{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T14:31:44Z","timestamp":1759847504446},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2010,2,4]],"date-time":"2010-02-04T00:00:00Z","timestamp":1265241600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Ann Oper Res"],"published-print":{"date-parts":[[2011,10]]},"DOI":"10.1007\/s10479-010-0688-z","type":"journal-article","created":{"date-parts":[[2010,2,3]],"date-time":"2010-02-03T22:40:58Z","timestamp":1265236858000},"page":"289-309","source":"Crossref","is-referenced-by-count":12,"title":["Embedding a state space model into\u00a0a\u00a0Markov\u00a0decision process"],"prefix":"10.1007","volume":"190","author":[{"given":"Lars","family":"Relund Nielsen","sequence":"first","affiliation":[]},{"given":"Erik","family":"J\u00f8rgensen","sequence":"additional","affiliation":[]},{"given":"S\u00f8ren","family":"H\u00f8jsgaard","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2010,2,4]]},"reference":[{"key":"688_CR1","series-title":"Lecture notes in computer science","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1007\/3-540-45446-2_20","volume-title":"Theoretical computer science: 7th Italian conference, ICTCS","author":"G. Ausiello","year":"2001","unstructured":"Ausiello, G., Franciosa, P. G., & Frigioni, D. (2001). Directed hypergraphs: Problems, algorithmic results, and a novel decremental approach. In Lecture notes in computer science. Vol. 2202: Theoretical computer science: 7th Italian conference, ICTCS (pp. 312\u2013328). Torino, Italy. Berlin: Springer."},{"issue":"1\u20132","key":"688_CR2","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/S0004-3702(00)00033-3","volume":"121","author":"C. Boutilier","year":"2000","unstructured":"Boutilier, C., Dearden, R., & Goldszmidt, M. (2000). Stochastic dynamic programming with factored representations. Artificial Intelligence, 121(1\u20132), 49\u2013107. doi: 10.1016\/s0004-3702(00)00033-3 .","journal-title":"Artificial Intelligence"},{"key":"688_CR3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.livsci.2006.05.023","volume":"105","author":"C. Cornou","year":"2006","unstructured":"Cornou, C. (2006). Automated oestrus detection methods in group housed sows: review of the current methods and perspectives for development. Livestock Science, 105, 1\u201311. doi: 10.1016\/j.livsci.2006.05.023 .","journal-title":"Livestock Science"},{"issue":"2\u20133","key":"688_CR4","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/S0168-1699(99)00016-2","volume":"22","author":"R. M. Mol de","year":"1999","unstructured":"de Mol, R. M., Keen, A., Kroeze, G. H., & Achten, J. M. F. H. (1999). Description of a detection model for oestrus and diseases in dairy cattle based on time series analysis combined with a Kalman filter. Computers and Electronics in Agriculture, 22(2\u20133), 171\u2013185. doi: 10.1016\/s0168-1699(99)00016-2 .","journal-title":"Computers and Electronics in Agriculture"},{"key":"688_CR5","doi-asserted-by":"crossref","first-page":"49","DOI":"10.2307\/2986113","volume":"43","author":"P. Diggle","year":"1994","unstructured":"Diggle, P., & Kenward, M. G. (1994). Informative dropout in longitudinal data analysis. Applied Statistics, 43, 49\u201393.","journal-title":"Applied Statistics"},{"key":"688_CR6","unstructured":"Feng, Z., Dearden, R., Meuleau, N., & Washington, R. (2004). Dynamic programming for structured continuous Markov decision problems. In AUAI \u201904: Proceedings of the 20th conference on uncertainty in artificial intelligence (pp. 154\u2013161). Arlington, Virginia, USA."},{"key":"688_CR7","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/S0301-6226(01)00323-2","volume":"75","author":"R. Firk","year":"2002","unstructured":"Firk, R., Stamer, E., Junge, W., & Krieter, J. (2002). Automation of oestrus detection in dairy cows: a review. Livestock Production Science, 75, 219\u2013232. doi: 10.1016\/s0301-6226(01)00323-2 .","journal-title":"Livestock Production Science"},{"issue":"2\u20133","key":"688_CR8","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/0166-218X(93)90045-P","volume":"42","author":"G. Gallo","year":"1993","unstructured":"Gallo, G., Longo, G., Pallottino, S., & Nguyen, S. (1993). Directed hypergraphs and applications. Discrete Applied Mathematics, 42(2\u20133), 177\u2013201. doi: 10.1016\/0166-218X(93)90045-P .","journal-title":"Discrete Applied Mathematics"},{"key":"688_CR9","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1613\/jair.1000","volume":"19","author":"C. Guestrin","year":"2003","unstructured":"Guestrin, C., Koller, D., Parr, R., & Venkataraman, S. (2003). Efficient solution algorithms for factored MDPs. Journal of Artificial Intelligence Research, 19, 399\u2013468.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"688_CR10","unstructured":"Guestrin, C., Hauskrecht, M., & Kveton, B. (2004). Solving factored MDPs with continuous and discrete variables. In AUAI \u201904: Proceedings of the 20th conference on uncertainty in artificial intelligence (pp. 235\u2013242). Arlington, Virginia, USA."},{"key":"688_CR11","doi-asserted-by":"crossref","first-page":"2975","DOI":"10.3168\/jds.S0022-0302(94)77239-8","volume":"77","author":"E. H. P. Houben","year":"1994","unstructured":"Houben, E. H. P., Huirne, R. B. M., Dijkhuizen, A. A., & Kristensen, A. R. (1994). Optimal replacement of mastitis cows determined by a hierarchic Markov process. Journal of Dairy Science, 77, 2975\u20132993.","journal-title":"Journal of Dairy Science"},{"key":"688_CR12","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1016\/0301-6226(91)90014-H","volume":"28","author":"R. B. M. Huirne","year":"1991","unstructured":"Huirne, R. B. M., Dijkhuizen, A. A., & Renkema, J. A. (1991). Economic optimization of sow replacement decisions on the personal computer by method of stochastic dynamic programming. Livestock Production Science, 28, 331\u2013347. doi: 10.1016\/0301-6226(91)90014-H .","journal-title":"Livestock Production Science"},{"key":"688_CR13","unstructured":"J\u00f8rgensen, E. (1992). Sow replacement: Reduction of state space in dynamic programming model and evaluation of benefit from using the model (Dina Research Report 6). National Institute of Animal Science."},{"issue":"1\u20132","key":"688_CR14","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/0308-521X(93)90066-B","volume":"42","author":"John O. S. Kennedy","year":"1993","unstructured":"Kennedy, John O. S., & Stott, Alistair W. (1993). An adaptive decision-making aid for dairy cow replacement. Agricultural Systems, 42(1\u20132), 25\u201339. doi: 10.1016\/0308-521X(93)90066-B .","journal-title":"Agricultural Systems"},{"key":"688_CR15","unstructured":"Kozlov, A. V., & Koller, D. (1997). Nonuniform dynamic discretization in hybrid networks. In The thirteenth conference on uncertainty in artificial intelligence (UAI-97) (pp.\u00a0314\u2013325). 1\u20133 August 1997."},{"issue":"2","key":"688_CR16","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/0377-2217(88)90031-8","volume":"35","author":"A. R. Kristensen","year":"1988","unstructured":"Kristensen, A. R. (1988). Hierarchic Markov processes and their applications in replacement models. European Journal of Operational Research, 35(2), 207\u2013215. doi: 10.1016\/0377-2217(88)90031-8 .","journal-title":"European Journal of Operational Research"},{"issue":"2","key":"688_CR17","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1093\/erae\/20.2.223","volume":"20","author":"A. R. Kristensen","year":"1993","unstructured":"Kristensen, A. R. (1993). Bayesian updating in hierarchical Markov-processes applied to the animal replacement-problem. European Review of Agricultural Economics, 20(2), 223\u2013239.","journal-title":"European Review of Agricultural Economics"},{"issue":"3","key":"688_CR18","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/S0168-1699(02)00183-7","volume":"38","author":"A. R. Kristensen","year":"2003","unstructured":"Kristensen, A. R. (2003). A general software system for Markov decision processes in herd management applications. Computers and Electronics in Agriculture, 38(3), 199\u2013215. doi: 10.1016\/s0168-1699(02)00183-7 .","journal-title":"Computers and Electronics in Agriculture"},{"key":"688_CR19","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1023\/A:1018921201113","volume":"94","author":"A. R. Kristensen","year":"2000","unstructured":"Kristensen, A. R., & J\u00f8rgensen, E. (2000). Multi-level hierarchic Markov processes as a framework for herd management support. Annals of Operations Research, 94, 69\u201389. doi: 10.1023\/A:1018921201113 .","journal-title":"Annals of Operations Research"},{"issue":"1","key":"688_CR20","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.livprodsci.2003.07.004","volume":"87","author":"A. R. Kristensen","year":"2004","unstructured":"Kristensen, A. R., & S\u00f8llested, T. A. (2004a). A sow replacement model using Bayesian updating in a three-level hierarchic Markov process I. Biological model. Livestock Production Science, 87(1), 13\u201324. doi: 10.1016\/j.livprodsci.2003.07.004 .","journal-title":"Livestock Production Science"},{"issue":"1","key":"688_CR21","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.livprodsci.2003.07.005","volume":"87","author":"A. R. Kristensen","year":"2004","unstructured":"Kristensen, A. R., & S\u00f8llested, T. A. (2004b). A sow replacement model using Bayesian updating in a three-level hierarchic Markov process, II. Optimization model. Livestock Production Science, 87(1), 25\u201336. doi: 10.1016\/j.livprodsci.2003.07.005 .","journal-title":"Livestock Production Science"},{"issue":"2","key":"688_CR22","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1046\/j.1365-2494.2003.00367.x","volume":"58","author":"G. Lien","year":"2003","unstructured":"Lien, G., Kristensen, A. R., Hegrenes, A., & Hardaker, J. B. (2003). Optimal length of leys in an area with winter damage problems. Grass and Forage Science, 58(2), 168\u2013177. doi: 10.1046\/j.1365-2494.2003.00367.x .","journal-title":"Grass and Forage Science"},{"issue":"1","key":"688_CR23","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.compag.2005.01.001","volume":"48","author":"T. N. Madsen","year":"2005","unstructured":"Madsen, T. N., Andersen, S., & Kristensen, A. R. (2005). Modelling the drinking patterns of young pigs using a state space model. Computers and Electronics in Agriculture, 48(1), 39\u201361. doi: 10.1016\/j.compag.2005.01.001 .","journal-title":"Computers and Electronics in Agriculture"},{"issue":"2","key":"688_CR24","doi-asserted-by":"crossref","first-page":"1164","DOI":"10.1016\/j.ejor.2005.06.011","volume":"175","author":"L. R. Nielsen","year":"2006","unstructured":"Nielsen, L. R., & Kristensen, A. R. (2006). Finding the K best policies in a finite-horizon Markov decision process. European Journal of Operational Research, 175(2), 1164\u20131179. doi: 10.1016\/j.ejor.2005.06.011 .","journal-title":"European Journal of Operational Research"},{"issue":"6","key":"688_CR25","doi-asserted-by":"crossref","first-page":"1477","DOI":"10.1016\/j.cor.2003.11.014","volume":"32","author":"L. R. Nielsen","year":"2005","unstructured":"Nielsen, L. R., Andersen, K. A., & Pretolani, D. (2005). Finding the K shortest hyperpaths. Computers and Operations Research, 32(6), 1477\u20131497. doi: 10.1016\/j.cor.2003.11.014 .","journal-title":"Computers and Operations Research"},{"issue":"1","key":"688_CR26","doi-asserted-by":"crossref","first-page":"75","DOI":"10.3168\/jds.2009-2209","volume":"93","author":"L. R. Nielsen","year":"2010","unstructured":"Nielsen, L. R., J\u00f8rgensen, E., Kristensen, A. R., & \u00d8stergaard, S. (2010). Optimal replacement policies for dairy cows based on daily yield measurements. Journal of Dairy Science, 93(1), 75\u201392.","journal-title":"Journal of Dairy Science"},{"key":"688_CR27","series-title":"Lecture notes in economics and mathematical systems","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/978-3-540-85646-7_6","volume-title":"Multiobjective programming and goal programming","author":"L. R. Nielsen","year":"2009","unstructured":"Nielsen, L. R., Pretolani, D., & Andersen, K. A. (2009). Bicriterion shortest paths in stochastic time-dependent networks. In Lecture notes in economics and mathematical systems. Vol. 618: Multiobjective programming and goal programming (pp. 57\u201367). Berlin: Springer. doi: 10.1007\/978-3-540-85646-7_6 ."},{"issue":"1","key":"688_CR28","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1016\/S0308-521X(02)00102-6","volume":"76","author":"L. M. Pla","year":"2003","unstructured":"Pla, L. M., Pomar, C., & Pomar, J. (2003). A Markov decision sow model representing the productive lifespan of herd sows. Agricultural Systems, 76(1), 253\u2013272. doi: 10.1016\/s0308-521X(02)00102-6 .","journal-title":"Agricultural Systems"},{"key":"688_CR29","series-title":"Wiley series in probability and mathematical statistics","doi-asserted-by":"crossref","DOI":"10.1002\/9780470316887","volume-title":"Markov decision processes","author":"M. L. Puterman","year":"1994","unstructured":"Puterman, M. L. (1994). Markov decision processes. Wiley series in probability and mathematical statistics. New York: Wiley-Interscience."},{"issue":"26","key":"688_CR30","doi-asserted-by":"crossref","first-page":"825","DOI":"10.1136\/vr.156.26.825","volume":"156","author":"A. W. Stott","year":"2005","unstructured":"Stott, A. W., Jones, G. M., Humphry, R. W., & Gunn, G. J. (2005). Financial incentive to control paratuberculosis (Johne\u2019s disease) on dairy farms in the United Kingdom. Veterinary Record, 156(26), 825\u2013831.","journal-title":"Veterinary Record"},{"key":"688_CR31","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1080\/09064709309410145","volume":"43","author":"I. Thysen","year":"1993","unstructured":"Thysen, I. (1993). Monitoring bulk tank somatic cell counts by a multi-process Kalman filter. Acta Agriculturae Scandinavica Section A\u2014Animal Science, 43, 58\u201364.","journal-title":"Acta Agriculturae Scandinavica Section A\u2014Animal Science"},{"issue":"2\u20133","key":"688_CR32","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/S0301-6226(02)00061-1","volume":"77","author":"N. Toft","year":"2002","unstructured":"Toft, N., & J\u00f8rgensen, E. (2002). Estimation of farm specific parameters in a longitudinal model for litter size with variance components and random dropout. Livestock Production Science, 77(2\u20133), 175\u2013185. doi: 10.1016\/s0301-6226(02)00061-1 .","journal-title":"Livestock Production Science"},{"issue":"11","key":"688_CR33","doi-asserted-by":"crossref","first-page":"2421","DOI":"10.3168\/jds.S0022-0302(99)75493-7","volume":"82","author":"J. Bebber Van","year":"1999","unstructured":"Van Bebber, J., Reinsch, N., Junge, W., & Kalm, E. (1999). Monitoring daily milk yields with a recursive test day repeatability model (Kalman filter). Journal of Dairy Science, 82(11), 2421.","journal-title":"Journal of Dairy Science"},{"key":"688_CR34","volume-title":"Bayesian forecasting and dynamic models","author":"M. West","year":"1997","unstructured":"West, M., & Harrison, J. (1997). Bayesian forecasting and dynamic models (2nd ed). New York: Springer.","edition":"2"},{"issue":"4","key":"688_CR35","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1017\/S0022029900004453","volume":"67","author":"C. Yalcin","year":"2000","unstructured":"Yalcin, C., & Stott, A. W. (2000). Dynamic programming to investigate financial impacts of mastitis control decisions in milk production systems. Journal of Dairy Research, 67(4), 515\u2013528, doi: 10.1017\/s0022029900004453 .","journal-title":"Journal of Dairy Research"}],"container-title":["Annals of Operations Research"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10479-010-0688-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10479-010-0688-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10479-010-0688-z","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,5,29]],"date-time":"2019-05-29T18:07:59Z","timestamp":1559153279000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10479-010-0688-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,2,4]]},"references-count":35,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2011,10]]}},"alternative-id":["688"],"URL":"https:\/\/doi.org\/10.1007\/s10479-010-0688-z","relation":{},"ISSN":["0254-5330","1572-9338"],"issn-type":[{"value":"0254-5330","type":"print"},{"value":"1572-9338","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,2,4]]}}}