{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,28]],"date-time":"2026-10-28T13:36:39Z","timestamp":1793194599652,"version":"4.5.0"},"reference-count":44,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,21]],"date-time":"2021-12-21T00:00:00Z","timestamp":1640044800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Large and densely sampled sensor datasets can contain a range of complex stochastic structures that are difficult to accommodate in conventional linear models. This can confound attempts to build a more complete picture of an animal\u2019s behavior by aggregating information across multiple asynchronous sensor platforms. The Livestock Informatics Toolkit (LIT) has been developed in R to better facilitate knowledge discovery of complex behavioral patterns across Precision Livestock Farming (PLF) data streams using novel unsupervised machine learning and information theoretic approaches. The utility of this analytical pipeline is demonstrated using data from a 6-month feed trial conducted on a closed herd of 185 mix-parity organic dairy cows. Insights into the tradeoffs between behaviors in time budgets acquired from ear tag accelerometer records were improved by augmenting conventional hierarchical clustering techniques with a novel simulation-based approach designed to mimic the complex error structures of sensor data. These simulations were then repurposed to compress the information in this data stream into robust empirically-determined encodings using a novel pruning algorithm. Nonparametric and semiparametric tests using mutual and pointwise information subsequently revealed complex nonlinear associations between encodings of overall time budgets and the order that cows entered the parlor to be milked.<\/jats:p>","DOI":"10.3390\/s22010001","type":"journal-article","created":{"date-parts":[[2021,12,21]],"date-time":"2021-12-21T09:50:43Z","timestamp":1640080243000},"page":"1","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Livestock Informatics Toolkit: A Case Study in Visually Characterizing Complex Behavioral Patterns across Multiple Sensor Platforms, Using Novel Unsupervised Machine Learning and Information Theoretic Approaches"],"prefix":"10.3390","volume":"22","author":[{"given":"Catherine","family":"McVey","sequence":"first","affiliation":[{"name":"Department of Animal Science, University of California Davis, Davis, CA 95616, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fushing","family":"Hsieh","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of California Davis, Davis, CA 95616, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diego","family":"Manriquez","sequence":"additional","affiliation":[{"name":"Department of Animal Science, Colorado State University, Fort Collins, CO 80523, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7111-3377","authenticated-orcid":false,"given":"Pablo","family":"Pinedo","sequence":"additional","affiliation":[{"name":"Department of Animal Science, Colorado State University, Fort Collins, CO 80523, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1667-4280","authenticated-orcid":false,"given":"Kristina","family":"Horback","sequence":"additional","affiliation":[{"name":"Department of Animal Science, University of California Davis, Davis, CA 95616, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"634338","DOI":"10.3389\/fvets.2021.634338","article-title":"A Systematic Review on Commercially Available and Validated Sensor Technologies for Welfare Assessment of Dairy Cattle","volume":"8","author":"Stygar","year":"2021","journal-title":"Front. Veter. Sci."},{"key":"ref_2","unstructured":"Pinheiro, J., and Bates, D. (2006). Mixed-Effects Models in S and S-PLUS, Springer Science & Business Media."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1111\/2041-210X.12772","article-title":"A guide to null models for animal social network analysis","volume":"8","author":"Farine","year":"2017","journal-title":"Methods Ecol. Evol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"433","DOI":"10.3389\/fpsyg.2016.00433","article-title":"Connections Matter: Social Networks and Lifespan Health in Primate Translational Models","volume":"7","author":"McCowan","year":"2016","journal-title":"Front. Psychol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.jveb.2007.09.005","article-title":"Interactions between housed dairy cows during feeding, lying, and standing","volume":"3","author":"Cooper","year":"2008","journal-title":"J. Vet. Behav."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.anbehav.2016.12.005","article-title":"Applications of machine learning in animal behaviour studies","volume":"124","author":"Valletta","year":"2017","journal-title":"Anim. Behav."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"523","DOI":"10.3389\/fvets.2020.00523","article-title":"Mind the Queue: A Case Study in Visualizing Heterogeneous Behavioral Patterns in Livestock Sensor Data Using Unsupervised Machine Learning Techniques","volume":"7","author":"McVey","year":"2020","journal-title":"Front. Vet. Sci."},{"key":"ref_8","unstructured":"Kirby, M. (2001). Geometric Data Analysis: An Empirical Approach to Dimensionality Reduction and the Study of Patterns, John Wiley & Sons."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"James, G., Witten, D., Hastie, T., and Tibshirani, R. (2013). An Introduction to Statistical Learning, Springer.","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"ref_10","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer Science & Business Media."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hsieh, F., Chou, E., and Chen, T.-L. (2021). Mimicking Complexity of Structured Data Matrix\u2019s Information Content: Categorical Exploratory Data Analysis. Entropy, 23.","DOI":"10.3390\/e23050594"},{"key":"ref_12","unstructured":"MacKay, D.J.C. (2003). Information Theory, Inference, and Learning Algorithms, Cambridge University Press."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.compag.2017.07.007","article-title":"The application of cluster analysis methods in assessment of daily physical activity of dairy cows milked in the Voluntary Milking System","volume":"141","author":"Adamczyk","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.compag.2007.01.002","article-title":"Robust classification of animal tracking data","volume":"56","author":"Schwager","year":"2007","journal-title":"Comput. Electron. Agric."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.compag.2014.12.002","article-title":"Dynamic cattle behavioural classification using supervised ensemble classifiers","volume":"111","author":"Dutta","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Xu, H., Li, S., Lee, C., Ni, W., Abbott, D., Johnson, M., Lea, J.M., Yuan, J., and Campbell, D.L.M. (2020). Analysis of Cattle Social Transitional Behaviour: Attraction and Repulsion. Sensors, 20.","DOI":"10.3390\/s20185340"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1017\/S1751731115001032","article-title":"Investigating integument alterations in cubicle housed dairy cows: Which types and locations can be combined?","volume":"10","author":"Brenninkmeyer","year":"2016","journal-title":"Animal"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lee, M., Lee, S., Park, J., and Seo, S. (2020). Clustering and Characterization of the Lactation Curves of Dairy Cows Using K-Medoids Clustering Algorithm. Animal, 10.","DOI":"10.3390\/ani10081348"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Fushing, H., Liu, S.-Y., Hsieh, Y.-C., and McCowan, B. (2018). From patterned response dependency to structured covariate dependency: Entropy based categorical-pattern-matching. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0198253"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"38","DOI":"10.3389\/fams.2018.00038","article-title":"Coupling Geometry on Binary Bipartite Networks: Hypotheses Testing on Pattern Geometry and Nestedness","volume":"4","author":"Guan","year":"2018","journal-title":"Front. Appl. Math. Stat."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"664","DOI":"10.15232\/pas.2018-01749","article-title":"Case Study: Assessment of human-conditioned sorting behavior in dairy cows in farm research trials","volume":"34","author":"Manriquez","year":"2018","journal-title":"Prof. Anim. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12917-019-2199-8","article-title":"The effect of an organic rumen-protected fat supplement on performance, metabolic status, and health of dairy cows","volume":"15","author":"Manriquez","year":"2019","journal-title":"BMC Vet. Res."},{"key":"ref_23","unstructured":"R Core Team (2018, August 17). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. Available online: https:\/\/www.R-project.org\/."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2974","DOI":"10.3168\/jds.2013-7560","article-title":"Technical note: Evaluation of an earattached movement sensor to record cow feeding behavior and activity","volume":"97","author":"Bikker","year":"2014","journal-title":"J. Dairy Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2492","DOI":"10.3168\/jds.2016-12534","article-title":"Technical note: Validation of an ear-tag accelerometer sensor to determine rumination, eating, and activity behaviors of grazing dairy cattle","volume":"101","author":"Pereira","year":"2018","journal-title":"J. Dairy Sci."},{"key":"ref_26","unstructured":"Agresti, A. (2013). Categorical Data Analysis, John Wiley & Sons, Inc.. [3rd ed.]."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Shirkhorshidi, A.S., Aghabozorgi, S., and Wah, T.Y. (2015). A Comparison Study on Similarity and Dissimilarity Measures in Clustering Continuous Data. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0144059"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Efron, B., and Tibshirani, R.J. (1993). An Introduction to the Bootstrap, Springer.","DOI":"10.1007\/978-1-4899-4541-9"},{"key":"ref_29","unstructured":"Papadakis, M., Tsagris, M., Dimitriadis, M., Fafalios, S., Tsamardinos, I., Fasiolo, M., Borboudakis, G., Burkardt, J., Zou, C., and Lakiotaki, K. (2020, March 10). Rfast: A Collection of Efficient and Extremely Fast R Functions (1.9.9). Available online: https:\/\/CRAN.R-project.org\/package=Rfast."},{"key":"ref_30","unstructured":"Kolde, R. (2019, January 04). pheatmap: Pretty Heatmaps. Available online: https:\/\/CRAN.R-project.org\/package=pheatmap."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wickham, H. (2016). ggplot2: Elegant Graphics for Data Analysis, Springer. Available online: http:\/\/ggplot2.org.","DOI":"10.1007\/978-3-319-24277-4_9"},{"key":"ref_32","unstructured":"Kassambara, A. (2020, July 06). ggpubr: \u201cggplot2\u201d Based Publication Ready Plots (0.4.0). Available online: https:\/\/CRAN.R-project.org\/package=ggpubr."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"20","DOI":"10.3168\/jds.2019-18074","article-title":"Invited review: Lying time and the welfare of dairy cows","volume":"104","author":"Tucker","year":"2021","journal-title":"J. Dairy Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1080\/01621459.1971.10482356","article-title":"Objective Criteria for the Evaluation of Clustering Methods","volume":"66","author":"Rand","year":"1971","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_35","unstructured":"Hausser, J., and Strimmer, K. (2021, August 09). entropy: Estimation of Entropy, Mutual Information and Related Quantities (1.3.0). Available online: https:\/\/CRAN.R-project.org\/package=entropy."},{"key":"ref_36","first-page":"1469","article-title":"Entropy Inference and the James-Stein Estimator, with Application to Nonlinear Gene Association Networks","volume":"10","author":"Hausser","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_37","unstructured":"Johnson, M. (2021, September 10). Confidence Intervals on Likelihood Estimates for Estimating Association Strength. Available online: http:\/\/web.science.mq.edu.au\/~mjohnson\/papers\/sigdiff.pdf."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/0304-3762(82)90131-6","article-title":"Order of cow entry at milking and its relationships with milk yield and consistency of the order","volume":"8","author":"Rathore","year":"1982","journal-title":"Appl. Anim. Ethol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1016\/0304-3762(75)90020-6","article-title":"Some preliminary field observations on the order of entry of cows into herringbone parlours","volume":"1","author":"Gadbury","year":"1975","journal-title":"Appl. Anim. Ethol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.applanim.2011.11.012","article-title":"Genetic and non-genetic factors associated with milking order in lactating dairy cows","volume":"136","author":"Berry","year":"2012","journal-title":"Appl. Anim. Behav. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"603","DOI":"10.3168\/jds.2017-12748","article-title":"Short communication: Milking order consistency of dairy cows in large Australian herds","volume":"101","author":"Beggs","year":"2018","journal-title":"J. Dairy Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/0304-3762(76)90060-2","article-title":"Relation between milking order and dominance value in a group of dairy cows","volume":"2","year":"1976","journal-title":"Appl. Anim. Ethol."},{"key":"ref_43","first-page":"36","article-title":"Leadership in a Herd of Dairy Cows","volume":"19","author":"Kilgour","year":"1959","journal-title":"Proc. N. Z. Soc. Anim. Prod."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1163\/156853983X00183","article-title":"Movement Orders and Leadership in a Semi-Wild Cattle Herd","volume":"83","author":"Reinhardt","year":"1983","journal-title":"Behaviour"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/1\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:50:19Z","timestamp":1760169019000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,21]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["s22010001"],"URL":"https:\/\/doi.org\/10.3390\/s22010001","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,21]]}}}