{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"bioRxiv"}],"indexed":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T19:22:24Z","timestamp":1789068144073,"version":"build-2803163510"},"posted":{"date-parts":[[2023,2,18]]},"group-title":"Animal Behavior and Cognition","reference-count":24,"publisher":"openRxiv","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2023,2,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                <jats:p>Characterizing animal behavior requires methods to distill 3D movements from video data. Though keypoint tracking has emerged as a widely used solution to this problem, it only provides a limited view of pose, reducing the body of an animal to a sparse set of experimenter-defined points. To more completely capture 3D pose, recent studies have fit 3D mesh models to subjects in image and video data. However, despite the importance of mice as a model organism in neuroscience research, these methods have not been applied to the 3D reconstruction of mouse behavior. Here, we present ArMo, an articulated mesh model of the laboratory mouse, and demonstrate its application to multi-camera recordings of head-fixed mice running on a spherical treadmill. Using an end-to-end gradient based optimization procedure, we fit the shape and pose of a dense 3D mouse model to data-derived keypoint and point cloud observations. The resulting reconstructions capture the shape of the animal\u2019s surface while compactly summarizing its movements as a time series of 3D skeletal joint angles. ArMo therefore provides a novel alternative to the sparse representations of pose more commonly used in neuroscience research.<\/jats:p>","DOI":"10.1101\/2023.02.17.526719","type":"posted-content","created":{"date-parts":[[2023,2,18]],"date-time":"2023-02-18T17:30:19Z","timestamp":1676741419000},"source":"Crossref","is-referenced-by-count":4,"title":["ArMo: An Articulated Mesh Approach for Mouse 3D Reconstruction"],"prefix":"10.64898","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9359-8907","authenticated-orcid":false,"given":"James P.","family":"Bohnslav","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8606-6518","authenticated-orcid":false,"given":"Mohammed Abdal Monium","family":"Osman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7493-6958","authenticated-orcid":false,"given":"Akshay","family":"Jaggi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sofia","family":"Soares","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6100-6084","authenticated-orcid":false,"given":"Caleb","family":"Weinreb","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8068-3862","authenticated-orcid":false,"given":"Sandeep Robert","family":"Datta","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9850-2268","authenticated-orcid":false,"given":"Christopher D.","family":"Harvey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"54368","reference":[{"key":"2023022103400768000_2023.02.17.526719v1.1","doi-asserted-by":"crossref","unstructured":"Badger, M. , Wang, Y. , Modh, A. , Perkes, A. , Kolotouros, N. , Pfrommer, B. G. ,\u2026 & Daniilidis, K. (2020, August). 3D bird reconstruction: a dataset, model, and shape recovery from a single view. In European Conference on Computer Vision (pp. 1\u201317). Springer, Cham.","DOI":"10.1007\/978-3-030-58523-5_1"},{"key":"2023022103400768000_2023.02.17.526719v1.2","doi-asserted-by":"crossref","unstructured":"Biggs, B. , Roddick, T. , Fitzgibbon, A. , & Cipolla, R. (2018, December). Creatures great and smal: Recovering the shape and motion of animals from video. In Asian Conference on Computer Vision (pp. 3\u201319). Springer, Cham.","DOI":"10.1007\/978-3-030-20873-8_1"},{"key":"2023022103400768000_2023.02.17.526719v1.3","doi-asserted-by":"crossref","unstructured":"Bogo, F. , Kanazawa, A. , Lassner, C. , Gehler, P. , Romero, J. , & Black, M. J. (2016, October). Keep it SMPL: Automatic estimation of 3D human pose and shape from a single image. In European conference on computer vision (pp. 561\u2013578). Springer, Cham.","DOI":"10.1007\/978-3-319-46454-1_34"},{"issue":"11","key":"2023022103400768000_2023.02.17.526719v1.4","first-page":"120","article-title":"The openCV library","volume":"25","year":"2000","journal-title":"Dr. Dobb\u2019s Journal: Software Tools for the Professional Programmer"},{"key":"2023022103400768000_2023.02.17.526719v1.5","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2019.09.038"},{"issue":"5","key":"2023022103400768000_2023.02.17.526719v1.6","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1038\/s41592-021-01106-6","article-title":"Geometric deep learning enables 3D kinematic profiling across species and environments","volume":"18","year":"2021","journal-title":"Nature methods"},{"issue":"1","key":"2023022103400768000_2023.02.17.526719v1.7","first-page":"1","article-title":"Automatic mapping of multiplexed social receptive fields by deep learning and GPU-accelerated 3D videography","volume":"13","year":"2022","journal-title":"Nature communications"},{"key":"2023022103400768000_2023.02.17.526719v1.8","first-page":"5","article-title":"Statistical methods for tomographic image reconstruction","volume":"4","year":"1987","journal-title":"Bull. Int. Stat. Inst"},{"key":"2023022103400768000_2023.02.17.526719v1.9","doi-asserted-by":"publisher","DOI":"10.1038\/nature08499"},{"key":"2023022103400768000_2023.02.17.526719v1.10","doi-asserted-by":"crossref","unstructured":"Huang, Y. , Bogo, F. , Lassner, C. , Kanazawa, A. , Gehler, P. V. , Romero, J. ,\u2026 & Black, M. J. (2017, October). Towards accurate marker-less human shape and pose estimation over time. In 2017 international conference on 3D vision (3DV) (pp. 421\u2013430).","DOI":"10.1109\/3DV.2017.00055"},{"key":"2023022103400768000_2023.02.17.526719v1.11","doi-asserted-by":"crossref","unstructured":"Kolotouros, N. , Pavlakos, G. , Black, M. J. , & Daniilidis, K. (2019). Learning to reconstruct 3D human pose and shape via model-fitting in the loop. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (pp. 2252\u20132261).","DOI":"10.1109\/ICCV.2019.00234"},{"key":"2023022103400768000_2023.02.17.526719v1.12","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2016.12.041"},{"issue":"6","key":"2023022103400768000_2023.02.17.526719v1.13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2816795.2818013","article-title":"SMPL: A skinned multi-person linear model","volume":"34","year":"2015","journal-title":"ACM transactions on graphics (TOG)"},{"key":"2023022103400768000_2023.02.17.526719v1.14","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2019.10.008"},{"key":"2023022103400768000_2023.02.17.526719v1.15","doi-asserted-by":"crossref","first-page":"102522","DOI":"10.1016\/j.conb.2022.02.002","article-title":"Leaving flatland: Advances in 3D behavioral measurement","volume":"73","year":"2022","journal-title":"Current Opinion in Neurobiology"},{"issue":"11","key":"2023022103400768000_2023.02.17.526719v1.16","doi-asserted-by":"crossref","first-page":"1500","DOI":"10.1038\/s41592-022-01634-9","article-title":"Estimation of skeletal kinematics in freely moving rodents","volume":"19","year":"2022","journal-title":"Nature methods"},{"issue":"7","key":"2023022103400768000_2023.02.17.526719v1.17","doi-asserted-by":"crossref","first-page":"2152","DOI":"10.1038\/s41596-019-0176-0","article-title":"Using DeepLabCut for 3D markerless pose estimation across species and behaviors","volume":"14","year":"2019","journal-title":"Nature protocols"},{"key":"2023022103400768000_2023.02.17.526719v1.18","unstructured":"Paszke, A. , Gross, S. , Chintala, S. , Chanan, G. , Yang, E. , DeVito, Z. ,\u2026 & Lerer, A. (2017). Automatic differentiation in pytorch."},{"key":"2023022103400768000_2023.02.17.526719v1.19","unstructured":"Ravi, N. , Reizenstein, J. , Novotny, D. , Gordon, T. , Lo, W. Y. , Johnson, J. , & Gkioxari, G. (2020). Accelerating 3d deep learning with pytorch3d. arXiv preprint arXiv:2007.08501."},{"key":"2023022103400768000_2023.02.17.526719v1.20","doi-asserted-by":"crossref","unstructured":"Schneider, A. , Zimmermann, C. , Alyahyay, M. , Steenbergen, F. , Brox, T. , & Diester, I. (2022). 3D pose estimation enables virtual head fixation in freely moving rats. Neuron.","DOI":"10.1101\/2022.04.14.488303"},{"issue":"10","key":"2023022103400768000_2023.02.17.526719v1.21","first-page":"3349","article-title":"Deep high-resolution representation learning for visual recognition","volume":"43","year":"2020","journal-title":"IEEE transactions on pattern analysis and machine intelligence"},{"key":"2023022103400768000_2023.02.17.526719v1.22","unstructured":"Zhang, L. , Dunn, T. , Marshall, J. , Olveczky, B. , & Linderman, S. (2021, March). Animal pose estimation from video data with a hierarchical von Mises-Fisher-Gaussian model. In International Conference on Artificial Intelligence and Statistics (pp. 2800\u20132808). PMLR."},{"key":"2023022103400768000_2023.02.17.526719v1.23","doi-asserted-by":"crossref","unstructured":"Zhang, Z. (2018, June). Improved adam optimizer for deep neural networks. In 2018 IEEE\/ACM 26th International Symposium on Quality of Service (IWQoS) (pp. 1\u20132). IEEE","DOI":"10.1109\/IWQoS.2018.8624183"},{"key":"2023022103400768000_2023.02.17.526719v1.24","doi-asserted-by":"crossref","unstructured":"Zuffi, S. , Kanazawa, A. , Jacobs, D. W. , & Black, M. J. (2017). 3D menagerie: Modeling the 3D shape and pose of animals. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 6365\u20136373).","DOI":"10.1109\/CVPR.2017.586"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1101\/2023.02.17.526719","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T04:17:12Z","timestamp":1768450632000},"score":1,"resource":{"primary":{"URL":"http:\/\/biorxiv.org\/lookup\/doi\/10.1101\/2023.02.17.526719"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,18]]},"references-count":24,"URL":"https:\/\/doi.org\/10.1101\/2023.02.17.526719","relation":{},"subject":[],"published":{"date-parts":[[2023,2,18]]},"subtype":"preprint"}}