{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T07:43:55Z","timestamp":1776843835112,"version":"3.51.2"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1012222","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T00:00:00Z","timestamp":1720137600000}}],"reference-count":59,"publisher":"Public Library of Science (PLoS)","issue":"6","license":[{"start":{"date-parts":[[2024,6,24]],"date-time":"2024-06-24T00:00:00Z","timestamp":1719187200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004189","name":"Max-Planck-Gesellschaft","doi-asserted-by":"publisher","award":["Independent Research Group The Comparative Bioacoustics Group"],"award-info":[{"award-number":["Independent Research Group The Comparative Bioacoustics Group"]}],"id":[{"id":"10.13039\/501100004189","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001732","name":"Danish National Research Foundation","doi-asserted-by":"crossref","award":["DNRF117"],"award-info":[{"award-number":["DNRF117"]}],"id":[{"id":"10.13039\/501100001732","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000780","name":"European Union","doi-asserted-by":"crossref","award":["ERC, TOHR, 101041885"],"award-info":[{"award-number":["ERC, TOHR, 101041885"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["VI.Veni 0.201G.047"],"award-info":[{"award-number":["VI.Veni 0.201G.047"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Language in Interaction"},{"name":"Postdoctoral Development Fund"}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Biological structures are defined by rigid elements, such as bones, and elastic elements, like muscles and membranes. Computer vision advances have enabled automatic tracking of moving animal skeletal poses. Such developments provide insights into complex time-varying dynamics of biological motion. Conversely, the elastic soft-tissues of organisms, like the nose of elephant seals, or the buccal sac of frogs, are poorly studied and no computer vision methods have been proposed. This leaves major gaps in different areas of biology. In primatology, most critically, the function of air sacs is widely debated; many open questions on the role of air sacs in the evolution of animal communication, including human speech, remain unanswered. To support the dynamic study of soft-tissue structures, we present a toolkit for the automated tracking of semi-circular elastic structures in biological video data. The toolkit contains unsupervised computer vision tools (using Hough transform) and supervised deep learning (by adapting DeepLabCut) methodology to track inflation of laryngeal air sacs or other biological spherical objects (e.g., gular cavities). Confirming the value of elastic kinematic analysis, we show that air sac inflation correlates with acoustic markers that likely inform about body size. Finally, we present a pre-processed audiovisual-kinematic dataset of 7+ hours of closeup audiovisual recordings of siamang (<jats:italic>Symphalangus syndactylus<\/jats:italic>) singing. This toolkit (<jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/WimPouw\/AirSacTracker\" xlink:type=\"simple\">https:\/\/github.com\/WimPouw\/AirSacTracker<\/jats:ext-link>) aims to revitalize the study of non-skeletal morphological structures across multiple species.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1012222","type":"journal-article","created":{"date-parts":[[2024,6,24]],"date-time":"2024-06-24T19:35:09Z","timestamp":1719257709000},"page":"e1012222","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":3,"title":["A toolkit for the dynamic study of air sacs in siamang and other elastic circular structures"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9210-7934","authenticated-orcid":true,"given":"Lara S.","family":"Burchardt","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yana","family":"van de Sande","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mounia","family":"Kehy","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9545-2242","authenticated-orcid":true,"given":"Marco","family":"Gamba","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Ravignani","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2729-6502","authenticated-orcid":true,"given":"Wim","family":"Pouw","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2024,6,24]]},"reference":[{"key":"pcbi.1012222.ref001","doi-asserted-by":"crossref","unstructured":"Cao Z, Simon T, Wei S-E, Sheikh Y. Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, HI: IEEE; 2017. pp. 1302\u20131310. doi: 10.1109\/CVPR.2017.143","DOI":"10.1109\/CVPR.2017.143"},{"key":"pcbi.1012222.ref002","article-title":"MediaPipe: A Framework for Building Perception Pipelines.","author":"C Lugaresi","year":"2019","journal-title":"arXiv"},{"key":"pcbi.1012222.ref003","doi-asserted-by":"crossref","first-page":"1281","DOI":"10.1038\/s41593-018-0209-y","article-title":"DeepLabCut: markerless pose estimation of user-defined body parts with deep learning","volume":"21","author":"A Mathis","year":"2018","journal-title":"Nat Neurosci"},{"key":"pcbi.1012222.ref004","doi-asserted-by":"crossref","first-page":"2152","DOI":"10.1038\/s41596-019-0176-0","article-title":"Using DeepLabCut for 3D markerless pose estimation across species and behaviors.","volume":"14","author":"T Nath","year":"2019","journal-title":"Nat Protoc."},{"key":"pcbi.1012222.ref005","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1038\/s41592-018-0234-5","article-title":"Fast animal pose estimation using deep neural networks.","volume":"16","author":"TD Pereira","year":"2019","journal-title":"Nat Methods"},{"key":"pcbi.1012222.ref006","doi-asserted-by":"crossref","first-page":"4560","DOI":"10.1038\/s41467-020-18441-5","article-title":"Automated markerless pose estimation in freely moving macaques with OpenMonkeyStudio.","volume":"11","author":"PC Bala","year":"2020","journal-title":"Nat Commun"},{"key":"pcbi.1012222.ref007","doi-asserted-by":"crossref","DOI":"10.3389\/fnbeh.2020.581154","article-title":"MacaquePose: A Novel \u201cIn the Wild\u201d Macaque Monkey Pose Dataset for Markerless Motion Capture.","volume":"14","author":"R Labuguen","year":"2021","journal-title":"Frontiers in Behavioral Neuroscience"},{"key":"pcbi.1012222.ref008","article-title":"OpenApePose: a database of annotated ape photographs for pose estimation.","author":"N Desai","year":"2022","journal-title":"arXiv"},{"key":"pcbi.1012222.ref009","doi-asserted-by":"crossref","first-page":"1560","DOI":"10.1111\/1365-2656.13932","article-title":"DeepWild: Application of the pose estimation tool DeepLabCut for behaviour tracking in wild chimpanzees and bonobos","volume":"92","author":"C Wiltshire","year":"2023","journal-title":"Journal of Animal Ecology"},{"key":"pcbi.1012222.ref010","doi-asserted-by":"crossref","DOI":"10.1126\/sciadv.abi4883","article-title":"Automated audiovisual behavior recognition in wild primates","volume":"7","author":"M Bain","year":"2021","journal-title":"Science Advances"},{"key":"pcbi.1012222.ref011","article-title":"Visual Recognition of Great Ape Behaviours in the Wild.","author":"F Sakib","year":"2020","journal-title":"arXiv"},{"key":"pcbi.1012222.ref012","unstructured":"Sande Y, Pouw W, Southern L. Automated Recognition of Grooming Behavior in Wild Chimpanzees. Proceedings of the annual meeting of the Cognitive Science Society 2024. Rotterdam; 2024."},{"key":"pcbi.1012222.ref013","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1080\/00222895.2013.798252","article-title":"The medium of haptic perception: A tensegrity hypothesis","volume":"46","author":"MT Turvey","year":"2014","journal-title":"Journal of Motor Behavior"},{"key":"pcbi.1012222.ref014","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.jbmt.2008.04.038","article-title":"Tensegrity and mechanotransduction","volume":"12","author":"DW Ingber","year":"2008","journal-title":"Journal of Bodywork and Movement Therapies"},{"key":"pcbi.1012222.ref015","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1093\/jole\/lzx012","article-title":"Gorillas may use their laryngeal air sacs for whinny-type vocalizations and male display","volume":"2","author":"M Perlman","year":"2017","journal-title":"Journal of Language Evolution"},{"key":"pcbi.1012222.ref016","doi-asserted-by":"crossref","first-page":"3719","DOI":"10.1242\/jeb.033076","article-title":"Vocal and anatomical evidence for two-voiced sound production in the greater sage-grouse Centrocercus urophasianus","volume":"212","author":"AH Krakauer","year":"2009","journal-title":"Journal of Experimental Biology"},{"key":"pcbi.1012222.ref017","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1537\/ase.180309","article-title":"Sexual selection and the loss of laryngeal air sacs during the evolution of speech","volume":"126","author":"JC Dunn","year":"2018","journal-title":"Anthropological Science"},{"key":"pcbi.1012222.ref018","doi-asserted-by":"crossref","first-page":"e23015","DOI":"10.1371\/journal.pone.0023015","article-title":"Transmission Characteristics of Primate Vocalizations: Implications for Acoustic Analyses.","volume":"6","author":"P Maciej","year":"2011","journal-title":"PLOS ONE."},{"key":"pcbi.1012222.ref019","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.anbehav.2014.07.027","article-title":"The anuran vocal sac: a tool for multimodal signalling","volume":"97","author":"I Starnberger","year":"2014","journal-title":"Anim Behav"},{"key":"pcbi.1012222.ref020","doi-asserted-by":"crossref","first-page":"e02147","DOI":"10.1016\/j.gecco.2022.e02147","article-title":"Invasion of annual grasses following wildfire corresponds to maladaptive habitat selection by a sagebrush ecosystem indicator species","volume":"37","author":"BE Brussee","year":"2022","journal-title":"Global Ecology and Conservation"},{"key":"pcbi.1012222.ref021","doi-asserted-by":"crossref","first-page":"1661","DOI":"10.1126\/science.284.5420.1661","article-title":"Contribution of gular pumping to lung ventilation in monitor lizards","author":"T Owerkowicz","year":"1999","journal-title":"Science"},{"key":"pcbi.1012222.ref022","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1121\/1.2924125","article-title":"Mammalian laryngeal air sacs add variability to the vocal tract impedance: physical and computational modeling","volume":"124","author":"T Riede","year":"2008","journal-title":"J Acoust Soc Am"},{"key":"pcbi.1012222.ref023","article-title":"honesty","author":"T Fitch","year":"2002","journal-title":"New York: Springer"},{"key":"pcbi.1012222.ref024","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/978-981-15-4250-3_2","volume-title":"The Origins of Language Revisited: Differentiation from Music and the Emergence of Neurodiversity and Autism.","author":"T. Nishimura","year":"2020"},{"key":"pcbi.1012222.ref025","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4939-5614-2","article-title":"Evolution of Gibbons and Siamang: Phylogeny, Morphology, and Cognition.","author":"U Reichard","year":"2016"},{"key":"pcbi.1012222.ref026","article-title":"Evidence for Vocal Flexibility in Wild Siamang (Symphalangus syndactylus) Ululating Scream Phrases.","author":"J D\u2019Agostino","year":"2023","journal-title":"Int J Primatol"},{"key":"pcbi.1012222.ref027","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1007\/978-1-4939-5614-2_15","volume-title":"Evolution of Gibbons and Siamang: Phylogeny, Morphology, and Cognition.","author":"H. Koda","year":"2016"},{"key":"pcbi.1012222.ref028","doi-asserted-by":"crossref","first-page":"e73","DOI":"10.1371\/journal.pone.0000073","article-title":"The Syntax and Meaning of Wild Gibbon Songs.","volume":"1","author":"E Clarke","year":"2006","journal-title":"PLOS ONE."},{"key":"pcbi.1012222.ref029","first-page":"103","volume-title":"Gibbon songs and human music from an evolutionary perspective. The origins of music","author":"T. Geissmann","year":"2000"},{"key":"pcbi.1012222.ref030","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1126\/science.193.4249.235","article-title":"Gibbons and their territorial songs","volume":"193","author":"JT Marshall","year":"1976","journal-title":"Science"},{"key":"pcbi.1012222.ref031","article-title":"Who you live with and what you duet for: a review of the function of primate duets in relation to their social organization","author":"C De Gregorio","year":"2024","journal-title":"J Comp Physiol A"},{"key":"pcbi.1012222.ref032","doi-asserted-by":"crossref","first-page":"3077","DOI":"10.1121\/1.1736273","article-title":"Siamang gibbons exceed the saccular threshold: Intensity of the song of Hylobates syndactylus","volume":"115","author":"NP McAngus Todd","year":"2004","journal-title":"The Journal of the Acoustical Society of America"},{"key":"pcbi.1012222.ref033","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1111\/j.1096-3642.1924.tb03336.x","article-title":"A Study by Serial Sections of the Structure of the Larynx of Hylobates syndactylus (Siamang Gibbon).","volume":"94","author":"F. Mott","year":"1924","journal-title":"Proceedings of the Zoological Society of London"},{"key":"pcbi.1012222.ref034","doi-asserted-by":"crossref","first-page":"3329","DOI":"10.1121\/1.3257544","article-title":"Acoustic analysis of primate air sacs and their effect on vocalization","volume":"126","author":"B. de Boer","year":"2009","journal-title":"J Acoust Soc Am"},{"key":"pcbi.1012222.ref035","first-page":"309","article-title":"Voice and larynx in african and asiatic colobidae","volume":"54","author":"WC Osman Hill","journal-title":"Journal of the Bombay Natural History Society"},{"key":"pcbi.1012222.ref036","volume-title":"The Evolution of the Human Head.","author":"D. Lieberman","year":"2011"},{"key":"pcbi.1012222.ref037","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1111\/j.1600-0684.1991.tb00551.x","article-title":"The veterinary management of a laryngeal air sac infection in a free-ranging mountain gorilla","volume":"20","author":"BE Hastings","year":"1991","journal-title":"Journal of Medical Primatology"},{"key":"pcbi.1012222.ref038","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1016\/B978-0-12-381366-4.00009-2","author":"LJ Lowenstine","year":"2012","journal-title":"Respiratory System Diseases of Nonhuman Primates. Nonhuman Primates in Biomedical Research"},{"key":"pcbi.1012222.ref039","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1111\/j.1600-0684.2012.00547.x","article-title":"Pathology of spontaneous air sacculitis in 37 baboons and seven chimpanzees and a brief review of the literature","volume":"41","author":"S Kumar","year":"2012","journal-title":"J Med Primatol"},{"key":"pcbi.1012222.ref040","doi-asserted-by":"crossref","first-page":"179","DOI":"10.2354\/psj.12.179","article-title":"The origin of the completely closed glottis. Why does not the monkey fall from a tree?","volume":"12","author":"S. Hayama","year":"1996","journal-title":"Primate Research."},{"key":"pcbi.1012222.ref041","first-page":"70","article-title":"The functions of laryngeal air sacs in primates: A new hypothesis.","volume":"73","author":"G Hewitt","year":"2002","journal-title":"FPR"},{"key":"pcbi.1012222.ref042","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511525766","volume-title":"The anatomy and physiology of the mamalian larynx","author":"DFN Harrison","year":"1995"},{"key":"pcbi.1012222.ref043","doi-asserted-by":"crossref","first-page":"1272","DOI":"10.1126\/science.283.5406.1272","article-title":"Communication Goes Multimodal.","volume":"283","author":"SR Partan","year":"1999","journal-title":"Science"},{"key":"pcbi.1012222.ref044","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1007\/s10764-008-9253-x","article-title":"Orangutan Long Call Degradation and Individuality Over Distance: A Playback Approach","volume":"29","author":"AR Lameira","year":"2008","journal-title":"Int J Primatol"},{"key":"pcbi.1012222.ref045","doi-asserted-by":"crossref","first-page":"2951","DOI":"10.1121\/1.418523","article-title":"The acoustic features of vowel-like grunt calls in chacma baboons (Papio cyncephalus ursinus): implications for production processes and functions.","volume":"101","author":"MJ Owren","year":"1997","journal-title":"J Acoust Soc Am"},{"key":"pcbi.1012222.ref046","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1146\/annurev-linguistics-011817-045748","article-title":"The Biology and Evolution of Speech","volume":"4","author":"WT Fitch","year":"2018","journal-title":"A Comparative Analysis. Annual Review of Linguistics"},{"key":"pcbi.1012222.ref047","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1038\/nature05047","article-title":"A juvenile early hominin skeleton from Dikika","volume":"443","author":"Z Alemseged","year":"2006","journal-title":"Ethiopia. Nature"},{"key":"pcbi.1012222.ref048","doi-asserted-by":"crossref","unstructured":"Martinez J, Hossain R, Romero J, Little JJ. A Simple Yet Effective Baseline for 3d Human Pose Estimation. 2017 IEEE International Conference on Computer Vision (ICCV). Venice: IEEE; 2017. pp. 2659\u20132668. doi: 10.1109\/ICCV.2017.288","DOI":"10.1109\/ICCV.2017.288"},{"key":"pcbi.1012222.ref049","doi-asserted-by":"crossref","first-page":"825","DOI":"10.2214\/ajr.108.4.825","article-title":"Laryngocele","volume":"108","author":"J Giovannello","year":"1970","journal-title":"American Journal of Roentgenology"},{"key":"pcbi.1012222.ref050","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1016\/0734-189X(87)90116-2","article-title":"Estimation of a circular arc center and its radius","volume":"38","author":"UM Landau","year":"1987","journal-title":"Computer Vision, Graphics, and Image Processing"},{"key":"pcbi.1012222.ref051","article-title":"Least squares fitting of circles and lines.","author":"N Chernov","year":"2003","journal-title":"arXiv"},{"key":"pcbi.1012222.ref052","unstructured":"Sumith YD. Fast Circle fitting using Landau method. MATLAB; 2024. Available: Sumith YD (2024). Fast Circle fitting using Landau method (https:\/\/www.mathworks.com\/matlabcentral\/fileexchange\/44219-fast-circle-fitting-using-landau-method), MATLAB Central File Exchange. Abgerufen 22. Mai 2024."},{"key":"pcbi.1012222.ref053","volume-title":"R: A Language and Environment for Statistical Computing","author":"R Core Team","year":"2020"},{"key":"pcbi.1012222.ref054","doi-asserted-by":"crossref","first-page":"778","DOI":"10.3758\/s13428-018-1095-7","article-title":"Soundgen: An open-source tool for synthesizing nonverbal vocalizations.","volume":"51","author":"A. Anikin","year":"2019","journal-title":"Behav Res."},{"key":"pcbi.1012222.ref055","author":"A. Anikin","year":"2023","journal-title":"Sound Synthesis and Acoustic Analysis"},{"key":"pcbi.1012222.ref056","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1002\/ajpa.22124","article-title":"Soprano singing in gibbons","volume":"149","author":"H Koda","year":"2012","journal-title":"American Journal of Physical Anthropology"},{"key":"pcbi.1012222.ref057","article-title":"SuperAnimal models pretrained for plug-and-play analysis of animal behavior.","author":"S Ye","year":"2023","journal-title":"arXiv"},{"key":"pcbi.1012222.ref058","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1038\/s41592-022-01443-0","article-title":"Multi-animal pose estimation, identification and tracking with DeepLabCut.","volume":"19","author":"J Lauer","year":"2022","journal-title":"Nat Methods."},{"key":"pcbi.1012222.ref059","doi-asserted-by":"crossref","first-page":"109730","DOI":"10.1016\/j.celrep.2021.109730","article-title":"Anipose: A toolkit for robust markerless 3D pose estimation","volume":"36","author":"P Karashchuk","year":"2021","journal-title":"Cell Reports"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1012222","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T00:00:00Z","timestamp":1720137600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012222","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T17:51:28Z","timestamp":1720201888000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012222"}},"subtitle":[],"editor":[{"given":"Adriano","family":"Lameira","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,6,24]]},"references-count":59,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6,24]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1012222","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1012222","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,24]]}}}