{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T04:22:00Z","timestamp":1775794920908,"version":"3.50.1"},"reference-count":38,"publisher":"Acoustical Society of America (ASA)","issue":"1","license":[{"start":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T00:00:00Z","timestamp":1657152000000},"content-version":"vor","delay-in-days":6,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T00:00:00Z","timestamp":1657152000000},"content-version":"tdm","delay-in-days":6,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,1]]},"abstract":"<jats:p>This paper addresses the development of a system for classifying mouse ultrasonic vocalizations (USVs) present in audio recordings. The automatic labeling process for USVs is usually divided into two main steps: USV segmentation followed by the matching classification. Three main contributions can be highlighted: (i) a new segmentation algorithm, (ii) a new set of features, and (iii) the discrimination of a higher number of classes when compared to similar studies. The developed segmentation algorithm is based on spectral entropy analysis. This novel segmentation approach can detect USVs with 94% and 74% recall and precision, respectively. When compared to other methods\/software, our segmentation algorithm achieves a higher recall. Regarding the classification phase, besides the traditional features from time, frequency, and time-frequency domains, a new set of contour-based features were extracted and used as inputs of shallow machine learning classification models. The contour-based features were obtained from the time-frequency ridge representation of USVs. The classification methods can differentiate among ten different syllable types with 81.1% accuracy and 80.5% weighted F1-score. The algorithms were developed and evaluated based on a large dataset, acquired on diverse social interaction conditions between the animals, to stimulate a varied vocal repertoire.<\/jats:p>","DOI":"10.1121\/10.0012350","type":"journal-article","created":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T12:11:55Z","timestamp":1657195915000},"page":"266-280","update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":7,"title":["Automatic segmentation and classification of mice ultrasonic vocalizations"],"prefix":"10.1121","volume":"152","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7783-7488","authenticated-orcid":false,"given":"Diogo","family":"Pessoa","sequence":"first","affiliation":[{"name":"University of Coimbra, Centre for Informatics and Systems of the University of Coimbra, Department of Informatics Engineering , 3030-290 Coimbra, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2045-0741","authenticated-orcid":false,"given":"Lorena","family":"Petrella","sequence":"additional","affiliation":[{"name":"University of Coimbra, Centre for Informatics and Systems of the University of Coimbra, Department of Informatics Engineering , 3030-290 Coimbra, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3630-7034","authenticated-orcid":false,"given":"Pedro","family":"Martins","sequence":"additional","affiliation":[{"name":"University of Coimbra, Centre for Informatics and Systems of the University of Coimbra, Department of Informatics Engineering , 3030-290 Coimbra, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4364-6373","authenticated-orcid":false,"given":"Miguel","family":"Castelo-Branco","sequence":"additional","affiliation":[{"name":"University of Coimbra, Centre for Informatics and Systems of the University of Coimbra, Department of Informatics Engineering , 3030-290 Coimbra, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9396-1211","authenticated-orcid":false,"given":"C\u00e9sar","family":"Teixeira","sequence":"additional","affiliation":[{"name":"University of Coimbra, Centre for Informatics and Systems of the University of Coimbra, Department of Informatics Engineering , 3030-290 Coimbra, Portugal"}]}],"member":"231","published-online":{"date-parts":[[2022,7,7]]},"reference":[{"issue":"8","key":"2023081003071452600_c1","doi-asserted-by":"publisher","first-page":"e3067","DOI":"10.1371\/journal.pone.0003067","article-title":"Unusual repertoire of vocalizations in the BTBR T+tf\/J mouse model of autism","volume":"3","year":"2008","journal-title":"PLoS One"},{"issue":"1","key":"2023081003071452600_c2","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1007\/s00441-013-1607-9","article-title":"Affective communication in rodents: Ultrasonic vocalizations as a tool for research on emotion and motivation","volume":"354","year":"2013","journal-title":"Cell Tissue Res."},{"issue":"4","key":"2023081003071452600_c3","doi-asserted-by":"publisher","first-page":"e351","DOI":"10.1371\/journal.pone.0000351","article-title":"Affiliative behavior, ultrasonic communication and social reward are influenced by genetic variation in adolescent mice","volume":"2","year":"2007","journal-title":"PLoS One"},{"issue":"1","key":"2023081003071452600_c4","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1111\/j.1601-183X.2010.00623.x","article-title":"Unusual repertoire of vocalizations in adult BTBR T+tf\/J mice during three types of social encounters","volume":"10","year":"2011","journal-title":"Genes Brain Behav."},{"issue":"3","key":"2023081003071452600_c5","doi-asserted-by":"publisher","first-page":"e17460","DOI":"10.1371\/journal.pone.0017460","article-title":"Development of social vocalizations in mice","volume":"6","year":"2011","journal-title":"PLoS One"},{"key":"2023081003071452600_c6","doi-asserted-by":"publisher","first-page":"76","DOI":"10.3389\/fnbeh.2015.00076","article-title":"Male mice song syntax depends on social contexts and influences female preferences","volume":"9","year":"2015","journal-title":"Front. Behav. Neurosci."},{"issue":"5","key":"2023081003071452600_c7","doi-asserted-by":"publisher","first-page":"859","DOI":"10.1038\/s41386-018-0303-6","article-title":"DeepSqueak: A deep learning-based system for detection and analysis of ultrasonic vocalizations","volume":"44","year":"2019","journal-title":"Neuropsychopharmacology"},{"key":"2023081003071452600_c8","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-92495-3","volume-title":"Rodent Bioacoustics","author":"Dent","year":"2018"},{"issue":"12","key":"2023081003071452600_c9","doi-asserted-by":"publisher","first-page":"e386","DOI":"10.1371\/journal.pbio.0030386","article-title":"Ultrasonic songs of male mice","volume":"3","year":"2005","journal-title":"PLOS Biol."},{"key":"2023081003071452600_c10","doi-asserted-by":"publisher","first-page":"e59161","DOI":"10.7554\/eLife.59161","article-title":"Analysis of ultrasonic vocalizations from mice using computer vision and machine learning","volume":"10","year":"2021","journal-title":"Elife"},{"issue":"3","key":"2023081003071452600_c11","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1016\/j.neuron.2017.04.005","article-title":"Mupet\u2013mouse ultrasonic profile extraction: A signal processing tool for rapid and unsupervised analysis of ultrasonic vocalizations","volume":"94","year":"2017","journal-title":"Neuron"},{"issue":"2","key":"2023081003071452600_c12","doi-asserted-by":"publisher","first-page":"e0228907","DOI":"10.1371\/journal.pone.0228907","article-title":"USVSEG: A robust method for segmentation of ultrasonic vocalizations in rodents","volume":"15","year":"2020","journal-title":"PLoS One"},{"issue":"1","key":"2023081003071452600_c13","doi-asserted-by":"publisher","first-page":"8100","DOI":"10.1038\/s41598-019-44221-3","article-title":"Quantifying ultrasonic mouse vocalizations using acoustic analysis in a supervised statistical machine learning framework","volume":"9","year":"2019","journal-title":"Sci. Rep."},{"issue":"23","key":"2023081003071452600_c14","doi-asserted-by":"publisher","first-page":"E3300","DOI":"10.1073\/pnas.1605973113","article-title":"Combinatorial effects of odorants on mouse behavior","volume":"113","year":"2016","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"2023081003071452600_c15","first-page":"37","article-title":"Automatic segmentation of ultrasonic vocalizations in rodents","year":"2019"},{"issue":"310","key":"2023081003071452600_c16","doi-asserted-by":"publisher","first-page":"312","DOI":"10.2307\/3611062","article-title":"The mathematical theory of communication. by Claude E. Shannon and Warren Weaver. Pp. 117 $2.50. 1949. (University of Illinois Press, Urbana)","volume":"34","year":"1950","journal-title":"Math. Gazette"},{"key":"2023081003071452600_c17","unstructured":"Mathworks, \u201cSpectral entropy of signal\u2014MATLAB pentropy\u2014mathworks.com,\u201d https:\/\/www.mathworks.com\/help\/signal\/ref\/pentropy.html (Last viewed May 6, 2022)."},{"issue":"5","key":"2023081003071452600_c18","doi-asserted-by":"publisher","first-page":"2833","DOI":"10.1121\/1.2982368","article-title":"Automatic detection of marine mammals using information entropy","volume":"124","year":"2008","journal-title":"J. Acoust. Soc. Am."},{"issue":"6","key":"2023081003071452600_c19","doi-asserted-by":"publisher","first-page":"e1007918","DOI":"10.1371\/journal.pcbi.1007918","article-title":"Classifying sex and strain from mouse ultrasonic vocalizations using deep learning","volume":"16","year":"2020","journal-title":"PLoS Comput. Biol."},{"issue":"1","key":"2023081003071452600_c20","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1007\/s13042-010-0001-0","article-title":"Understanding bag-of-words model: A statistical framework","volume":"1","year":"2010","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"2023081003071452600_c21","first-page":"1","article-title":"Visual categorization with bags of keypoints","year":"2004"},{"key":"2023081003071452600_c22","first-page":"214","article-title":"Kaze features","volume-title":"Computer Vision\u2014ECCV 2012","author":"Fitzgibbon","year":"2012"},{"key":"2023081003071452600_c23","unstructured":"Mathworks, \u201cKaze features,\u201d https:\/\/www.mathworks.com\/help\/vision\/ref\/detectkazefeatures.html (Last viewed May 6, 2022)."},{"key":"2023081003071452600_c24a","doi-asserted-by":"publisher","volume-title":"An Introduction to Audio Content Analysis","year":"2012","DOI":"10.1002\/9781118393550"},{"key":"2023081003071452600_c25","first-page":"4190","article-title":"Application of image processing techniques for frog call classification","year":"2015"},{"issue":"4","key":"2023081003071452600_c26","doi-asserted-by":"publisher","first-page":"2212","DOI":"10.1121\/1.3624821","article-title":"Automated extraction of odontocete whistle contours","volume":"130","year":"2011","journal-title":"J. Acoust. Soc. Am."},{"issue":"2","key":"2023081003071452600_c27","doi-asserted-by":"publisher","first-page":"1159","DOI":"10.1121\/1.2945711","article-title":"Spectrogram denoising and automated extraction of the fundamental frequency variation of dolphin whistles","volume":"124","year":"2008","journal-title":"J. Acoust. Soc. Am."},{"issue":"1","key":"2023081003071452600_c28","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1121\/1.4770251","article-title":"Automated extraction and classification of time-frequency contours in humpback vocalizations","volume":"133","year":"2013","journal-title":"J. Acoust. Soc. Am."},{"key":"2023081003071452600_c29","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1016\/j.sigpro.2016.01.024","article-title":"Extraction of instantaneous frequencies from ridges in time\u2013frequency representations of signals","volume":"125","year":"2016","journal-title":"Signal Process."},{"key":"2023081003071452600_c30","unstructured":"G. W.\u2008Moran, \u201cLocally-weighted-regression scatter-plot smoothing (lowess): A graphical exploratory data analysis technique (1984-09),\u201d http:\/\/hdl.handle.net\/10945\/19419 (Last viewed May 6, 2022)."},{"key":"2023081003071452600_c31","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1016\/j.apacoust.2016.06.029","article-title":"Acoustic classification of Australian frogs based on enhanced features and machine learning algorithms","volume":"113","year":"2016","journal-title":"Appl. Acoust."},{"key":"2023081003071452600_c32","volume-title":"Pattern Recognition and Machine Learning (Information Science and Statistics)","year":"2006"},{"issue":"2","key":"2023081003071452600_c33","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1109\/72.991427","article-title":"A comparison of methods for multiclass support vector machines","volume":"13","year":"2002","journal-title":"IEEE Trans. Neural Netw."},{"key":"2023081003071452600_c34","first-page":"272","article-title":"Content-based classification and retrieval of wild animal sounds using feature selection algorithm","year":"2010"},{"key":"2023081003071452600_c35","volume-title":"Pattern Classification, a Wiley-Interscience Publication","year":"2000","edition":"2nd ed."},{"issue":"1","key":"2023081003071452600_c36","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of decision trees","volume":"1","year":"1986","journal-title":"Mach. Learn."},{"issue":"2","key":"2023081003071452600_c37","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1509\/jmkr.43.2.276","article-title":"Bagging and boosting classification trees to predict churn","volume":"43","year":"2006","journal-title":"J. Mark. Res."},{"issue":"1","key":"2023081003071452600_c38","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1023\/A:1025667309714","article-title":"Theoretical and empirical analysis of relieff and rrelieff","volume":"53","year":"2003","journal-title":"Mach. Learn."}],"container-title":["The Journal of the Acoustical Society of America"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/152\/1\/266\/16526622\/266_1_online.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/152\/1\/266\/16526622\/266_1_online.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/152\/1\/266\/16526622\/266_1_online.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,27]],"date-time":"2025-05-27T19:14:39Z","timestamp":1748373279000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/jasa\/article\/152\/1\/266\/2838328\/Automatic-segmentation-and-classification-of-mice"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,1]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,7,1]]}},"URL":"https:\/\/doi.org\/10.1121\/10.0012350","relation":{},"ISSN":["0001-4966","1520-8524"],"issn-type":[{"value":"0001-4966","type":"print"},{"value":"1520-8524","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,7]]},"published":{"date-parts":[[2022,7,1]]}}}