{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T15:46:14Z","timestamp":1784216774979,"version":"3.55.0"},"reference-count":29,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,2,8]],"date-time":"2024-02-08T00:00:00Z","timestamp":1707350400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>Crying is an inevitable character trait that occurs throughout the growth of infants, under conditions where the caregiver may have difficulty interpreting the underlying cause of the cry. Crying can be treated as an audio signal that carries a message about the infant's state, such as discomfort, hunger, and sickness. The primary infant caregiver requires traditional ways of understanding these feelings. Failing to understand them correctly can cause severe problems. Several methods attempt to solve this problem; however, proper audio feature representation and classifiers are necessary for better results. This study uses time-, frequency-, and time-frequency-domain feature representations to gain in-depth information from the data. The time-domain features include zero-crossing rate (ZCR) and root mean square (RMS), the frequency-domain feature includes the Mel-spectrogram, and the time-frequency-domain feature includes Mel-frequency cepstral coefficients (MFCCs). Moreover, time-series imaging algorithms are applied to transform 20 MFCC features into images using different algorithms: Gramian angular difference fields, Gramian angular summation fields, Markov transition fields, recurrence plots, and RGB GAF. Then, these features are provided to different machine learning classifiers, such as decision tree, random forest, K nearest neighbors, and bagging. The use of MFCCs, ZCR, and RMS as features achieved high performance, outperforming state of the art (SOTA). Optimal parameters are found via the grid search method using 10-fold cross-validation. Our MFCC-based random forest (RF) classifier approach achieved an accuracy of 96.39%, outperforming SOTA, the scalogram-based shuffleNet classifier, which had an accuracy of 95.17%.<\/jats:p>","DOI":"10.3389\/frai.2024.1337356","type":"journal-article","created":{"date-parts":[[2024,2,8]],"date-time":"2024-02-08T05:19:44Z","timestamp":1707369584000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Machine learning-based infant crying interpretation"],"prefix":"10.3389","volume":"7","author":[{"given":"Mohammed","family":"Hammoud","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Melaku N.","family":"Getahun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Baldycheva","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrey","family":"Somov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,2,8]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"122136","DOI":"10.1109\/ACCESS.2022.3223444","article-title":"Mel frequency cepstral coefficient and its applications: a review","volume":"10","author":"Abdul","year":"2022","journal-title":"IEEE Access"},{"key":"B2","doi-asserted-by":"publisher","first-page":"1318","DOI":"10.1121\/1.5001491","article-title":"A fully automated approach for baby cry signal segmentation and boundary detection of expiratory and inspiratory episodes","volume":"142","author":"Abou-Abbas","year":"2017","journal-title":"J. Acoust. Soc. Am."},{"key":"B3","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1109\/ICCCS52626.2021.9449246","article-title":"\u201cInfant cry classification with graph convolutional networks,\u201d","author":"Chunyan","year":"2021"},{"key":"B4","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/978-3-030-31764-5_7","article-title":"\u201cBaby cry detection: deep learning and classical approaches,\u201d","volume-title":"Development and Analysis of Deep Learning Architectures","author":"Cohen","year":"2020"},{"key":"B5","doi-asserted-by":"publisher","first-page":"983147","DOI":"10.1155\/2012\/983147","article-title":"Cry-based classification of healthy and sick infants using adapted boosting mixture learning method for gaussian mixture models","volume":"2012","author":"Farsaie Alaie","year":"2012","journal-title":"Model. Simul. Eng."},{"key":"B6","doi-asserted-by":"publisher","first-page":"2409","DOI":"10.21437\/Interspeech.2018-1211","article-title":"Data augmentation improves recognition of foreign accented speech","volume":"2018","author":"Fukuda","year":"2018","journal-title":"Proc. Interspeech"},{"key":"B7","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1016\/j.cmpb.2011.07.010","article-title":"Normal and hypoacoustic infant cry signal classification using time\u2013frequency analysis and general regression neural network","volume":"108","author":"Hariharan","year":"2012","journal-title":"Comput. Methods Programs Biomed."},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1117\/12.2309486","article-title":"\u201cClassification of time-series images using deep convolutional neural networks,\u201d","author":"Hatami","year":"2018","journal-title":"Tenth International Conference on Machine Vision (ICMV 2017)"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1811.07270","article-title":"Cifar10 to compare visual recognition performance between deep neural networks and humans","author":"Ho-Phuoc","year":"2018","journal-title":"arXiv."},{"key":"B10","volume-title":"Infant Cry Signal Processing, Analysis, and Classification with Artificial Neural Networks","author":"Ji","year":"2021"},{"key":"B11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13636-021-00197-5","article-title":"A review of infant cry analysis and classification","volume":"2021","author":"Ji","year":"2021","journal-title":"EURASIP J. Audio Speech Music Process."},{"key":"B12","doi-asserted-by":"publisher","first-page":"819865","DOI":"10.3389\/fpubh.2022.819865","article-title":"A multistage heterogeneous stacking ensemble model for augmented infant cry classification","volume":"10","author":"Joshi","year":"2022","journal-title":"Front. Public Health"},{"key":"B13","doi-asserted-by":"publisher","first-page":"1266873","DOI":"10.3389\/fnins.2023.1266873","article-title":"How can cry acoustics associate newborns' distress levels with neurophysiological and behavioral signals? Front","volume":"17","author":"Laguna","year":"2023","journal-title":"Neurosci."},{"key":"B14","doi-asserted-by":"publisher","first-page":"111700","DOI":"10.1016\/j.chaos.2021.111700","article-title":"Deep learning systems for automatic diagnosis of infant cry signals","volume":"154","author":"Lahmiri","year":"2022","journal-title":"Chaos Solitons Fractals"},{"key":"B15","doi-asserted-by":"crossref","DOI":"10.1109\/MASSW.2019.00028","article-title":"\u201cUsing transfer learning, SVM, and ensemble classification to classify baby cries based on their spectrogram images,\u201d","volume-title":"2019 IEEE 16th International Conference on Mobile Ad Hoc and Sensor Systems Workshops (MASSW)","author":"Le","year":"2019"},{"key":"B16","doi-asserted-by":"publisher","first-page":"6311","DOI":"10.3390\/ijerph19106311","article-title":"Deep learning for infant cry recognition","volume":"19","author":"Liang","year":"2022","journal-title":"Int. J. Environ. Res. Public Health"},{"key":"B17","doi-asserted-by":"publisher","first-page":"778","DOI":"10.1109\/JAS.2019.1911435","article-title":"Infant cry language analysis and recognition: an experimental approach","volume":"6","author":"Liu","year":"2019","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2021.12.021","article-title":"Machine learning-based cry diagnostic system for identifying septic newborns","author":"Matikolaie","year":"2022","journal-title":"J. Voice"},{"key":"B19","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1109\/IndianCMIT.2013.6529410","article-title":"\u201cAn evaluation of human perception for neonatal cry using a database of cry and underlying cause,\u201d","volume-title":"2013 Indian Conference on Medical Informatics and Telemedicine (ICMIT)","author":"Mukhopadhyay","year":"2013"},{"key":"B20","doi-asserted-by":"publisher","first-page":"104648","DOI":"10.1016\/j.bspc.2023.104648","article-title":"Infant cry classification by using different deep neural network models and hand-crafted features","volume":"83","author":"Ozseven","year":"2023","journal-title":"Biomed. Signal Process. Control"},{"key":"B21","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1109\/MICAI.2008.73","article-title":"\u201cEvolutionary-neural system to classify infant cry units for pathologies identification in recently born babies,\u201d","volume-title":"2008 Seventh Mexican International Conference on Artificial Intelligence","author":"Reyes-Galaviz","year":"2008"},{"key":"B22","first-page":"1","article-title":"\u201cInfant weeping calls decoder using statistical feature extraction and gaussian mixture models,\u201d","volume-title":"2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT)","author":"Sharma","year":"2019"},{"key":"B23","doi-asserted-by":"publisher","first-page":"012019","DOI":"10.1088\/1742-6596\/1528\/1\/012019","article-title":"Infant cry classification using CNN\u2013RNN","volume":"1528","author":"Tusty","year":"2020","journal-title":"J. Phys. Conf. Series"},{"key":"B24","doi-asserted-by":"publisher","first-page":"670352","DOI":"10.3389\/fpubh.2021.670352","article-title":"Deep learning assisted neonatal cry classification via support vector machine models","volume":"9","author":"Vincent","year":"2021","journal-title":"Front. Public Health"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1506.00327","article-title":"Imaging time-series to improve classification and imputation","author":"Wang","year":"2015","journal-title":"arXiv."},{"key":"B26","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1109\/YAC.2019.8787725","article-title":"\u201cResearch on acoustic feature extraction of crying for early screening of children with autism,\u201d","volume-title":"2019 34rd Youth Academic Annual Conference of Chinese Association of Automation (YAC)","author":"Wu","year":"2019"},{"key":"B27","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1109\/ICASSP43922.2022.9746096","article-title":"\u201cInfant crying detection in real-world environments,\u201d","volume-title":"ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)","author":"Yao","year":"2022"},{"key":"B28","doi-asserted-by":"publisher","first-page":"2107","DOI":"10.3390\/diagnostics13122107","article-title":"Infant cry signal diagnostic system using deep learning and fused features","volume":"13","author":"Zayed","year":"2023","journal-title":"Diagnostics"},{"key":"B29","doi-asserted-by":"publisher","first-page":"5956","DOI":"10.3390\/app10175956","article-title":"A comparison of human against machine-classification of spatial audio scenes in binaural recordings of music","volume":"10","author":"Zieli\u0144ski","year":"2020","journal-title":"Appl. Sci."}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1337356\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,8]],"date-time":"2024-02-08T05:19:51Z","timestamp":1707369591000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1337356\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,8]]},"references-count":29,"alternative-id":["10.3389\/frai.2024.1337356"],"URL":"https:\/\/doi.org\/10.3389\/frai.2024.1337356","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,8]]},"article-number":"1337356"}}