{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T20:07:31Z","timestamp":1787947651632,"version":"build-2784847793"},"reference-count":48,"publisher":"Public Library of Science (PLoS)","issue":"11","license":[{"start":{"date-parts":[[2020,11,25]],"date-time":"2020-11-25T00:00:00Z","timestamp":1606262400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>The present study explored whether a tool for automatic detection and recognition of interactions and child-directed speech (CDS) in preschool classrooms could be developed, validated, and applied to non-coded video recordings representing children\u2019s classroom experiences. Using first-person video recordings collected by 13 preschool children during a morning in their classrooms, we extracted high-level audiovisual features from recordings using automatic speech recognition and computer vision services from a cloud computing provider. Using manual coding for interactions and transcriptions of CDS as reference, we trained and tested supervised classifiers and linear mappings to measure five variables of interest. We show that the supervised classifiers trained with speech activity, proximity, and high-level facial features achieve adequate accuracy in detecting interactions. Furthermore, in combination with an automatic speech recognition service, the supervised classifier achieved error rates for CDS measures that are in line with other open-source automatic decoding tools in early childhood settings. Finally, we demonstrate our tool\u2019s applicability by using it to automatically code and transcribe children\u2019s interactions and CDS exposure vertically within a classroom day (morning to afternoon) and horizontally over time (fall to winter). Developing and scaling tools for automatized capture of children\u2019s interactions with others in the preschool classroom, as well as exposure to CDS, may revolutionize scientific efforts to identify precise mechanisms that foster young children\u2019s language development.<\/jats:p>","DOI":"10.1371\/journal.pone.0242511","type":"journal-article","created":{"date-parts":[[2020,11,25]],"date-time":"2020-11-25T13:35:40Z","timestamp":1606311340000},"page":"e0242511","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":24,"title":["Automatized analysis of children\u2019s exposure to child-directed speech in reschool settings: Validation and application"],"prefix":"10.1371","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9093-9852","authenticated-orcid":true,"given":"Hugo","family":"Gonzalez Villasanti","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura M.","family":"Justice","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1852-1878","authenticated-orcid":true,"given":"Leidy Johana","family":"Chaparro-Moreno","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tzu-Jung","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kelly","family":"Purtell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2020,11,25]]},"reference":[{"key":"pone.0242511.ref001","doi-asserted-by":"crossref","DOI":"10.2307\/j.ctv1khdr07","volume-title":"Neural plasticity","author":"PR Huttenlocher","year":"2009"},{"issue":"36","key":"pone.0242511.ref002","doi-asserted-by":"crossref","first-page":"7870","DOI":"10.1523\/JNEUROSCI.0484-18.2018","article-title":"Language exposure relates to structural neural connectivity in childhood","volume":"38","author":"RR Romeo","year":"2018","journal-title":"Journal of Neuroscience"},{"issue":"3","key":"pone.0242511.ref003","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1111\/cdev.13128","article-title":"Language matters: Denying the existence of the 30\u2010million\u2010word gap has serious consequences","volume":"90","author":"RM Golinkoff","year":"2019","journal-title":"Child development"},{"issue":"4","key":"pone.0242511.ref004","doi-asserted-by":"crossref","first-page":"1303","DOI":"10.1111\/cdev.13072","article-title":"Reexamining the verbal environments of children from different socioeconomic backgrounds","volume":"90","author":"DE Sperry","year":"2019","journal-title":"Child development"},{"issue":"5","key":"pone.0242511.ref005","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1111\/j.1467-7687.2012.01168.x","article-title":"Language input and acquisition in a Mayan village: How important is directed speech?","volume":"15","author":"LA Shneidman","year":"2012","journal-title":"Developmental science"},{"issue":"5","key":"pone.0242511.ref006","doi-asserted-by":"crossref","first-page":"1368","DOI":"10.1111\/1467-8624.00612","article-title":"The specificity of environmental influence: Socioeconomic status affects early vocabulary development via maternal speech","volume":"74","author":"E Hoff","year":"2003","journal-title":"Child development"},{"key":"pone.0242511.ref007","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1017\/S0305000907008343","article-title":"Child-directed speech: Relation to socioeconomic status, knowledge of child development and child vocabulary skill","volume":"35","author":"ML Rowe","year":"2008","journal-title":"Journal of child language"},{"issue":"5","key":"pone.0242511.ref008","doi-asserted-by":"crossref","first-page":"1762","DOI":"10.1111\/j.1467-8624.2012.01805.x","article-title":"A longitudinal investigation of the role of quantity and quality of child\u2010directed speech in vocabulary development","volume":"83","author":"ML Rowe","year":"2012","journal-title":"Child development"},{"key":"pone.0242511.ref009","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.ecresq.2017.09.003","article-title":"Linguistic environment of preschool classrooms: What dimensions support children\u2019s language growth?","volume":"42","author":"LM Justice","year":"2018","journal-title":"Early Childhood Research Quarterly"},{"issue":"2","key":"pone.0242511.ref010","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1177\/1525740110367826","article-title":"Assessing children\u2019s home language environments using automatic speech recognition technology","volume":"32","author":"CR Greenwood","year":"2011","journal-title":"Communication Disorders Quarterly"},{"issue":"30","key":"pone.0242511.ref011","doi-asserted-by":"crossref","first-page":"13354","DOI":"10.1073\/pnas.1003882107","article-title":"Automated vocal analysis of naturalistic recordings from children with autism, language delay, and typical development","volume":"107","author":"DK Oller","year":"2010","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"6","key":"pone.0242511.ref012","doi-asserted-by":"crossref","first-page":"2002","DOI":"10.1044\/2019_JSLHR-H-18-0325","article-title":"Remote Microphone System Use at Home: Impact on Child-Directed Speech. Journal of Speech, Language, and","volume":"62","author":"CR Ben\u00edtez-Barrera","year":"2019","journal-title":"Hearing Research"},{"issue":"7","key":"pone.0242511.ref013","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0199893","article-title":"A year in words: The dynamics and consequences of language experiences in an intervention classroom","volume":"13","author":"LK Perry","year":"2018","journal-title":"PloS one"},{"key":"pone.0242511.ref014","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.ecresq.2018.12.005","article-title":"Enriching home language environment among families from low-SES backgrounds: A randomized controlled trial of a home visiting curriculum","volume":"50","author":"CYY Leung","year":"2020","journal-title":"Early Childhood Research Quarterly"},{"key":"pone.0242511.ref015","article-title":"Socioeconomic Disparities in Language Input Are Associated With Children's Language\u2010Related Brain Structure and Reading Skills","author":"EC Merz","journal-title":"Child Development"},{"issue":"1","key":"pone.0242511.ref016","article-title":"A step-by-step guide to collecting and analyzing long-format speech environment (LFSE) recordings","volume":"5","author":"M Casillas","year":"2019","journal-title":"Collabra"},{"key":"pone.0242511.ref017","doi-asserted-by":"crossref","first-page":"1093","DOI":"10.1044\/2020_JSLHR-19-00017","article-title":"Accuracy of the Language Environment Analysis System Segmentation and Metrics: A Systematic Review","volume":"63","author":"A Cristia","year":"2020","journal-title":"Journal of Speech, Language, and Hearing Research"},{"key":"pone.0242511.ref018","first-page":"2013","volume-title":"Transcriptional analyses of the LENA natural language corpus","author":"J Gilkerson","year":"2008"},{"issue":"3","key":"pone.0242511.ref019","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1080\/10409280802065403","article-title":"Patterns of teacher\u2013child conversations in Head Start classrooms: Implications for an empirically grounded approach to professional development","volume":"19","author":"DK Dickinson","year":"2008","journal-title":"Early Education and Development"},{"issue":"1","key":"pone.0242511.ref020","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.ecresq.2007.09.004","article-title":"Quality of language and literacy instruction in preschool classrooms serving at-risk pupils","volume":"23","author":"LM Justice","year":"2008","journal-title":"Early childhood research quarterly"},{"issue":"8","key":"pone.0242511.ref021","doi-asserted-by":"crossref","first-page":"e0220227","DOI":"10.1371\/journal.pone.0220227","article-title":"The preschool classroom linguistic environment: Children's first-person experiences","volume":"14","author":"LJ Chaparro-Moreno","year":"2019","journal-title":"PLoS One"},{"key":"pone.0242511.ref022","volume-title":"Text Analytics Toolbox: User's Guide (R2020a) Natick","author":"Mathworks","year":"2020"},{"key":"pone.0242511.ref023","volume-title":"Amazon Rekognition: Developer Guide","author":"Amazon Web Services","year":"2020"},{"key":"pone.0242511.ref024","volume-title":"Amazon Transcribe: Developer Guide","author":"Amazon Web Services","year":"2020"},{"issue":"3","key":"pone.0242511.ref025","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3351229","article-title":"EduSense: Practical classroom sensing at Scale","volume":"3","author":"K Ahuja","year":"2019","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"pone.0242511.ref026","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1007\/978-981-13-1402-5_21","volume-title":"Data Management, Analytics and Innovation","author":"S Mane","year":"2019"},{"key":"pone.0242511.ref027","first-page":"683","article-title":"A systematic comparison of contemporary automatic speech recognition engines for conversational clinical speech. AMIA Annual Symposium proceedings","volume":"2018","author":"J Kodish-Wachs","year":"2018","journal-title":"AMIA Symposium"},{"key":"pone.0242511.ref028","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.infbeh.2018.11.004","article-title":"Using automatic face analysis to score infant behaviour from video collected online","volume":"54","author":"B Chouinard","year":"2019","journal-title":"Infant Behavior and Development"},{"key":"pone.0242511.ref029","volume-title":"Audio Toolbox, User Guide (R2020a) Natick","author":"Mathworks","year":"2020"},{"issue":"3","key":"pone.0242511.ref030","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1007\/s11042-012-1080-6","article-title":"Audiovisual diarization of people in video content","volume":"68","author":"EE Khoury","year":"2012","journal-title":"Multimedia Tools and Applications"},{"issue":"8","key":"pone.0242511.ref031","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"S Hochreiter","year":"1997","journal-title":"Neural computation"},{"key":"pone.0242511.ref032","volume-title":"Deep Learning Toolbox User's Guide (R2020a) Natick","author":"Mathworks","year":"2020"},{"key":"pone.0242511.ref033","doi-asserted-by":"crossref","DOI":"10.21437\/Interspeech.2015-373","volume-title":"Large vocabulary automatic speech recognition for children","author":"H Liao","year":"2015"},{"issue":"2","key":"pone.0242511.ref034","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1111\/j.1440-1681.1997.tb01807.x","article-title":"Special article comparing methods of measurement","volume":"24","author":"J Ludbrook","year":"1997","journal-title":"Clinical and Experimental Pharmacology and Physiology"},{"key":"pone.0242511.ref035","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.specom.2019.08.005","article-title":"Automatic word count estimation from daylong child-centered recordings in various language environments using language-independent syllabification of speech.","volume":"113","author":"O R\u00e4s\u00e4nen","year":"2019","journal-title":"Speech Communication"},{"issue":"3","key":"pone.0242511.ref036","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1016\/S0010-0285(02)00500-5","article-title":"Language input and child syntax","volume":"45","author":"J Huttenlocher","year":"2002","journal-title":"Cognitive psychology"},{"issue":"6","key":"pone.0242511.ref037","doi-asserted-by":"crossref","first-page":"e195738","DOI":"10.1001\/jamanetworkopen.2019.5738","article-title":"Assessment of a Parent-Child Interaction Intervention for Language Development in Children","volume":"2","author":"DA Christakis","year":"2019","journal-title":"JAMA network open"},{"issue":"2","key":"pone.0242511.ref038","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s41252-017-0014-8","article-title":"Exploring classroom behavioral imaging: Moving closer to effective and data-based early childhood inclusion planning","volume":"1","author":"DW Irvin","year":"2017","journal-title":"Advances in Neurodevelopmental Disorders"},{"key":"pone.0242511.ref039","article-title":"Signal processing for young child speech language development","author":"D Xu","year":"2008","journal-title":"Wocci"},{"issue":"4","key":"pone.0242511.ref040","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1016\/j.ecresq.2014.05.004","article-title":"Language-and literacy-learning opportunities in early childhood classrooms: Children's typical experiences and within-classroom variability","volume":"29","author":"CY Pelatti","year":"2014","journal-title":"Early Childhood Research Quarterly"},{"issue":"4","key":"pone.0242511.ref041","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1080\/10409289.2010.548767","article-title":"Observations of children's interactions with teachers, peers, and tasks across preschool classroom activity settings","volume":"23","author":"LM Booren","year":"2012","journal-title":"Early Education & Development"},{"issue":"1","key":"pone.0242511.ref042","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1044\/jslhr.4001.33","article-title":"Interaction among preschoolers with and without disabilities: Effects of across-the-day peer intervention","volume":"40","author":"H Goldstein","year":"1997","journal-title":"Journal of Speech, Language, and Hearing Research"},{"issue":"3","key":"pone.0242511.ref043","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1177\/0165025418820708","article-title":"Continuous measurement of dynamic classroom social interactions","volume":"43","author":"DS Messinger","year":"2019","journal-title":"International Journal of Behavioral Development"},{"key":"pone.0242511.ref044","doi-asserted-by":"crossref","DOI":"10.21437\/Interspeech.2012-642","volume-title":"An automatic child-directed speech detector for the study of child language development","author":"S Vosoughi","year":"2012"},{"issue":"9","key":"pone.0242511.ref045","doi-asserted-by":"crossref","first-page":"1722","DOI":"10.1177\/0956797614538978","article-title":"Peer effects in early childhood education: Testing the assumptions of special-education inclusion","volume":"25","author":"LM Justice","year":"2014","journal-title":"Psychological Science"},{"issue":"6","key":"pone.0242511.ref046","doi-asserted-by":"crossref","first-page":"1809","DOI":"10.1007\/s10803-014-2340-2","article-title":"A comprehensive peer network intervention to improve social communication of children with autism spectrum disorders: A randomized trial in kindergarten and first grade","volume":"45","author":"D Kamps","year":"2015","journal-title":"Journal of autism and developmental disorders"},{"key":"pone.0242511.ref047","first-page":"1","article-title":"The social networks of children with and without disabilities in early childhood special education classrooms","author":"J Chen","year":"2019","journal-title":"Journal of autism and developmental disorders"},{"key":"pone.0242511.ref048","volume-title":"The ACLEW DiViMe: An Easy-to-use Diarization Tool","author":"A Le Franc","year":"2018"}],"updated-by":[{"DOI":"10.1371\/journal.pone.0248232","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000}}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0242511","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,29]],"date-time":"2022-11-29T15:51:55Z","timestamp":1669737115000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0242511"}},"subtitle":[],"editor":[{"given":"Susan","family":"Nittrouer","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2020,11,25]]},"references-count":48,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,11,25]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0242511","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,25]]}}}