{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T19:29:41Z","timestamp":1776972581352,"version":"3.51.4"},"reference-count":74,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T00:00:00Z","timestamp":1675382400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>Understanding children's conversational skills is crucial for understanding their social, cognitive, and linguistic development, with important applications in health and education. To develop theories based on quantitative studies of conversational development, we need (i) data recorded in naturalistic contexts (e.g., child-caregiver dyads talking in their daily environment) where children are more likely to show much of their conversational competencies, as opposed to controlled laboratory contexts which typically involve talking to a stranger (e.g., the experimenter); (ii) data that allows for clear access to children's multimodal behavior in face-to-face conversations; and (iii) data whose acquisition method is cost-effective with the potential of being deployed at a large scale to capture individual and cultural variability. The current work is a first step to achieving this goal. We built a corpus of video chats involving children in middle childhood (6\u201312 years old) and their caregivers using a weakly structured word-guessing game to prompt spontaneous conversation. The manual annotations of these recordings have shown a similarity in the frequency distribution of multimodal communicative signals from both children and caregivers. As a case study, we capitalize on this rich behavioral data to study how verbal and non-verbal cues contribute to the children's conversational coordination. In particular, we looked at how children learn to engage in coordinated conversations, not only as speakers but also as listeners, by analyzing children's use of backchannel signaling (e.g., verbal \u201cmh\u201d or head nods) during these conversations. Contrary to results from previous in-lab studies, our use of a more spontaneous conversational setting (as well as more adequate controls) revealed that school-age children are strikingly close to adult-level mastery in many measures of backchanneling. Our work demonstrates the usefulness of recent technology in video calling for acquiring quality data that can be used for research on children's conversational development in the wild.<\/jats:p>","DOI":"10.3389\/fcomp.2023.1088752","type":"journal-article","created":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T07:12:44Z","timestamp":1675408364000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Using video calls to study children's conversational development: The case of backchannel signaling"],"prefix":"10.3389","volume":"5","author":[{"given":"K\u00fcbra","family":"Bodur","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mitja","family":"Nikolaus","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laurent","family":"Pr\u00e9vot","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Abdellah","family":"Fourtassi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,2,3]]},"reference":[{"key":"B1","first-page":"129","article-title":"\u201cThe MUMIN multimodal coding scheme,\u201d","author":"Allwood","year":"2005","journal-title":"NorFA Yearbook"},{"key":"B2","first-page":"25","article-title":"\u201cThe HCRC map task corpus: natural dialogue for speech recognition,\u201d","author":"Anderson","year":"1993","journal-title":"Proceedings of the Workshop on Human Language Technology, HLT '93"},{"key":"B3","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1177\/002383099103400404","article-title":"The hcrc map task corpus","volume":"34","author":"Anderson","year":"1991","journal-title":"Lang. Speech"},{"key":"B4","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1177\/0142723710370538","article-title":"Discourse topic management and discussion skills in middle childhood: the effects of age and task","volume":"30","author":"Baines","year":"2010","journal-title":"First Lang"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.79.6.941","article-title":"Listeners as co-narrators","author":"Bavelas","year":"2000","journal-title":"J. Pers. Soc. Psychol"},{"key":"B6","first-page":"1748","article-title":"\u201cSPPAS: a tool for the phonetic segmentations of speech,\u201d","author":"Bigi","year":"2012","journal-title":"The Eighth International Conference on Language Resources and Evaluation"},{"key":"B7","first-page":"54","article-title":"SPPAS-multi-lingual approaches to the automatic annotation of speech. the phonetician","volume":"111","author":"Bigi","year":"2015","journal-title":"J. Int. Soc. Phonetic Sci"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1530","DOI":"10.17851\/2237-2083.26.4.1489-1530","article-title":"Automatic segmentation of spontaneous speech","volume":"26","author":"Bigi","year":"2018","journal-title":"Revista de Estudos da Linguagem"},{"key":"B9","doi-asserted-by":"publisher","first-page":"1272","DOI":"10.1037\/xge0001150","article-title":"Zoom disrupts the rhythm of conversation","volume":"151","author":"Boland","year":"2021","journal-title":"J. Exp. Psychol. Gen"},{"key":"B10","first-page":"537","article-title":"\u201cA multimodal model for predicting conversational feedbacks,\u201d","author":"Boudin","year":"2021","journal-title":"International Conference on Text, Speech, and Dialogue"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1037\/0278-7393.22.6.1482","article-title":"Conceptual pacts and lexical choice in conversation","author":"Brennan","year":"1996","journal-title":"J. Exp. Psychol. Learn. Mem. Cogn"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.37.5.728","article-title":"Smiles can be backchannels","author":"Brunner","year":"1979","journal-title":"J. Pers. Soc. Psychol"},{"key":"B13","doi-asserted-by":"crossref","first-page":"41","DOI":"10.3115\/1610065.1610071","article-title":"\u201cCoordination in conversation and rapport,\u201d","author":"Cassell","year":"2007","journal-title":"Proceedings of the Workshop on Embodied Language Processing"},{"key":"B14","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1080\/15475441.2017.1340843","article-title":"Conversation and language acquisition: a pragmatic approach","volume":"14","author":"Clark","year":"2018","journal-title":"Lang. Learn. Dev"},{"key":"B15","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511620539","author":"Clark","year":"1996","journal-title":"Using Language"},{"key":"B16","first-page":"261","article-title":"\u201cContextualizing conversational strategies: backchannel, repair and linguistic alignment in spontaneous and task-oriented conversations,\u201d","author":"Dideriksen","year":"2019","journal-title":"CogSci'19"},{"key":"B17","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1111\/j.1460-2466.1972.tb00165.x","article-title":"Developmental factors in conversational behavior","volume":"22","author":"Dittmann","year":"1972","journal-title":"J. Commun"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1037\/h0025722","article-title":"Relationship between vocalizations and head nods as listener responses","author":"Dittmann","year":"1968","journal-title":"J. Pers. Soc. Psychol"},{"key":"B19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2307\/1165872","article-title":"Developmental trends in the quality of conversation achieved by small groups of acquainted peers","volume":"49","author":"Dorval","year":"1984","journal-title":"Monogr. Soc. Res. Child Dev"},{"key":"B20","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1111\/infa.12468","article-title":"iCatcher: a neural network approach for automated coding of young children's eye movements","volume":"27","author":"Erel","year":"2022","journal-title":"Infancy"},{"key":"B21","article-title":"\u201cGetting to the root of linguistic alignment: Testing the predictions of interactive alignment across developmental and biological variation in language skill,\u201d","author":"Foushee","year":"2022","journal-title":"Proceedings of the 44th Annual Meeting of the Cognitive Science Society"},{"key":"B22","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1016\/j.newideapsych.2013.03.005","article-title":"Dialog as interpersonal synergy","volume":"32","author":"Fusaroli","year":"2014","journal-title":"New Ideas Psychol"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.31234\/osf.io\/ysjec","article-title":"Caregiver linguistic alignment to autistic and typically developing children","author":"Fusaroli","year":"2021","journal-title":"PsyArXiv [Preprint]"},{"key":"B24","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1007\/BF00148127","article-title":"Between and within: alternative sequential treatments of continuers and assessments","volume":"9","author":"Goodwin","year":"1986","journal-title":"Hum. Stud"},{"key":"B25","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1177\/1362361305051395","article-title":"Social communication in children with autism: the relationship between theory of mind and discourse development","volume":"9","author":"Hale","year":"2005","journal-title":"Autism"},{"key":"B26","author":"Hazan","year":"2017"},{"key":"B27","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1080\/01638538809544706","article-title":"Acquisition of backchannel listener responses to adequate messages","volume":"11","author":"Hess","year":"1988","journal-title":"Commun. Sci. Disord. Faculty Publications"},{"key":"B28","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1016\/0001-6918(67)90005-4","article-title":"Some functions of gaze-direction in social interaction","volume":"26","author":"Kendon","year":"1967","journal-title":"Acta Psychol"},{"key":"B29","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1075\/ijcl.14.1.05kje","article-title":"Where do we backchannel?: on the use of mm, mhm, uh huh and such like","volume":"14","author":"Kjellmer","year":"2009","journal-title":"Int. J. Corpus Linguist"},{"key":"B30","doi-asserted-by":"publisher","first-page":"600","DOI":"10.3758\/s13423-021-02009-5","article-title":"The role of iconic gestures and mouth movements in face-to-face communication","volume":"29","author":"Krason","year":"2022","journal-title":"Psychonomic Bull. Rev"},{"key":"B31","doi-asserted-by":"publisher","first-page":"2347","DOI":"10.1007\/s11135-015-0266-1","article-title":"On the reliability of unitizing textual continua: Further developments","volume":"50","author":"Krippendorff","year":"2016","journal-title":"Quality Quantity"},{"key":"B32","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1146\/annurev-psych-062220-051256","article-title":"Understanding human cognitive uniqueness","volume":"72","author":"Laland","year":"2021","journal-title":"Annu. Rev. Psychol"},{"key":"B33","doi-asserted-by":"publisher","first-page":"975","DOI":"10.1177\/0956797621993104","article-title":"Parents fine-tune their speech to children's vocabulary knowledge","volume":"32","author":"Leung","year":"2021","journal-title":"Psychol. Sci"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2013.0302","article-title":"The origin of human multi-modal communication","author":"Levinson","year":"2014","journal-title":"Philos. Trans. R. Soc. B Biol. Sci"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1037\/dev0001414","article-title":"A longitudinal analysis of the social information in infants' naturalistic visual experience using automated detections","author":"Long","year":"2022","journal-title":"Dev. Psychol"},{"key":"B36","author":"MacWhinney","year":"2014","journal-title":"The CHILDES Project: Tools for Analyzing talk, Volume II: The Database"},{"key":"B37","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/BF03173140","article-title":"Turn-taking in classroom interactions: Overlapping, interruptions and pauses in primary school","volume":"23","author":"Maroni","year":"2008","journal-title":"Euro. J. Psychol. Educ"},{"key":"B38","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1162\/COLI_a_00296","article-title":"The agreement measure \u03b3 cat a complement to \u03b3 focused on categorization of a continuum","volume":"43","author":"Mathet","year":"2017","journal-title":"Comput. Linguist"},{"key":"B39","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1162\/COLI_a_00227","article-title":"The unified and holistic method Gamma (\u03b3) for inter-annotator agreement measure and alignment","volume":"41","author":"Mathet","year":"2015","journal-title":"Comput. Linguist"},{"key":"B40","article-title":"\u201cLaughter mimicry in parent-child and parent-adult interaction,\u201d","author":"Mazzocconi","year":"2023","journal-title":"International Multimodal Communication Symposium (MMSYM)"},{"key":"B41","doi-asserted-by":"publisher","first-page":"1302","DOI":"10.1109\/TAFFC.2020.2994533","article-title":"What's your laughter doing there? a taxonomy of the pragmatic functions of laughter","volume":"13","author":"Mazzocconi","year":"2020","journal-title":"IEEE Trans. Affect. Comput"},{"key":"B42","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","article-title":"Interrater reliability: the Kappa statistic","volume":"22","author":"McHugh","year":"2012","journal-title":"Biochem. Med"},{"key":"B43","doi-asserted-by":"crossref","first-page":"54","DOI":"10.18653\/v1\/2020.cmcl-1.7","article-title":"\u201cDevelopment of multi-level linguistic alignment in child-adult conversations,\u201d","author":"Misiek","year":"2020","journal-title":"Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics"},{"key":"B44","article-title":"\u201cCaregivers exaggerate their lexical alignment to young children across several cultures,\u201d","author":"Misiek","year":"2022","journal-title":"Proceedings of the 26th Workshop on the Semantics and Pragmatics of Dialogue"},{"key":"B45","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1007\/s10458-009-9092-y","article-title":"A probabilistic multimodal approach for predicting listener backchannels","volume":"20","author":"Morency","year":"2010","journal-title":"Auton. Agent Multi Agent Syst"},{"key":"B46","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1007\/s10802-013-9772-6","article-title":"The behaviour of young children with social communication disorders during dyadic interaction with peers","volume":"42","author":"Murphy","year":"2014","journal-title":"J. Abnorm. Child Psychol"},{"key":"B47","doi-asserted-by":"publisher","first-page":"2730","DOI":"10.1016\/j.neuropsychologia.2010.05.020","article-title":"How does the topic of conversation affect verbal exchange and eye gaze? A comparison between typical development and high-functioning autism","volume":"48","author":"Nadig","year":"2010","journal-title":"Neuropsychologia"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1016\/j.newideapsych.2022.100985","article-title":"Communicative feedback in language acquisition","author":"Nikolaus","year":"2023","journal-title":"New Ideas Psychol"},{"key":"B49","article-title":"\u201cLarge-scale study of speech acts' development using automatic labelling,\u201d","author":"Nikolaus","year":"2021","journal-title":"Proceedings of the 43rd Annual Meeting of the Cognitive Science Society"},{"key":"B50","first-page":"592","article-title":"\u201cRole of gesture in language processing: Toward a unified account for production and comprehension,\u201d","author":"\u00d6zy\u00fcrek","year":"2018","journal-title":"Oxford Handbook of Psycholinguistics"},{"key":"B51","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1007\/s12193-012-0105-9","article-title":"Head movements, facial expressions and feedback in conversations: empirical evidence from Danish multimodal data","volume":"7","author":"Paggio","year":"2013","journal-title":"J. Multimodal User Interfaces"},{"key":"B52","first-page":"2308","article-title":"\u201cTelling stories to robots: The effect of backchanneling on a child's storytelling,\u201d","volume-title":"Proceedings of the 2017 ACM. IEEE International Conference on Human-Robot Interaction","author":"Park","year":"2017"},{"key":"B53","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1017\/S0305000900013854","article-title":"The who, when and where of early narratives","volume":"17","author":"Peterson","year":"1990","journal-title":"J. Child Lang"},{"key":"B54","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1007\/s11168-006-9004-0","article-title":"Alignment as the basis for successful communication","volume":"4","author":"Pickering","year":"2006","journal-title":"Res. Lang. Comput"},{"key":"B55","doi-asserted-by":"crossref","DOI":"10.1017\/9781108610728","author":"Pickering","year":"2021","journal-title":"Understanding Dialogue: Language use and Social Interaction"},{"key":"B56","first-page":"149","article-title":"\u201cA sip of CoFee: a sample of interesting productions of conversational feedback,\u201d","author":"Pr\u00e9vot","year":"2017","journal-title":"Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGdial), Prague, Czech Republic, 2-4 September 2015"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.1111\/cogs.12911","article-title":"Alignment in multimodal interaction: an integrative framework","author":"Rasenberg","year":"2020","journal-title":"Cogn. Sci"},{"key":"B58","first-page":"1","article-title":"\u201cAutomating the administration and analysis of psychiatric tests: the case of attachment in school age children,\u201d","author":"Roffo","year":"2019","journal-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems"},{"key":"B59","doi-asserted-by":"publisher","first-page":"e0240277","DOI":"10.1371\/journal.pone.0240277","article-title":"The school attachment monitor\u2013a novel computational tool for assessment of attachment in middle childhood","volume":"16","author":"Rooksby","year":"2021","journal-title":"PLoS ONE"},{"key":"B60","doi-asserted-by":"publisher","first-page":"696","DOI":"10.1353\/lan.1974.0010","article-title":"A simplest systematics for the organization of turn-taking for conversation","volume":"50","author":"Sacks","year":"1974","journal-title":"Language"},{"key":"B61","first-page":"25","article-title":"\u201cHigh-accuracy annotation and parsing of CHILDES transcripts,\u201d","author":"Sagae","year":"2007","journal-title":"Proceedings of the Workshop on Cognitive Aspects of Computational Language Acquisition"},{"key":"B62","first-page":"93","article-title":"Discourse as an interactional achievement: some uses of \u2018uh-huh' and other things that come between sentences","volume":"71","author":"Schegloff","year":"1982","journal-title":"Analyzing Discourse"},{"key":"B63","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/1165783","article-title":"\u201cThe development of communication skills: modifications in the speech of young children as a function of listener,\u201d","author":"Shatz","year":"1973","journal-title":"Monographs of the Society for Research in Child Development"},{"key":"B64","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1017\/S0305000900000453","article-title":"The development of conversation between mothers and babies","volume":"4","author":"Snow","year":"1977","journal-title":"J. Child Lang"},{"key":"B65","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1162\/opmi_a_00039","article-title":"SAYCam: a large, longitudinal audiovisual dataset recorded from the infant's perspective","volume":"5","author":"Sullivan","year":"2022","journal-title":"Open Mind"},{"key":"B66","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1207\/s15327965pli0104_1","article-title":"The nature of rapport and its nonverbal correlates","volume":"1","author":"Tickle-Degnen","year":"1990","journal-title":"Psychol. Inq"},{"key":"B67","doi-asserted-by":"publisher","first-page":"2989","DOI":"10.21105\/joss.02989","article-title":"Pygamma-agreement: gamma \u03b3 measure for inter\/intra-annotator agreement in Python","volume":"6","author":"Titeux","year":"2021","journal-title":"J. Open Source Software"},{"key":"B68","author":"Tomasello","year":"1999","journal-title":"The Cultural Origins of Human Cognition"},{"key":"B69","doi-asserted-by":"publisher","DOI":"10.1093\/mind\/LIX.236.433","article-title":"I.\u2013computing machinery and intelligence","author":"Turing","year":"1950","journal-title":"Mind LIX"},{"key":"B70","doi-asserted-by":"publisher","first-page":"510","DOI":"10.1177\/0023830910372495","article-title":"The wildcat corpus of native-and foreign-accented english: communicative efficiency across conversational dyads with varying language alignment profiles","volume":"53","author":"Van Engen","year":"2010","journal-title":"Lang. Speech"},{"key":"B71","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1145\/3382507.3418858","article-title":"\u201cDid the children behave? investigating the relationship between attachment condition and child computer interaction,\u201d","author":"Vo","year":"2020","journal-title":"Proceedings of the 2020 International Conference on Multimodal Interaction"},{"key":"B72","doi-asserted-by":"publisher","first-page":"1314","DOI":"10.1177\/0956797614531023","article-title":"A social feedback loop for speech development and its reduction in autism","volume":"25","author":"Warlaumont","year":"2014","journal-title":"Psychol. Sci"},{"key":"B73","first-page":"567","article-title":"\u201cOn getting a word in edgewise,\u201d","author":"Yngve","year":"1970","journal-title":"Chicago Linguistics Society, 6th Meeting, Vol. 1970"},{"key":"B74","year":"2021"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1088752\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T07:13:10Z","timestamp":1675408390000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1088752\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,3]]},"references-count":74,"alternative-id":["10.3389\/fcomp.2023.1088752"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2023.1088752","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,3]]},"article-number":"1088752"}}