{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T12:23:35Z","timestamp":1788524615548,"version":"build-2803163510"},"reference-count":43,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T00:00:00Z","timestamp":1694563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"Framework Programme","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Abdominal palpation is one of the basic but important physical examination methods used by physicians. Visual, auditory, and haptic feedback from the patients are known to be the main sources of feedback they use in the diagnosis. However, learning to interpret this feedback and making accurate diagnosis require several years of training. Many abdominal palpation training simulators have been proposed to date, but very limited attempts have been reported in integrating vocal pain expressions into physical abdominal palpation simulators. Here, we present a vocal pain expression augmentation for a robopatient. The proposed robopatient is capable of providing real-time facial and vocal pain expressions based on the exerted palpation force and position on the abdominal phantom of the robopatient. A pilot study is conducted to test the proposed system, and we show the potential of integrating vocal pain expressions to the robopatient. The platform has also been tested by two clinical experts with prior experience in abdominal palpation. Their evaluations on functionality and suggestions for improvements are presented. We highlight the advantages of the proposed robopatient with real-time vocal and facial pain expressions as a controllable simulator platform for abdominal palpation training studies. Finally, we discuss the limitations of the proposed approach and suggest several future directions for improvements.<\/jats:p>","DOI":"10.3389\/frobt.2023.1122914","type":"journal-article","created":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T12:18:57Z","timestamp":1694607537000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Vocal pain expression augmentation for a robopatient"],"prefix":"10.3389","volume":"10","author":[{"given":"Namnueng","family":"Protpagorn","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thilina Dulantha","family":"Lalitharatne","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leone","family":"Costi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fumiya","family":"Iida","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,9,13]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1162\/PRES_a_00145","article-title":"Exploring agent physicality and social presence for medical team training","volume":"22","author":"Chuah","year":"2013","journal-title":"Presence"},{"key":"B2","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1006\/pmed.1999.0544","article-title":"The effectiveness of using standardized patients to improve community physician skills in mammography counseling and clinical breast exam","volume":"29","author":"Costanza","year":"1999","journal-title":"Prev. Med."},{"key":"B3","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1037\/H0079934","article-title":"Judgment of pain in newborns: facial activity and cry as determinants","volume":"20","author":"Craig","year":"1988","journal-title":"Can. J. Behav. Science\/Revue Can. des Sci. du comportement"},{"key":"B4","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1097\/SIH.0000000000000409","article-title":"The physical-virtual patient simulator: a physical human form with virtual appearance and behavior","volume":"15","author":"Daher","year":"2020","journal-title":"Simul. Healthc."},{"key":"B5","doi-asserted-by":"publisher","first-page":"1608142","DOI":"10.1080\/10872981.2019.1608142","article-title":"How do novices learn physical examination skills? A systematic review of the literature","volume":"24","author":"Danielson","year":"2019","journal-title":"Med. Educ. online"},{"key":"B6","doi-asserted-by":"publisher","first-page":"700","DOI":"10.1001\/jama.274.9.700","article-title":"Changing physician performance: a systematic review of the effect of continuing medical education strategies","volume":"274","author":"Davis","year":"1995","journal-title":"Jama"},{"key":"B7","volume-title":"To err is human: Building a safer health system","author":"Donaldson","year":"2000"},{"key":"B8","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1136\/BMJQS-2019-010206","article-title":"Economic analysis of the prevalence and clinical and economic burden of medication error in england","volume":"30","author":"Elliott","year":"2021","journal-title":"BMJ Qual. Saf."},{"key":"B9","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1016\/J.PHYSLETA.2005.02.048","article-title":"Relating pain intensity of newborns to onset of nonlinear phenomena in cry recordings","volume":"338","author":"Facchini","year":"2005","journal-title":"Phys. Lett. A"},{"key":"B10","doi-asserted-by":"publisher","first-page":"S29","DOI":"10.1097\/ACM.0000000000004925","article-title":"Standardized patients\u2019 perspectives on bias in student encounters","volume":"97","author":"Fluet","year":"2022","journal-title":"Acad. Med."},{"key":"B11","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1177\/105477389500400304","article-title":"The effect of pain on infant behaviors","volume":"4","author":"Fuller","year":"1995","journal-title":"Clin. Nurs. Res."},{"key":"B12","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/S0897-1897(05)80036-9","article-title":"Acoustical analysis of maternal sounds during the second stage of labor","volume":"6","author":"Fuller","year":"1993","journal-title":"Appl. Nurs. Res."},{"key":"B13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4172\/jptr.1000115","article-title":"The effect of real time auditory feedback during palpation of a simulated lumbar spine in the education of physical therapy students","volume":"3","author":"Gugliotti","year":"2019","journal-title":"J. Physiother. Rehabil."},{"key":"B14","doi-asserted-by":"publisher","first-page":"1703","DOI":"10.1002\/ejp.1623","article-title":"Crying out in pain-a systematic review into the validity of vocalization as an indicator for pain","volume":"24","author":"Helmer","year":"2020","journal-title":"Eur. J. Pain"},{"key":"B15","doi-asserted-by":"publisher","first-page":"S233","DOI":"10.1016\/0304-3959(87)91526-0","article-title":"Acoustical attributes of infant pain cries: discriminating features","volume":"30","author":"Johnston","year":"1987","journal-title":"Pain"},{"key":"B16","doi-asserted-by":"publisher","first-page":"e0171706","DOI":"10.1371\/journal.pone.0171706","article-title":"Palpation force modulation strategies to identify hard regions in soft tissue organs","volume":"12","author":"Konstantinova","year":"2017","journal-title":"PLoS ONE"},{"key":"B17","doi-asserted-by":"publisher","first-page":"1651","DOI":"10.1109\/tbme.2013.2296877","article-title":"Behavioral characteristics of manual palpation to localize hard nodules in soft tissues","volume":"61","author":"Konstantinova","year":"2014","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"B18","first-page":"99","article-title":"Virtual human + tangible interface = mixed reality human an initial exploration with a virtual breast exam patient","author":"Kotranza","year":"2008"},{"key":"B19","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1080\/09524622.2017.1344931","article-title":"The acoustic space of pain: cries as indicators of distress recovering dynamics in pre-verbal infants","volume":"27","author":"Koutseff","year":"2018","journal-title":"Bioacoustics"},{"key":"B20","doi-asserted-by":"publisher","first-page":"12592","DOI":"10.1038\/s41598-022-16643-z","article-title":"Face mediated human\u2013robot interaction for remote medical examination","volume":"12","author":"Lalitharatne","year":"2022","journal-title":"Sci. Rep."},{"key":"B21","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1109\/LRA.2020.3048670","article-title":"Morphface: a hybrid morphable face for a robopatient","volume":"6","author":"Lalitharatne","year":"2021","journal-title":"IEEE Robotics Automation Lett."},{"key":"B22","doi-asserted-by":"publisher","first-page":"215874","DOI":"10.1109\/ACCESS.2020.3041173","article-title":"Facial expression rendering in medical training simulators: current status and future directions","volume":"8","author":"Lalitharatne","year":"2020","journal-title":"IEEE Access"},{"key":"B23","doi-asserted-by":"publisher","first-page":"e597","DOI":"10.1097\/PR9.0000000000000597","article-title":"Phonetic characteristics of vocalizations during pain","volume":"2","author":"Lautenbacher","year":"2017","journal-title":"PAIN Rep."},{"key":"B24","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1097\/AJP.0B013E31805476F2","article-title":"Neonatal facial coding system scores and spectral characteristics of infant crying during newborn circumcision","volume":"23","author":"Lehr","year":"2007","journal-title":"Clin. J. Pain"},{"key":"B25","doi-asserted-by":"publisher","first-page":"656","DOI":"10.1111\/j.1365-2125.2009.03423.x","article-title":"Prevention of medication errors: teaching and training","volume":"67","author":"Likic","year":"2009","journal-title":"Br. J. Clin. Pharmacol."},{"key":"B26","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1097\/sih.0000000000000195","article-title":"Developing a conversational virtual standardized patient to enable students to practice history-taking skills","volume":"12","author":"Maicher","year":"2017","journal-title":"Simul. Healthc."},{"key":"B27","doi-asserted-by":"publisher","first-page":"F428","DOI":"10.1136\/ARCHDISCHILD-2016-312279","article-title":"Cry presence and amplitude do not reflect cortical processing of painful stimuli in newborns with distinct responses to touch or cold","volume":"102","author":"Maitre","year":"2017","journal-title":"Archives Dis. Child. - Fetal Neonatal Ed."},{"key":"B28","doi-asserted-by":"publisher","first-page":"12","DOI":"10.3389\/frobt.2016.00012","article-title":"A comparison of avatar-video-and robot-mediated interaction on users\u2019 trust in expertise","volume":"3","author":"Pan","year":"2016","journal-title":"Front. Robotics AI"},{"key":"B29","doi-asserted-by":"publisher","first-page":"790","DOI":"10.2307\/1130355","article-title":"Neonatal pain cries: effect of circumcision on acoustic features and perceived urgency","volume":"57","author":"Porter","year":"1986","journal-title":"Child. Dev."},{"key":"B30","doi-asserted-by":"crossref","DOI":"10.1109\/BioRob52689.2022.9925382","article-title":"Vocal pain expression augmentation to improve interaction accuracy in virtual robopatient","author":"Protpagorn","year":"2022"},{"key":"B31","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1080\/09524622.2018.1463295","article-title":"Vocal communication of simulated pain","volume":"28","author":"Raine","year":"2019","journal-title":"Bioacoustics"},{"key":"B32","doi-asserted-by":"publisher","first-page":"83","DOI":"10.3121\/cmr.2018.1423","article-title":"Abdominal physical signs and medical eponyms: physical examination of palpation part 1, 1876\u20131907","volume":"16","author":"Rastogi","year":"2018","journal-title":"Clin. Med. Res."},{"key":"B33","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1007\/s11548-017-1669-3","article-title":"Anthropomorphic liver phantom with flow for multimodal image-guided liver therapy research and training","volume":"13","author":"Rethy","year":"2018","journal-title":"Int. J. Comput. assisted radiology Surg."},{"key":"B34","doi-asserted-by":"publisher","first-page":"372","DOI":"10.3233\/978-1-61499-022-2-372","article-title":"Shader lamps virtual patients: the physical manifestation of virtual patients","volume":"173","author":"Rivera-Gutierrez","year":"2012","journal-title":"Stud. Health Technol. Inf."},{"key":"B35","doi-asserted-by":"publisher","first-page":"745234","DOI":"10.3389\/frobt.2021.745234","article-title":"Perception by palpation: development and testing of a haptic ferrogranular jamming surface","volume":"8","author":"R\u00f8rvik","year":"2021","journal-title":"Front. Robotics AI"},{"key":"B36","first-page":"385","volume-title":"The body in pain: The making and unmaking of the world","author":"Scarry","year":"1985"},{"key":"B37","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1016\/j.jsurg.2011.10.005","article-title":"Use of breast simulators compared with standardized patients in teaching the clinical breast examination to medical students","volume":"69","author":"Schubart","year":"2012","journal-title":"J. Surg. Educ."},{"key":"B38","first-page":"200","article-title":"Medical palpation autonomous robotic system modeling and simulation in ros\/gazebo","author":"Shafikov","year":"2020"},{"key":"B39","volume-title":"Realistic pain expression simulation using perception-based weighted action units","author":"Tan","year":"2021"},{"key":"B40","doi-asserted-by":"publisher","first-page":"4200","DOI":"10.1038\/s41598-022-08115-1","article-title":"Simulating dynamic facial expressions of pain from visuo-haptic interactions with a robotic patient","volume":"12","author":"Tan","year":"2022","journal-title":"Sci. Rep."},{"key":"B41","doi-asserted-by":"publisher","first-page":"DN040441","DOI":"10.2495\/DN040441","article-title":"Determination of pain intensity in newborns by time series analysis","volume":"73","author":"Tiezzi","year":"2004","journal-title":"WIT Trans. Ecol. Environ."},{"key":"B42","volume-title":"Clinical methods: The history, physical, and laboratory examinations","author":"Walker","year":"1990"},{"key":"B43","doi-asserted-by":"publisher","first-page":"241","DOI":"10.2147\/jpr.s14708","article-title":"Virtual human technology: patient demographics and healthcare training factors in pain observation and treatment recommendations","volume":"3","author":"Wandner","year":"2010","journal-title":"J. pain Res."}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1122914\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T12:19:01Z","timestamp":1694607541000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1122914\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,13]]},"references-count":43,"alternative-id":["10.3389\/frobt.2023.1122914"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2023.1122914","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,13]]},"article-number":"1122914"}}