{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T16:44:34Z","timestamp":1778345074610,"version":"3.51.4"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2023,8,14]],"date-time":"2023-08-14T00:00:00Z","timestamp":1691971200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,14]],"date-time":"2023-08-14T00:00:00Z","timestamp":1691971200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Ecole Doctorale 488 SIS Sciences, Ing\u00e9nierie, Sant\u00e9"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Infant pose estimation is crucial in different clinical applications, including preterm automatic general movements assessment. Recent infant pose estimation methods are limited by a lack of real clinical data and are mainly focused on 2D detection. We introduce a stereoscopic system for infants\u2019 3D pose estimation, based on fine-tuning state-of-the-art 2D human pose estimation networks on a large, real, and manually annotated dataset of infants\u2019 images. Our dataset contains over 88k images, collected from 175 videos from 53 premature infants born &lt;33 weeks of gestational age (GA), acquired within the Neonatology department of the Centre Hospitalier Universitaire de Saint Etienne, France, between 32 and 41 weeks of GA. This framework significantly reduced the pose estimation error compared to existing 2D infant pose estimation networks. It achieved a mean error of 1.72 cm on 18000 stereoscopic images in the 3D pose estimation task. This framework is the first 3D pose estimation tool dedicated to preterm infants hospitalized in the Neonatal Unit that does not depend on any visual markers or infrared cameras.<\/jats:p>","DOI":"10.1007\/s11042-023-16333-6","type":"journal-article","created":{"date-parts":[[2023,8,14]],"date-time":"2023-08-14T05:02:01Z","timestamp":1691989321000},"page":"24383-24400","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["A 3D pose estimation framework for preterm infants hospitalized in the Neonatal Unit"],"prefix":"10.1007","volume":"83","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1395-2687","authenticated-orcid":false,"given":"Ameur","family":"Soualmi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christophe","family":"Ducottet","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hugues","family":"Patural","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antoine","family":"Giraud","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Olivier","family":"Alata","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,8,14]]},"reference":[{"issue":"9","key":"16333_CR1","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1016\/j.earlhumdev.2009.05.003","volume":"85","author":"L Adde","year":"2009","unstructured":"Adde L, Helbostad JL, Jensenius AR, Taraldsen G, St\u00f8en R (2009) Using computer-based video analysis in the study of fidgety movements. Early Human Develop 85(9):541\u2013547","journal-title":"Early Human Develop"},{"key":"16333_CR2","doi-asserted-by":"crossref","unstructured":"Andriluka M, Pishchulin L, Gehler P, Schiele B (2014) 2d human pose estimation: New benchmark and state of the art analysis. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp 3686\u20133693","DOI":"10.1109\/CVPR.2014.471"},{"key":"16333_CR3","doi-asserted-by":"crossref","unstructured":"Baccinelli W, Bulgheroni M, Simonetti V, Fulceri F, Caruso A, Gila L, Luisa Scattoni M (2020) Movidea: A software package for automatic video analysis of movements in infants at risk for neurodevelopmental disorders. Brain Sciences, 10","DOI":"10.3390\/brainsci10040203"},{"issue":"6","key":"16333_CR4","doi-asserted-by":"publisher","first-page":"1212","DOI":"10.1016\/j.jbiomech.2011.01.016","volume":"44","author":"L Berthouze","year":"2011","unstructured":"Berthouze L, Mayston M (2011) Design and validation of surface-marker clusters for the quantification of joint rotations in general movements in early infancy. J Biomech 44(6):1212\u20131215","journal-title":"J Biomech"},{"key":"16333_CR5","doi-asserted-by":"crossref","unstructured":"Cabon S, Weber R, Cailleau L, Carrault G, Pladys P, Por\u00e9e F (2021) Automated quiet sleep detection for premature newborns based on video and ecg analysis. In: 2021 Computing in Cardiology (CinC), vol 48, pp 1\u20134","DOI":"10.23919\/CinC53138.2021.9662821"},{"issue":"01","key":"16333_CR6","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1109\/TPAMI.2019.2929257","volume":"43","author":"Z Cao","year":"2021","unstructured":"Cao Z, Hidalgo G, Simon T, Wei S, Sheikh Y (2021) Openpose: Realtime multi-person 2d pose estimation using part affinity fields. IEEE Trans Pattern Anal Mach Intell 43(01):172\u2013186","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"16333_CR7","doi-asserted-by":"publisher","first-page":"2431","DOI":"10.1109\/TNSRE.2020.3029121","volume":"28","author":"C Chambers","year":"2020","unstructured":"Chambers C, Seethapathi N, Saluja R, Loeb H, Pierce S, Bogen D, Prosser L, Johnson M, Kording K (2020) Computer vision to automatically assess infant neuromotor risk. IEEE Transactions on Neural Systems and Rehabilitation Engineering 28:2431\u20132442","journal-title":"IEEE Transactions on Neural Systems and Rehabilitation Engineering"},{"key":"16333_CR8","doi-asserted-by":"crossref","unstructured":"Cheng B, Xiao B, Wang J, Shi H, Huang TS, Zhang L (2020) Higherhrnet: Scale-aware representation learning for bottom-up human pose estimation. In: 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 5385\u20135394","DOI":"10.1109\/CVPR42600.2020.00543"},{"key":"16333_CR9","unstructured":"Cioni G, Ferrari F, Bos AF, Prechtl HFR, Einspieler C (2008) Prechtls Method on the Qualitative Assessment of General Movements in Preterm, Term and Young Infants. Mac Keith Press"},{"key":"16333_CR10","unstructured":"Coco keypoint evaluation. https:\/\/cocodataset.org\/#keypoints-eval"},{"key":"16333_CR11","doi-asserted-by":"crossref","unstructured":"Doroniewicz I, Ledwo\u0144 D, Affanasowicz A, Kieszczy\u0144ska K, Latos D, Matyja M, Mitas A, My\u015bliwiec A (2020) Writhing movement detection in newborns on the second and third day of life using pose-based feature machine learning classification. Sensors, 20(21), 5986","DOI":"10.3390\/s20215986"},{"key":"16333_CR12","doi-asserted-by":"crossref","unstructured":"Fan M, Gravem D, Cooper DM, Patterson DJ (2012) Augmenting gesture recognition with erlang-cox models to identify neurological disorders in premature babies. In: Proceedings of the 2012 ACM Conference on Ubiquitous Computing, UbiComp \u201912, page 411-420, New York, NY, USA. Association for Computing Machinery","DOI":"10.1145\/2370216.2370278"},{"issue":"2","key":"16333_CR13","doi-asserted-by":"publisher","first-page":"021013","DOI":"10.1115\/1.4006129","volume":"6","author":"D Gravem","year":"2012","unstructured":"Gravem D, Singh M, Chen C, Rich J, Vaughan J, Goldberg K, Waffarn F, Chou P, Cooper D, Reinkensmeyer D, Patterson D (2012) Assessment of Infant Movement With a Compact Wireless Accelerometer System. J Med Devices 6(2):021013","journal-title":"J Med Devices"},{"key":"16333_CR14","doi-asserted-by":"publisher","first-page":"2518","DOI":"10.1007\/s10489-020-01918-7","volume":"51","author":"D Groos","year":"2021","unstructured":"Groos D, Ramampiaro H, Ihlen E (2021) Efficientpose: Scalable single-person pose estimation. Appl Intell 51:2518\u20132533","journal-title":"Appl Intell"},{"key":"16333_CR15","doi-asserted-by":"crossref","unstructured":"Hesse N, Bodensteiner C, Arens M, Hofmann UG, Weinberger R, Schroeder AS (2019) Computer vision for medical infant motion analysis: State of the art and rgb-d data set. In: Leal-Taix\u00e9 L, Roth S, (eds), Computer Vision \u2013 ECCV 2018 Workshops, pp 32\u201349, Cham. Springer International Publishing","DOI":"10.1007\/978-3-030-11024-6_3"},{"key":"16333_CR16","doi-asserted-by":"crossref","unstructured":"Huang X, Fu N, Liu S, Ostadabbas S (2021) Invariant representation learning for infant pose estimation with small data. In: 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021), pp 1\u20138, Los Alamitos, CA, USA. IEEE Computer Society","DOI":"10.1109\/FG52635.2021.9666956"},{"issue":"13","key":"16333_CR17","doi-asserted-by":"publisher","first-page":"2860","DOI":"10.1016\/j.jbiomech.2008.06.033","volume":"41","author":"D Karch","year":"2008","unstructured":"Karch D, Kim K-S, Wochner K, Pietz J, Dickhaus H, Philippi H (2008) Quantification of the segmental kinematics of spontaneous infant movements. J Biomech 41(13):2860\u20137","journal-title":"J Biomech"},{"key":"16333_CR18","doi-asserted-by":"publisher","first-page":"526","DOI":"10.3414\/ME09-02-0034","volume":"49","author":"D Karch","year":"2010","unstructured":"Karch D, Wochner K, Kim K, Philippi H, Hadders-Algra M, Pietz J, Dickhaus H (2010) Quantitative score for the evaluation of kinematic recordings in neuropediatric diagnostics detection of complex patterns in spontaneous limb movements. Methods Inform Med 49:526\u2013530","journal-title":"Methods Inform Med"},{"issue":"5","key":"16333_CR19","doi-asserted-by":"publisher","first-page":"6904","DOI":"10.1109\/JSEN.2020.3037121","volume":"21","author":"M Li","year":"2021","unstructured":"Li M, Wei F, Li Y, Zhang S, Xu G (2021) Three-dimensional pose estimation of infants lying supine using data from a kinect sensor with low training cost. IEEE Sens J 21(5):6904\u20136913","journal-title":"IEEE Sens J"},{"key":"16333_CR20","doi-asserted-by":"crossref","unstructured":"Lin T-Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Doll\u00e1r P, Zitnick CL (2014) Microsoft coco: Common objects in context. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds), Computer Vision \u2013 ECCV 2014, pp 740\u2013755, Cham. Springer International Publishing","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"16333_CR21","doi-asserted-by":"publisher","first-page":"51582","DOI":"10.1109\/ACCESS.2020.2980269","volume":"8","author":"KD McCay","year":"2020","unstructured":"McCay KD, Ho ESL, Shum HPH, Fehringer G, Marcroft C, Embleton ND (2020) Abnormal infant movements classification with deep learning on pose-based features. IEEE Access 8:51582\u201351592","journal-title":"IEEE Access"},{"key":"16333_CR22","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1109\/TNSRE.2021.3138185","volume":"30","author":"KD McCay","year":"2022","unstructured":"McCay KD, Hu P, Shum HPH, Woo WL, Marcroft C, Embleton ND, Munteanu A, Ho ESL (2022) A pose-based feature fusion and classification framework for the early prediction of cerebral palsy in infants. IEEE Trans Neural Syst Rehab Eng 30:8\u201319","journal-title":"IEEE Trans Neural Syst Rehab Eng"},{"issue":"2","key":"16333_CR23","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1016\/j.humov.2005.09.012","volume":"25","author":"L Meinecke","year":"2006","unstructured":"Meinecke L, Breitbach-Faller N, Bartz C, Damen R, Rau G, Disselhorst-Klug C (2006) Movement analysis in the early detection of newborns at risk for developing spasticity due to infantile cerebral palsy. Human Movement Sci 25(2):125\u2013144","journal-title":"Human Movement Sci"},{"key":"16333_CR24","doi-asserted-by":"crossref","unstructured":"Moccia S, Migliorelli L, Pietrini R, Frontoni E (2019) Preterm infants\u2019 limb-pose estimation from depth images using convolutional neural networks. In: 2019 IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB), pp 1\u20137","DOI":"10.1109\/CIBCB.2019.8791242"},{"key":"16333_CR25","unstructured":"Mohan S, Patterson DJ (2010) Involuntary gesture recognition for predicting cerebral palsy in high-risk infants. In: International Symposium on Wearable Computers (ISWC) 2010:1\u20138"},{"key":"16333_CR26","doi-asserted-by":"publisher","first-page":"105115","DOI":"10.1016\/j.earlhumdev.2020.105115","volume":"148","author":"JE Olsen","year":"2020","unstructured":"Olsen JE, Cheong JLY, Eeles AL, FitzGerald TL, Cameron KL, Albesher RA, Anderson PJ, Doyle LW, Spittle AJ (2020) Early general movements are associated with developmental outcomes at 4.5-5 years. Early Human Develop 148:105115","journal-title":"Early Human Develop"},{"key":"16333_CR27","doi-asserted-by":"crossref","unstructured":"Orlandi S, Raghuram K, Smith CR, Mansueto D, Church P, Shah V, Luther M, Chau T (2018) Detection of atypical and typical infant movements using computer-based video analysis. In: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp 3598\u20133601","DOI":"10.1109\/EMBC.2018.8513078"},{"key":"16333_CR28","doi-asserted-by":"publisher","first-page":"08","DOI":"10.1016\/S2352-4642(20)30239-X","volume":"4","author":"A Pavel","year":"2020","unstructured":"Pavel A, Rennie J, Vries L, Blennow M, Foran A, Shah D, Pressler R, Kapellou O, Dempsey E, Mathieson S, Pavlidis E, Huffelen A, Livingstone V, Toet M, Weeke L, Finder M, Mitra S, Murray D, Marnane W, Boylan G (2020) A machine-learning algorithm for neonatal seizure recognition: a multicentre, randomised, controlled trial. The Lancet Child & Adolescent Health 4:08","journal-title":"The Lancet Child & Adolescent Health"},{"key":"16333_CR29","doi-asserted-by":"crossref","unstructured":"Pierrat V, Marchand-Martin L, Marret S, Arnaud C, Benhammou V, Cambonie G, Debillon T, Dufourg M-N, Gire C, Goffinet F, Kaminski M, Lapillonne A, Morgan AS, Roz\u00e9 J-C, Twilhaar S, Charles M-A, Ancel P-Y (2021) Neurodevelopmental outcomes at age 5 among children born preterm: Epipage-2 cohort study. BMJ, 373","DOI":"10.1136\/bmj.n741"},{"key":"16333_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41372-019-0464-0","volume":"39","author":"K Raghuram","year":"2019","unstructured":"Raghuram K, Orlandi S, Shah V, Chau T, Luther M, Banihani R, Church P (2019) Automated movement analysis to predict motor impairment in preterm infants: a retrospective study. J Perinatology 39:1\u20138","journal-title":"J Perinatology"},{"key":"16333_CR31","doi-asserted-by":"crossref","unstructured":"Rahmati H, Aamo OM, Stavdahl \u00c3, Dragon R, Adde L (2014) Video-based early cerebral palsy prediction using motion segmentation. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp 3779\u20133783","DOI":"10.1109\/EMBC.2014.6944446"},{"key":"16333_CR32","doi-asserted-by":"crossref","unstructured":"Reich S, Zhang D, Kulvicius T, B\u00f6lte S, Nielsen-Saines K, Pokorny F, Peharz R, Poustka L, W\u00f6rg\u00f6tter F, Einspieler C, Marschik P (2021) Novel ai driven approach to classify infant motor functions. Scientific Reports, 11","DOI":"10.1038\/s41598-021-89347-5"},{"key":"16333_CR33","doi-asserted-by":"crossref","unstructured":"Sakkos D, McCay K, Marcroft C, Embleton N, Chattopadhyay S, Ho E (2021) Identification of abnormal movements in infants: A deep neural network for body part-based prediction of cerebral palsy. IEEE Access, PP:1\u20131","DOI":"10.1109\/ACCESS.2021.3093469"},{"key":"16333_CR34","doi-asserted-by":"crossref","unstructured":"Sciortino G, Farinella GM, Battiato S, Leo M, Distante C (2017) On the estimation of children\u2019s poses. In: Battiato S, Gallo G, Schettini R, Stanco F (eds), Image Analysis and Processing - ICIAP 2017, pp 410\u2013421, Cham. Springer International Publishing","DOI":"10.1007\/978-3-319-68548-9_38"},{"key":"16333_CR35","doi-asserted-by":"crossref","unstructured":"Shivakumar SS, Loeb H, Bogen DK, Shofer F, Bryant P, Prosser L, Johnson MJ (2017) Stereo 3d tracking of infants in natural play conditions. In: 2017 International Conference on Rehabilitation Robotics (ICORR), pp 841\u2013846","DOI":"10.1109\/ICORR.2017.8009353"},{"key":"16333_CR36","doi-asserted-by":"crossref","unstructured":"Spittle A, Orton J, Anderson P, Boyd R, Doyle L (2015) Early developmental intervention programmes provided post hospital discharge to prevent motor and cognitive impairment in preterm infants. Cochrane Database of Systematic Reviews","DOI":"10.1002\/14651858.CD005495.pub4"},{"key":"16333_CR37","doi-asserted-by":"crossref","unstructured":"Stahl A, Schellewald C, Stavdahl \u00c3, Aamo O, Adde L, Kirker\u00f8d, H (2012) An optical flow-based method to predict infantile cerebral palsy. IEEE Transactions on Neural Systems and Rehabilitation Engineering: a Publication of the IEEE Engineering in Medicine and Biology Society, 20:605\u2013614","DOI":"10.1109\/TNSRE.2012.2195030"},{"key":"16333_CR38","doi-asserted-by":"crossref","unstructured":"Sun K, Xiao B, Liu D, Wang J (2019) Deep high-resolution representation learning for human pose estimation. In: 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 5686\u20135696","DOI":"10.1109\/CVPR.2019.00584"},{"key":"16333_CR39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/ACCESS.2021.3051505","volume":"PP","author":"Q Wu","year":"2021","unstructured":"Wu Q, Xu G, Fan W, Chen L, Sicong Z (2021) Rgb-d videos-based early prediction of infant cerebral palsy via general movements complexity. IEEE Access PP:1\u20131","journal-title":"IEEE Access"},{"key":"16333_CR40","doi-asserted-by":"crossref","unstructured":"Wu Q, Xu G, Zhang S, Li Y, Wei F (2020) Human 3d pose estimation in a lying position by rgb-d images for medical diagnosis and rehabilitation. In: 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pp 5802\u20135805","DOI":"10.1109\/EMBC44109.2020.9176407"},{"key":"16333_CR41","doi-asserted-by":"crossref","unstructured":"Zhang F, Zhu X, Dai H, Ye M, Zhu C (2020) Distribution-aware coordinate representation for human pose estimation. In: 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 7091\u20137100","DOI":"10.1109\/CVPR42600.2020.00712"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-16333-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-023-16333-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-16333-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,22]],"date-time":"2024-02-22T13:35:18Z","timestamp":1708608918000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-023-16333-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,14]]},"references-count":41,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["16333"],"URL":"https:\/\/doi.org\/10.1007\/s11042-023-16333-6","relation":{},"ISSN":["1573-7721"],"issn-type":[{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,14]]},"assertion":[{"value":"21 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 June 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 July 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 August 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The study was conducted in accordance with international ethical standards and the Declaration of Helsinki. The AGMA study was approved by the Comit\u00e9 de Protection des Personnes - Sud-Est II Ethical Committee in February 2021.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Written parental consent was obtained from each participant.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All the infants\u2019 images in this study were used after a signed parental consent.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}}]}}