{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T00:43:32Z","timestamp":1768524212833,"version":"3.49.0"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2021,8,21]],"date-time":"2021-08-21T00:00:00Z","timestamp":1629504000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,21]],"date-time":"2021-08-21T00:00:00Z","timestamp":1629504000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006360","name":"Bundesministerium f\u00fcr Wirtschaft und Energie","doi-asserted-by":"publisher","award":["01MK20012B"],"award-info":[{"award-number":["01MK20012B"]}],"id":[{"id":"10.13039\/501100006360","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006360","name":"Bundesministerium f\u00fcr Wirtschaft und Energie","doi-asserted-by":"publisher","award":["01MK20012B"],"award-info":[{"award-number":["01MK20012B"]}],"id":[{"id":"10.13039\/501100006360","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Purpose<\/jats:title><jats:p>Body weight is a crucial parameter for patient-specific treatments, particularly in the context of proper drug dosage. Contactless weight estimation from visual sensor data constitutes a promising approach to overcome challenges arising in emergency situations. Machine learning-based methods have recently been shown to perform accurate weight estimation from point cloud data. The proposed methods, however, are designed for controlled conditions in terms of visibility and position of the patient, which limits their practical applicability. In this work, we aim to decouple accurate weight estimation from such specific conditions by predicting the weight of covered patients from voxelized point cloud data.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We propose a novel deep learning framework, which comprises two 3D CNN modules solving the given task in two separate steps. First, we train a 3D U-Net to virtually uncover the patient, i.e. to predict the patient\u2019s volumetric surface without a cover. Second, the patient\u2019s weight is predicted from this 3D volume by means of a 3D CNN architecture, which we optimized for weight regression.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We evaluate our approach on a lying pose dataset (SLP) under two different cover conditions. The proposed framework considerably improves on the baseline model by up to<jats:inline-formula><jats:alternatives><jats:tex-math>$${16}{\\%}$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:mrow><mml:mn>16<\/mml:mn><mml:mo>%<\/mml:mo><\/mml:mrow><\/mml:math><\/jats:alternatives><\/jats:inline-formula>and reduces the gap between the accuracy of weight estimates for covered and uncovered patients by up to<jats:inline-formula><jats:alternatives><jats:tex-math>$${52}{\\%}$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:mrow><mml:mn>52<\/mml:mn><mml:mo>%<\/mml:mo><\/mml:mrow><\/mml:math><\/jats:alternatives><\/jats:inline-formula>.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>We present a novel pipeline to estimate the weight of patients, which are covered by a blanket. Our approach relaxes the specific conditions that were required for accurate weight estimates by previous contactless methods and thus constitutes an important step towards fully automatic weight estimation in clinical practice.<\/jats:p><\/jats:sec>","DOI":"10.1007\/s11548-021-02476-0","type":"journal-article","created":{"date-parts":[[2021,8,21]],"date-time":"2021-08-21T16:03:50Z","timestamp":1629561830000},"page":"2079-2087","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Seeing under the cover with a 3D U-Net: point cloud-based weight estimation of covered patients"],"prefix":"10.1007","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7824-5735","authenticated-orcid":false,"given":"Alexander","family":"Bigalke","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lasse","family":"Hansen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jasper","family":"Diesel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mattias P.","family":"Heinrich","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,8,21]]},"reference":[{"key":"2476_CR1","doi-asserted-by":"crossref","unstructured":"Achilles F, Ichim AE, Coskun H, Tombari F, Noachtar S, Navab N (2016) Patient mocap: human pose estimation under blanket occlusion for hospital monitoring applications. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 491\u2013499","DOI":"10.1007\/978-3-319-46720-7_57"},{"key":"2476_CR2","doi-asserted-by":"crossref","unstructured":"Altinigne CY, Thanou D, Achanta R (2020) Height and weight estimation from unconstrained images. In: ICASSP 2020\u20132020 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, pp 2298\u20132302","DOI":"10.1109\/ICASSP40776.2020.9053363"},{"key":"2476_CR3","doi-asserted-by":"crossref","unstructured":"Benalcazar D, Benalcazar D, Erazo A (2017) Artificial neural networks and digital image processing: an approach for indirect weight measurement. In: 2017 IEEE second ecuador technical chapters meeting (ETCM). IEEE, pp 1\u20136","DOI":"10.1109\/ETCM.2017.8247457"},{"key":"2476_CR4","doi-asserted-by":"crossref","unstructured":"Bigalke A, Hansen L, Heinrich MP (2021) End-to-end learning of body weight prediction from point clouds with basis point sets. In: Bildverarbeitung f\u00fcr die Medizin 2021. Springer, pp 254\u2013259","DOI":"10.1007\/978-3-658-33198-6_59"},{"issue":"1","key":"2476_CR5","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1016\/j.jemermed.2010.10.022","volume":"42","author":"RG Buckley","year":"2012","unstructured":"Buckley RG, Stehman CR, Dos Santos FL, Riffenburgh RH, Swenson A, Mjos N, Brewer M, Mulligan S (2012) Bedside method to estimate actual body weight in the emergency department. J Emerg Med 42(1):100\u2013104","journal-title":"J Emerg Med"},{"issue":"3","key":"2476_CR6","first-page":"517","volume":"14","author":"L Casas","year":"2019","unstructured":"Casas L, Navab N, Demirci S (2019) Patient 3d body pose estimation from pressure imaging. Int J Comput Ass Rad 14(3):517\u2013524","journal-title":"Int J Comput Ass Rad"},{"issue":"4","key":"2476_CR7","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1136\/emermed-2015-205623","volume":"34","author":"GN Cattermole","year":"2017","unstructured":"Cattermole GN, Graham CA, Rainer TH (2017) Mid-arm circumference can be used to estimate weight of adult and adolescent patients. Emerg Med J 34(4):231\u2013236","journal-title":"Emerg Med J"},{"key":"2476_CR8","doi-asserted-by":"crossref","unstructured":"\u00c7i\u00e7ek \u00d6 Abdulkadir A, Lienkamp SS, Brox T, Ronneberger O (2016) 3d u-net: learning dense volumetric segmentation from sparse annotation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 424\u2013432","DOI":"10.1007\/978-3-319-46723-8_49"},{"key":"2476_CR9","doi-asserted-by":"crossref","unstructured":"Clever HM, Erickson Z, Kapusta A, Turk G, Liu K, Kemp CC (2020) Bodies at rest: 3d human pose and shape estimation from a pressure image using synthetic data. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 6215\u20136224","DOI":"10.1109\/CVPR42600.2020.00625"},{"key":"2476_CR10","unstructured":"Fernandes C, Clark S, Price A, Innes G (1999) How accurately do we estimate patients\u2019 weight in emergency departments? Can Fam Phys 45:2373"},{"key":"2476_CR11","doi-asserted-by":"crossref","unstructured":"Guo Y, Wang H, Hu Q, Liu H, Liu L, Bennamoun M (2020) Deep learning for 3d point clouds: a survey. IEEE Trans Pattern Anal Mach Intell","DOI":"10.1109\/TPAMI.2020.3005434"},{"key":"2476_CR12","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"issue":"10","key":"2476_CR13","doi-asserted-by":"publisher","first-page":"2676","DOI":"10.1109\/TIFS.2019.2904840","volume":"14","author":"M Jiang","year":"2019","unstructured":"Jiang M, Guo G (2019) Body weight analysis from human body images. IEEE Trans Inf Forensics Sec 14(10):2676\u20132688","journal-title":"IEEE Trans Inf Forensics Sec"},{"issue":"7","key":"2476_CR14","doi-asserted-by":"publisher","first-page":"1248","DOI":"10.1049\/iet-ipr.2019.1170","volume":"14","author":"M Jiang","year":"2020","unstructured":"Jiang M, Shang Y, Guo G (2020) Computational approach to body mass index estimation from dressed people in 3d space. IET Image Process 14(7):1248\u20131256","journal-title":"IET Image Process"},{"issue":"8","key":"2476_CR15","doi-asserted-by":"publisher","first-page":"2701","DOI":"10.1109\/TMI.2020.2991954","volume":"39","author":"S Karanam","year":"2020","unstructured":"Karanam S, Li R, Yang F, Hu W, Chen T, Wu Z (2020) Towards contactless patient positioning. IEEE Trans Med Imaging 39(8):2701\u20132710","journal-title":"IEEE Trans Med Imaging"},{"key":"2476_CR16","doi-asserted-by":"crossref","unstructured":"Labati RD, Genovese A, Piuri V, Scotti F (2012) Weight estimation from frame sequences using computational intelligence techniques. In: 2012 IEEE international conference on computational intelligence for measurement systems and applications (CIMSA) proceedings. IEEE, pp 29\u201334","DOI":"10.1109\/CIMSA.2012.6269603"},{"key":"2476_CR17","unstructured":"Liu S, Huang X, Fu N, Li C, Su Z, Ostadabbas S (2020) Simultaneously-collected multimodal lying pose dataset: towards in-bed human pose monitoring under adverse vision conditions. arXiv preprint arXiv:2008.08735"},{"key":"2476_CR18","doi-asserted-by":"crossref","unstructured":"Liu S, Ostadabbas S (2019) Seeing under the cover: a physics guided learning approach for in-bed pose estimation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 236\u2013245","DOI":"10.1007\/978-3-030-32239-7_27"},{"issue":"12","key":"2476_CR19","doi-asserted-by":"publisher","first-page":"1331","DOI":"10.1136\/jnnp.2007.117150","volume":"78","author":"MW Lorenz","year":"2007","unstructured":"Lorenz MW, Graf M, Henke C, Hermans M, Ziemann U, Sitzer M, Foerch C (2007) Anthropometric approximation of body weight in unresponsive stroke patients. J Neurol Neurosurg Psychiatry 78(12):1331\u20131336","journal-title":"J Neurol Neurosurg Psychiatry"},{"key":"2476_CR20","doi-asserted-by":"crossref","unstructured":"Maturana D, Scherer S (2015) Voxnet: a 3d convolutional neural network for real-time object recognition. In: 2015 IEEE\/RSJ international conference on intelligent robots and systems (IROS). IEEE, pp 922\u2013928","DOI":"10.1109\/IROS.2015.7353481"},{"issue":"2","key":"2476_CR21","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1111\/j.1742-6723.2005.00701.x","volume":"17","author":"S Menon","year":"2005","unstructured":"Menon S, Kelly AM (2005) How accurate is weight estimation in the emergency department? Emerg Med Australas 17(2):113\u2013116","journal-title":"Emerg Med Australas"},{"key":"2476_CR22","doi-asserted-by":"crossref","unstructured":"Moon G, Chang JY, Lee KM (2018) V2v-posenet: voxel-to-voxel prediction network for accurate 3d hand and human pose estimation from a single depth map. In: Proceedings of the IEEE conference on computer vision and pattern Recognition, pp 5079\u20135088","DOI":"10.1109\/CVPR.2018.00533"},{"key":"2476_CR23","doi-asserted-by":"crossref","unstructured":"Nahavandi D, Abobakr A, Haggag H, Hossny M, Nahavandi S, Filippidis D (2017) A skeleton-free kinect system for body mass index assessment using deep neural networks. In: 2017 IEEE international systems engineering symposium (ISSE). IEEE, pp 1\u20136","DOI":"10.1109\/SysEng.2017.8088252"},{"issue":"5","key":"2476_CR24","doi-asserted-by":"publisher","first-page":"777","DOI":"10.1007\/s11390-014-1467-0","volume":"29","author":"TV Nguyen","year":"2014","unstructured":"Nguyen TV, Feng J, Yan S (2014) Seeing human weight from a single rgb-d image. J Comput Sci Technol 29(5):777\u2013784","journal-title":"J Comput Sci Technol"},{"key":"2476_CR25","unstructured":"Paszke A, Gross S, Chintala S, Chanan G, Yang E, DeVito Z, Lin Z, Desmaison A, Antiga L, Lerer A (2017) Automatic differentiation in pytorch. In: NIPS-W"},{"key":"2476_CR26","doi-asserted-by":"crossref","unstructured":"Pfitzner C, May S, Merkl C, Breuer L, K\u00f6hrmann M, Braun J, Dirauf F, N\u00fcchter A (2015) Libra3d: body weight estimation for emergency patients in clinical environments with a 3d structured light sensor. In: 2015 IEEE international conference on robotics and automation (ICRA). IEEE, pp 2888\u20132893","DOI":"10.1109\/ICRA.2015.7139593"},{"key":"2476_CR27","doi-asserted-by":"crossref","unstructured":"Pfitzner C, May S, N\u00fcchter A (2016) Neural network-based visual body weight estimation for drug dosage finding. In: Medical imaging 2016: image processing, vol 9784. International Society for Optics and Photonics, p 97841Z","DOI":"10.1117\/12.2216042"},{"issue":"1","key":"2476_CR28","doi-asserted-by":"publisher","first-page":"10148","DOI":"10.1016\/j.ifacol.2017.08.1761","volume":"50","author":"C Pfitzner","year":"2017","unstructured":"Pfitzner C, May S, N\u00fcchter A (2017) Evaluation of features from rgb-d data for human body weight estimation. IFAC-PapersOnLine 50(1):10148\u201310153","journal-title":"IFAC-PapersOnLine"},{"key":"2476_CR29","unstructured":"Pirker K, R\u00fcther M, Bischof H, Skrabal F, Pichler G (2009) Human body volume estimation in a clinical environment. AAPR\/OAGM: challenges in the biosciences: image analysis and pattern recognition aspects, Stainz Austria"},{"key":"2476_CR30","doi-asserted-by":"crossref","unstructured":"Prokudin S, Lassner C, Romero J (2019) Efficient learning on point clouds with basis point sets. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp 4332\u20134341","DOI":"10.1109\/ICCV.2019.00443"},{"key":"2476_CR31","unstructured":"Qi CR, Su H, Mo K, Guibas LJ (2017) Pointnet: deep learning on point sets for 3d classification and segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 652\u2013660"},{"key":"2476_CR32","unstructured":"Qi CR, Yi L, Su H, Guibas LJ (2017) Pointnet++: deep hierarchical feature learning on point sets in a metric space. arXiv preprint arXiv:1706.02413"},{"key":"2476_CR33","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 234\u2013241","DOI":"10.1007\/978-3-319-24574-4_28"},{"issue":"2","key":"2476_CR34","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1016\/j.jss.2015.03.097","volume":"197","author":"MR Silas","year":"2015","unstructured":"Silas MR, Grassia P, Langerman A (2015) Video recording of the operating room-is anonymity possible? J Surg Res 197(2):272\u2013276","journal-title":"J Surg Res"},{"key":"2476_CR35","doi-asserted-by":"crossref","unstructured":"Singh V, Ma K, Tamersoy B, Chang YJ, Wimmer A, O\u2019Donnell T, Chen T (2017) Darwin: deformable patient avatar representation with deep image network. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 497\u2013504","DOI":"10.1007\/978-3-319-66185-8_56"},{"key":"2476_CR36","doi-asserted-by":"crossref","unstructured":"Song S, Xiao J (2016) Deep sliding shapes for amodal 3d object detection in rgb-d images. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 808\u2013816","DOI":"10.1109\/CVPR.2016.94"},{"key":"2476_CR37","doi-asserted-by":"crossref","unstructured":"Supranata TH, Davin PSS, Jeremy DK, Pratiwi AE, Wulandari M (2018) Body weight measurement using image processing based on body surface area and elliptical tube volume. In: 2018 10th international conference on information technology and electrical engineering (ICITEE). IEEE, pp 290\u2013294","DOI":"10.1109\/ICITEED.2018.8534735"},{"key":"2476_CR38","unstructured":"Velardo C, Dugelay JL(2012) What can computer vision tell you about your weight? In: 2012 Proceedings of the 20th European signal processing conference (EUSIPCO). IEEE, pp 1980\u20131984"},{"key":"2476_CR39","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.neucom.2018.05.083","volume":"312","author":"M Wang","year":"2018","unstructured":"Wang M, Deng W (2018) Deep visual domain adaptation: a survey. Neurocomputing 312:135\u2013153","journal-title":"Neurocomputing"},{"issue":"5","key":"2476_CR40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3326362","volume":"38","author":"Y Wang","year":"2019","unstructured":"Wang Y, Sun Y, Liu Z, Sarma SE, Bronstein MM, Solomon JM (2019) Dynamic graph CNN for learning on point clouds. ACM Trans Graphic 38(5):1\u201312","journal-title":"ACM Trans Graphic"},{"key":"2476_CR41","unstructured":"Wu Z, Song S, Khosla A, Yu F, Zhang L, Tang X, Xiao J (2015) 3d shapenets: a deep representation for volumetric shapes. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1912\u20131920"},{"key":"2476_CR42","doi-asserted-by":"crossref","unstructured":"Yang F, Li R, Georgakis G, Karanam S, Chen T, Ling H, Wu Z (2020) Robust multi-modal 3d patient body modeling. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 86\u201395","DOI":"10.1007\/978-3-030-59716-0_9"},{"key":"2476_CR43","unstructured":"Yin Y, Robinson JP, Fu Y (2020) Multimodal in-bed pose and shape estimation under the blankets. arXiv preprint arXiv:2012.06735"},{"key":"2476_CR44","unstructured":"Zhou K, Liu Z, Qiao Y, Xiang T, Loy CC (2021) Domain generalization: a survey. arXiv preprint arXiv:2103.02503"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-021-02476-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-021-02476-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-021-02476-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,7]],"date-time":"2023-11-07T18:13:28Z","timestamp":1699380808000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-021-02476-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,21]]},"references-count":44,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["2476"],"URL":"https:\/\/doi.org\/10.1007\/s11548-021-02476-0","relation":{},"ISSN":["1861-6410","1861-6429"],"issn-type":[{"value":"1861-6410","type":"print"},{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,21]]},"assertion":[{"value":"31 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 August 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Source code is available at","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code availability"}},{"value":"The authors declare that they have no conflict of interest.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"This article does not contain any studies with human participants or animals performed by any of the authors.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Statement of informed consent was not applicable since the manuscript does not contain any participants\u2019 data.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}