{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T11:20:25Z","timestamp":1773141625723,"version":"3.50.1"},"reference-count":21,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2022,12,24]],"date-time":"2022-12-24T00:00:00Z","timestamp":1671840000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,12,24]],"date-time":"2022-12-24T00:00:00Z","timestamp":1671840000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["13GW0473A"],"award-info":[{"award-number":["13GW0473A"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Past research contained the investigation and development of robotic ultrasound. In this context, interfaces which allow for interaction with the robotic system are of paramount importance. Few researchers have addressed the issue of developing non-tactile interaction approaches, although they could be beneficial for maintaining sterility during medical procedures. Interaction could be supported by multimodality, which has the potential to enable intuitive and natural interaction. To assess the feasibility of multimodal interaction for non-tactile control of a co-located robotic ultrasound system, a novel human\u2013robot interaction concept was developed.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>The medical use case of needle-based interventions under hybrid computed tomography and ultrasound imaging was analyzed by interviewing four radiologists. From the resulting workflow, interaction tasks were derived which include human\u2013robot interaction. Based on this, characteristics of a multimodal, touchless human\u2013robot interface were elaborated, suitable interaction modalities were identified, and a corresponding interface was developed, which was thereafter evaluated in a user study with eight participants.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The implemented interface includes voice commands, combined with hand gesture control for discrete control and navigation interaction of the robotic US probe, respectively. The interaction concept was evaluated by the users in the form of a quantitative questionnaire with a average usability. Qualitative analysis of interview results revealed user satisfaction with the implemented interaction methods and potential improvements to the system.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>A multimodal, touchless interaction concept for a robotic US for the use case of needle-based procedures in interventional radiology was developed, incorporating combined voice and hand gesture control. Future steps will include the integration of a solution for the missing haptic feedback and the evaluation of its clinical suitability.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-022-02810-0","type":"journal-article","created":{"date-parts":[[2022,12,24]],"date-time":"2022-12-24T07:02:36Z","timestamp":1671865356000},"page":"1429-1436","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A multimodal user interface for touchless control of robotic ultrasound"],"prefix":"10.1007","volume":"18","author":[{"given":"Josefine","family":"Schreiter","sequence":"first","affiliation":[]},{"given":"Tonia","family":"Mielke","sequence":"additional","affiliation":[]},{"given":"Danny","family":"Schott","sequence":"additional","affiliation":[]},{"given":"Maximilian","family":"Thormann","sequence":"additional","affiliation":[]},{"given":"Jazan","family":"Omari","sequence":"additional","affiliation":[]},{"given":"Maciej","family":"Pech","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5734-7529","authenticated-orcid":false,"given":"Christian","family":"Hansen","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,12,24]]},"reference":[{"issue":"1","key":"2810_CR1","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s43154-020-00037-y","volume":"2","author":"F Von Haxthausen","year":"2021","unstructured":"Von Haxthausen F, B\u00f6ttger S, Wulff D, Hagenah J, Garc\u00eda-V\u00e1zquez V, Ipsen S (2021) Medical robotics for ultrasound imaging: current systems and future trends. Curr Robotics Rep 2(1):55\u201371","journal-title":"Curr Robotics Rep"},{"issue":"3","key":"2810_CR2","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1561\/1100000005","volume":"1","author":"MA Goodrich","year":"2007","unstructured":"Goodrich MA, Schultz AC (2007) Human\u2013robot interaction: a survey. Found Trends\u00ae Hum Comput Interact 1(3):203\u2013275","journal-title":"Found Trends\u00ae Hum Comput Interact"},{"issue":"3","key":"2810_CR3","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1177\/875647938500100309","volume":"1","author":"M Craig","year":"1985","unstructured":"Craig M (1985) Sonography: an occupational health hazard? J Diagn Med Sonogr 1(3):121\u2013126","journal-title":"J Diagn Med Sonogr"},{"issue":"3","key":"2810_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2019.101606","volume":"54","author":"Q Huang","year":"2019","unstructured":"Huang Q, Lan J (2019) Remote control of a robotic prosthesis arm with six-degree-of-freedom for ultrasonic scanning and three-dimensional imaging. Biomed Signal Process Control 54(3):101606","journal-title":"Biomed Signal Process Control"},{"key":"2810_CR5","doi-asserted-by":"crossref","unstructured":"de Cunha D, Gravez P, Leroy C, Maillard E, Jouan J, Varley P, Jones M, Halliwell M, Hawkes D, Wells PNT, Angelini L (1998) The midstep system for ultrasound guided remote telesurgery. In: Proceedings of the 20th annual international conference of the IEEE engineering in medicine and biology society. Biomedical engineering towards the year 2000 and beyond (Cat. No. 98CH36286), vol 20. IEEE, pp 1266\u20131269","DOI":"10.1109\/IEMBS.1998.747107"},{"key":"2810_CR6","doi-asserted-by":"crossref","unstructured":"Mathiassen K, Fjellin JE, Glette K, Hol PK, Elle OJ (2016) An ultrasound robotic system using the commercial robot ur5. Front Robotics AI 3:11","DOI":"10.3389\/frobt.2016.00001"},{"key":"2810_CR7","doi-asserted-by":"crossref","unstructured":"Zandsteeg CJ, Bruijnen DJH, van de Molengraft MJG (2010) Haptic tele-operation system control design for the ultrasound task: a loop-shaping approach. Mechatronics 20(7):767-777","DOI":"10.1016\/j.mechatronics.2010.02.007"},{"issue":"6","key":"2810_CR8","doi-asserted-by":"publisher","first-page":"983","DOI":"10.1007\/s11548-017-1566-9","volume":"12","author":"T-Y Fang","year":"2017","unstructured":"Fang T-Y, Zhang HK, Finocchi R, Taylor RH, Boctor EM (2017) Force-assisted ultrasound imaging system through dual force sensing and admittance robot control. Int J Comput Assist Radiol Surg 12(6):983\u2013991","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"4","key":"2810_CR9","doi-asserted-by":"publisher","first-page":"172988141771604","DOI":"10.1177\/1729881417716043","volume":"14","author":"I Maurtua","year":"2017","unstructured":"Maurtua I, Fern\u00e1ndez I, Tellaeche A, Kildal J, Susperregi L, Ibarguren A, Sierra B (2017) Natural multimodal communication for human\u2013robot collaboration. Int J Adv Rob Syst 14(4):172988141771604","journal-title":"Int J Adv Rob Syst"},{"issue":"1","key":"2810_CR10","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1109\/MIS.2001.1183338","volume":"16","author":"D Perzanowski","year":"2001","unstructured":"Perzanowski D, Schultz AC, Adams W, Marsh E, Bugajska M (2001) Building a multimodal human\u2013robot interface. IEEE Intell Syst 16(1):16\u201321","journal-title":"IEEE Intell Syst"},{"issue":"1","key":"2810_CR11","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1016\/j.specom.2013.09.008","volume":"57","author":"P Wagner","year":"2014","unstructured":"Wagner P, Malisz Z, Kopp S (2014) Gesture and speech in interaction: an overview. Speech Commun 57(1):209\u2013232","journal-title":"Speech Commun"},{"key":"2810_CR12","doi-asserted-by":"crossref","unstructured":"Hugle J, Lambrecht J, Kruger J (2017) An integrated approach for industrial robot control and programming combining haptic and non-haptic gestures. In: 2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, pp 851\u2013857","DOI":"10.1109\/ROMAN.2017.8172402"},{"key":"2810_CR13","doi-asserted-by":"publisher","first-page":"55448","DOI":"10.1109\/ACCESS.2021.3071364","volume":"9","author":"K-B Park","year":"2021","unstructured":"Park K-B, Choi SH, Lee JY, Ghasemi Y, Mohammed M, Jeong H (2021) Hands-free human\u2013robot interaction using multimodal gestures and deep learning in wearable mixed reality. IEEE Access 9:55448\u201355464","journal-title":"IEEE Access"},{"key":"2810_CR14","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-45247-5","volume-title":"Interaktive Systeme","author":"B Preim","year":"2015","unstructured":"Preim B, Dachselt R (2015) Interaktive Systeme. Springer, Berlin"},{"key":"2810_CR15","unstructured":"Ferre M, Macias-Guarasa J, Aracil R, Barrientos A (1998) voice command generation for teleoperated robot systems"},{"key":"2810_CR16","first-page":"11","volume-title":"The think aloud method: a practical approach to modelling cognitive","author":"M van Someren","year":"1994","unstructured":"van Someren M, Barnard YF, Sandberg J (1994) The think aloud method: a practical approach to modelling cognitive. Academic Press, London, p 11"},{"key":"2810_CR17","first-page":"207","volume-title":"Usability evaluation in industry","author":"J Brooke","year":"1996","unstructured":"Brooke J (1996) SUS: A \u2018quick and dirty\u2019 usability scale. Usability evaluation in industry. CRC Press, Boca Raton, pp 207\u2013212"},{"key":"2810_CR18","unstructured":"Sauro J (2011) A practical guide to the system usability scale: background, benchmarks & best practices. Measuring Usability LLC"},{"issue":"2","key":"2810_CR19","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1007\/s11548-021-02526-7","volume":"17","author":"T Nguyen","year":"2022","unstructured":"Nguyen T, Plishker W, Matisoff A, Sharma K, Shekhar R (2022) HoloUs: augmented reality visualization of live ultrasound images using HoloLens for ultrasound-guided procedures. Int J Comput Assist Radiol Surg 17(2):385\u2013391","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"11","key":"2810_CR20","doi-asserted-by":"publisher","first-page":"1895","DOI":"10.1007\/s11548-020-02236-6","volume":"15","author":"C R\u00fcger","year":"2020","unstructured":"R\u00fcger C, Feufel MA, Moosburner S, \u00d6zbek C, Pratschke J, Sauer IM (2020) Ultrasound in augmented reality: a mixed-methods evaluation of head-mounted displays in image-guided interventions. Int J Comput Assist Radiol Surg 15(11):1895\u20131905","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"2810_CR21","doi-asserted-by":"crossref","unstructured":"Li T, Meng X, Tavakoli M (2022) Dual mode pHRI-teleHRI control system with a hybrid admittance-force controller for ultrasound imaging. Sensors (Basel, Switzerland) 22(11)","DOI":"10.3390\/s22114025"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-022-02810-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-022-02810-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-022-02810-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,22]],"date-time":"2023-07-22T05:07:46Z","timestamp":1690002466000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-022-02810-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,24]]},"references-count":21,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["2810"],"URL":"https:\/\/doi.org\/10.1007\/s11548-022-02810-0","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,24]]},"assertion":[{"value":"16 September 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 December 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 December 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}