{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T00:56:02Z","timestamp":1760403362995,"version":"build-2065373602"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2025,6,26]],"date-time":"2025-06-26T00:00:00Z","timestamp":1750896000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,6,26]],"date-time":"2025-06-26T00:00:00Z","timestamp":1750896000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100020963","name":"Moonshot Research and Development Program","doi-asserted-by":"publisher","award":["JPMJMS2033-09"],"award-info":[{"award-number":["JPMJMS2033-09"]}],"id":[{"id":"10.13039\/501100020963","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Purpose<\/jats:title>\n            <jats:p>To support research on autonomous robotic micro-drilling for cranial window creation in mice, a multimodal digital twin (DT) is developed to generate realistic synthetic images and drilling sounds. The realism of the DT is evaluated using data from an eggshell drilling scenario, demonstrating its potential for training AI models with multimodal synthetic data.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>The asynchronous multi-body framework (AMBF) simulator for volumetric drilling with haptic feedback is combined with the Isaac Sim simulator for photorealistic rendering. A deep audio generator (DAG) model is presented and its realism is evaluated on real drilling sounds. A convolutional neural network (CNN) trained on synthetic images is used to assess visual realism by detecting drilling areas in real eggshell images. Finally, the accuracy of the DT is evaluated by experiments on a real eggshell.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>The DAG model outperformed pitch modulation methods, achieving lower Frechet audio distance (FAD) and Frechet inception distance (FID) scores, demonstrating a closer resemblance to real drilling sounds. The CNN trained on synthetic images achieved a mean average precision (mAP) of 70.2 when tested on real drilling images. The DT had an alignment error of 0.22 \u00b1 0.03\u00a0mm.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>A multimodal DT has been developed to simulate the creation of the cranial window on an eggshell model and its realism has been evaluated. The results indicate a high degree of realism in both the synthetic audio and images and submillimeter accuracy.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1007\/s11548-025-03465-3","type":"journal-article","created":{"date-parts":[[2025,6,26]],"date-time":"2025-06-26T03:20:20Z","timestamp":1750908020000},"page":"1987-1997","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A multimodal digital twin for autonomous micro-drilling in scientific exploration"],"prefix":"10.1007","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1812-8649","authenticated-orcid":false,"given":"Saul Alexis","family":"Heredia Perez","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tze Lun","family":"Lok","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Enduo","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kanako","family":"Harada","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,6,26]]},"reference":[{"key":"3465_CR1","doi-asserted-by":"crossref","unstructured":"Di\u00a0Maio S, Sekhar LN (2018) Skull base tumors: Evaluation and microsurgery. In: Principles of neurological surgery, pp. 682\u2013694. Elsevier","DOI":"10.1016\/B978-0-323-43140-8.00047-0"},{"key":"3465_CR2","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1016\/B978-0-444-59602-4.00019-8","volume":"124","author":"D Solari","year":"2014","unstructured":"Solari D, Cavallo LM, Cappabianca P (2014) Surgical approach to pituitary tumors. Handbook Clin Neurol 124:291\u2013301","journal-title":"Handbook Clin Neurol"},{"key":"3465_CR3","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.jmatprotec.2015.09.016","volume":"229","author":"Z Liao","year":"2016","unstructured":"Liao Z, Axinte DA (2016) On monitoring chip formation, penetration depth and cutting malfunctions in bone micro-drilling via acoustic emission. J Mater Process Technol 229:82\u201393","journal-title":"J Mater Process Technol"},{"key":"3465_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2021.109100","volume":"354","author":"SW Cramer","year":"2021","unstructured":"Cramer SW, Carter RE, Aronson JD, Kodandaramaiah SB, Ebner TJ, Chen CC (2021) Through the looking glass: a review of cranial window technology for optical access to the brain. J Neurosci Methods 354:109100","journal-title":"J Neurosci Methods"},{"issue":"5","key":"3465_CR5","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1038\/nbt.4127","volume":"36","author":"AA Mansour","year":"2018","unstructured":"Mansour AA, Gon\u00e7alves JT, Bloyd CW, Li H, Fernandes S, Quang D, Johnston S, Parylak SL, Jin X, Gage FH (2018) An in vivo model of functional and vascularized human brain organoids. Nature Biotechnol 36(5):432\u2013441","journal-title":"Nature Biotechnol"},{"key":"3465_CR6","doi-asserted-by":"publisher","first-page":"64188","DOI":"10.3791\/64188","volume":"189","author":"GF Hoeferlin","year":"2022","unstructured":"Hoeferlin GF, Menendez DM, Krebs OK, Capadona JR, Shoffstall AJ (2022) Assessment of thermal damage from robot-drilled craniotomy for cranial window surgery in mice. JoVE (J Visual Exp) 189:64188. https:\/\/doi.org\/10.3791\/64188","journal-title":"JoVE (J Visual Exp)"},{"issue":"10","key":"3465_CR7","doi-asserted-by":"publisher","first-page":"3943","DOI":"10.1152\/jn.01055.2014","volume":"113","author":"N Pak","year":"2015","unstructured":"Pak N, Siegle JH, Kinney JP, Denman DJ, Blanche TJ, Boyden ES (2015) Closed-loop, ultraprecise, automated craniotomies. J Neurophysiol 113(10):3943\u20133953","journal-title":"J Neurophysiol"},{"issue":"1","key":"3465_CR8","doi-asserted-by":"publisher","first-page":"1023","DOI":"10.1038\/s41598-018-37073-w","volume":"9","author":"L Ghanbari","year":"2019","unstructured":"Ghanbari L, Rynes ML, Hu J, Schulman DS, Johnson GW, Laroque M, Shull GM, Kodandaramaiah SB (2019) Craniobot: a computer numerical controlled robot for cranial microsurgeries. Sci Rep 9(1):1023","journal-title":"Sci Rep"},{"key":"3465_CR9","doi-asserted-by":"crossref","unstructured":"Marinho MM, Quiroz-Oma\u00f1a JJ, Harada K (2024) A multiarm robotic platform for scientific exploration: Its design, digital twins, and validation. IEEE Robotics & Automation Magazine","DOI":"10.1109\/MRA.2023.3336472"},{"key":"3465_CR10","doi-asserted-by":"crossref","unstructured":"Zhao E, Marinho MM, Harada K (2023) Autonomous robotic drilling system for mice cranial window creation: an evaluation with an egg model. In: 2023 IEEE\/RSJ international conference on intelligent robots and systems (IROS), 4592\u20134599. IEEE","DOI":"10.1109\/IROS55552.2023.10341693"},{"key":"3465_CR11","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1016\/j.wneu.2017.12.099","volume":"111","author":"L Andreoli","year":"2018","unstructured":"Andreoli L, Simpl\u00edcio H, Morya E (2018) Egg model training protocol for stereotaxic neurosurgery and microelectrode implantation. World Neurosurg 111:243\u2013250","journal-title":"World Neurosurg"},{"issue":"6","key":"3465_CR12","doi-asserted-by":"publisher","first-page":"1077","DOI":"10.1007\/s11548-023-02863-9","volume":"18","author":"H Shu","year":"2023","unstructured":"Shu H, Liang R, Li Z, Goodridge A, Zhang X, Ding H, Nagururu N, Sahu M, Creighton FX, Taylor RH et al (2023) Twin-s: a digital twin for skull base surgery. Int J Comput Assist Radiol Surg 18(6):1077\u20131084","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3465_CR13","doi-asserted-by":"publisher","unstructured":"Bryan J, Stredney D, Wiet G, Sessanna D (2001) Virtual temporal bone dissection: a case study. In: Proceedings visualization, 2001. VIS \u201901., pp. 497\u2013598. https:\/\/doi.org\/10.1109\/VISUAL.2001.964561","DOI":"10.1109\/VISUAL.2001.964561"},{"key":"3465_CR14","doi-asserted-by":"crossref","unstructured":"Morris D, Sewell C, Blevins N, Barbagli F, Salisbury K (2004) A collaborative virtual environment for the simulation of temporal bone surgery. In: Medical image computing and computer-assisted intervention\u2013MICCAI 2004: 7th International Conference, Saint-Malo, France, September 26-29, 2004. Proceedings, Part II 7, pp. 319\u2013327. Springer","DOI":"10.1007\/978-3-540-30136-3_40"},{"issue":"S1","key":"3465_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/lary.22499","volume":"122","author":"GJ Wiet","year":"2012","unstructured":"Wiet GJ, Stredney D, Kerwin T, Hittle B, Fernandez SA, Abdel-Rasoul M, Welling DB (2012) Virtual temporal bone dissection system: Osu virtual temporal bone system: development and testing. Laryngoscope 122(S1):1\u201312","journal-title":"Laryngoscope"},{"issue":"1","key":"3465_CR16","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1007\/s11548-023-02956-5","volume":"19","author":"A Munawar","year":"2024","unstructured":"Munawar A, Li Z, Nagururu N, Trakimas D, Kazanzides P, Taylor RH, Creighton FX (2024) Fully immersive virtual reality for skull-base surgery: surgical training and beyond. Int J Comput Assist Radiol Surg 19(1):51\u201359","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3465_CR17","doi-asserted-by":"crossref","unstructured":"Ying Z, Shu L, Sugita N (2020) Autonomous penetration perception for bone cutting during laminectomy. In: 2020 8th IEEE RAS\/EMBS international conference for biomedical robotics and biomechatronics (BioRob), pp. 1043\u20131048. IEEE","DOI":"10.1109\/BioRob49111.2020.9224375"},{"key":"3465_CR18","unstructured":"Niu Q (2008) Modeling and rendering for development of a virtual bone surgery system. PhD thesis. AAI3318730"},{"issue":"4","key":"3465_CR19","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1080\/21681163.2021.1999331","volume":"10","author":"A Munawar","year":"2021","unstructured":"Munawar A, Li Z, Kunjam P, Nagururu N, Ding AS, Kazanzides P, Looi T, Creighton FX, Taylor RH, Unberath M (2021) Virtual reality for synergistic surgical training and data generation. Comput Methods Biomech Biomed Eng Imag Visual 10(4):366\u2013374","journal-title":"Comput Methods Biomech Biomed Eng Imag Visual"},{"key":"3465_CR20","unstructured":"Isaac Sim \u2014 developer.nvidia.com. https:\/\/developer.nvidia.com\/isaac\/sim. [Accessed 02 July 2024]"},{"key":"3465_CR21","doi-asserted-by":"crossref","unstructured":"Lorensen WE, Cline HE (1998) Marching cubes: A high resolution 3d surface construction algorithm. In: Seminal graphics: pioneering efforts that shaped the field, pp. 347\u2013353","DOI":"10.1145\/280811.281026"},{"issue":"10","key":"3465_CR22","doi-asserted-by":"publisher","first-page":"1661","DOI":"10.3390\/math10101661","volume":"10","author":"Y-K Weng","year":"2022","unstructured":"Weng Y-K, Li C-H, Lai C-C, Cheng C-W (2022) Equation for egg volume calculation based on smart s model. Mathematics 10(10):1661","journal-title":"Mathematics"},{"key":"3465_CR23","unstructured":"Mirza M, Osindero S (2014) Conditional generative adversarial nets. CoRR abs\/1411.1784 arXiv:1411.1784"},{"key":"3465_CR24","unstructured":"Radford A, Metz L, Chintala S (2015) Unsupervised representation learning with deep convolutional generative adversarial networks. CoRR arXiv:1511.06434"},{"key":"3465_CR25","unstructured":"Kong J, Kim J, Bae J (2020) Hifi-gan: Generative adversarial networks for efficient and high fidelity speech synthesis. In: Advances in neural information processing systems, vol. 33, pp. 17022\u201317033. Curran Associates, Inc"},{"issue":"1","key":"3465_CR26","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1186\/s10033-022-00744-x","volume":"35","author":"Z Ying","year":"2022","unstructured":"Ying Z, Shu L, Sugita N (2022) Bone milling: on monitoring cutting state and force using sound signals. Chin J Mech Eng 35(1):61","journal-title":"Chin J Mech Eng"},{"key":"3465_CR27","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"3465_CR28","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1007\/978-3-319-46448-0_2","volume-title":"Computer Vision - ECCV 2016","author":"W Liu","year":"2016","unstructured":"Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C-Y, Berg AC (2016) Ssd: single shot multibox detector. In: Leibe B, Matas J, Sebe N, Welling M (eds) Computer Vision - ECCV 2016. Springer, Cham, pp 21\u201337"},{"issue":"24","key":"3465_CR29","doi-asserted-by":"publisher","first-page":"1730","DOI":"10.1080\/01691864.2024.2415092","volume":"38","author":"X Lin","year":"2024","unstructured":"Lin X, Heredia P\u00e9rez SA, Harada K (2024) A cranial-feature-based registration scheme for robotic micromanipulation using a microscopic stereo camera system. Adv Robot 38(24):1730\u20131742","journal-title":"Adv Robot"},{"key":"3465_CR30","doi-asserted-by":"publisher","unstructured":"Kilgour K, Zuluaga M, Roblek D, Sharifi M (2019) Fr chet audio distance: A reference-free metric for evaluating music enhancement algorithms. In: Interspeech 2019, pp. 2350\u20132354. https:\/\/doi.org\/10.21437\/Interspeech.2019-2219","DOI":"10.21437\/Interspeech.2019-2219"},{"key":"3465_CR31","unstructured":"Heusel M, Ramsauer H, Unterthiner T, Nessler B, Hochreiter S (2017) Gans trained by a two time-scale update rule converge to a local nash equilibrium. Adv Neural Inf Process Syst 30"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-025-03465-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-025-03465-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-025-03465-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T17:07:14Z","timestamp":1760375234000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-025-03465-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,26]]},"references-count":31,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2025,10]]}},"alternative-id":["3465"],"URL":"https:\/\/doi.org\/10.1007\/s11548-025-03465-3","relation":{},"ISSN":["1861-6429"],"issn-type":[{"type":"electronic","value":"1861-6429"}],"subject":[],"published":{"date-parts":[[2025,6,26]]},"assertion":[{"value":"10 November 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 June 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 June 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflict of interest directly relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}