{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,5]],"date-time":"2026-08-05T18:32:39Z","timestamp":1785954759834,"version":"3.56.0"},"reference-count":105,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,3,3]],"date-time":"2022-03-03T00:00:00Z","timestamp":1646265600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,3,3]],"date-time":"2022-03-03T00:00:00Z","timestamp":1646265600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100013342","name":"NIHR Imperial Biomedical Research Centre","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100013342","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Multiscale Medical Robotic Center (MRC) InnoHK, Hong Kong Innovation and Technology Commission."}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Accurate and objective performance assessment is essential for both trainees and certified surgeons. However, existing methods can be time consuming, labor intensive, and subject to bias. Machine learning (ML) has the potential to provide rapid, automated, and reproducible feedback without the need for expert reviewers. We aimed to systematically review the literature and determine the ML techniques used for technical surgical skill assessment and identify challenges and barriers in the field. A systematic literature search, in accordance with the PRISMA statement, was performed to identify studies detailing the use of ML for technical skill assessment in surgery. Of the 1896 studies that were retrieved, 66 studies were included. The most common ML methods used were Hidden Markov Models (HMM, 14\/66), Support Vector Machines (SVM, 17\/66), and Artificial Neural Networks (ANN, 17\/66). 40\/66 studies used kinematic data, 19\/66 used video or image data, and 7\/66 used both. Studies assessed the performance of benchtop tasks (48\/66), simulator tasks (10\/66), and real-life surgery (8\/66). Accuracy rates of over 80% were achieved, although tasks and participants varied between studies. Barriers to progress in the field included a focus on basic tasks, lack of standardization between studies, and lack of datasets. ML has the potential to produce accurate and objective surgical skill assessment through the use of methods including HMM, SVM, and ANN. Future ML-based assessment tools should move beyond the assessment of basic tasks and towards real-life surgery and provide interpretable feedback with clinical value for the surgeon.<\/jats:p><jats:p>PROSPERO: CRD42020226071<\/jats:p>","DOI":"10.1038\/s41746-022-00566-0","type":"journal-article","created":{"date-parts":[[2022,3,3]],"date-time":"2022-03-03T11:02:42Z","timestamp":1646305362000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":159,"title":["Machine learning for technical skill assessment in surgery: a systematic review"],"prefix":"10.1038","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6407-4912","authenticated-orcid":false,"given":"Kyle","family":"Lam","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junhong","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zeyu","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fahad M.","family":"Iqbal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7815-7989","authenticated-orcid":false,"given":"Ara","family":"Darzi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benny","family":"Lo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0187-8328","authenticated-orcid":false,"given":"Sanjay","family":"Purkayastha","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James M.","family":"Kinross","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,3,3]]},"reference":[{"key":"566_CR1","first-page":"273","volume":"84","author":"JA Martin","year":"1997","unstructured":"Martin, J. A. et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br. J. Surg. 84, 273\u2013278 (1997).","journal-title":"Br. J. Surg."},{"key":"566_CR2","doi-asserted-by":"publisher","first-page":"738","DOI":"10.1097\/DCR.0000000000000817","volume":"60","author":"BJ Champagne","year":"2017","unstructured":"Champagne, B. J. et al. The American Society of Colon and Rectal Surgeons Assessment Tool for Performance of Laparoscopic Colectomy. Dis. Colon Rectum 60, 738\u2013744 (2017).","journal-title":"Dis. Colon Rectum"},{"key":"566_CR3","doi-asserted-by":"publisher","first-page":"1229","DOI":"10.1177\/0363546513483535","volume":"41","author":"RJ Koehler","year":"2013","unstructured":"Koehler, R. J. et al. The Arthroscopic Surgical Skill Evaluation Tool (ASSET). Am. J. Sports Med 41, 1229\u20131237 (2013).","journal-title":"Am. J. Sports Med"},{"key":"566_CR4","doi-asserted-by":"publisher","first-page":"2287","DOI":"10.2106\/JBJS.H.01762","volume":"91","author":"A Insel","year":"2009","unstructured":"Insel, A., Carofino, B., Leger, R., Arciero, R. & Mazzocca, A. D. The development of an objective model to assess arthroscopic performance. J. Bone Jt. Surg. Am. 91, 2287\u20132295 (2009).","journal-title":"J. Bone Jt. Surg. Am."},{"key":"566_CR5","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1016\/j.amjsurg.2005.04.004","volume":"190","author":"MC Vassiliou","year":"2005","unstructured":"Vassiliou, M. C. et al. A global assessment tool for evaluation of intraoperative laparoscopic skills. Am. J. Surg. 190, 107\u2013113 (2005).","journal-title":"Am. J. Surg."},{"key":"566_CR6","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1016\/j.juro.2011.09.032","volume":"187","author":"AC Goh","year":"2012","unstructured":"Goh, A. C., Goldfarb, D. W., Sander, J. C., Miles, B. J. & Dunkin, B. J. Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. J. Urol. 187, 247\u2013252 (2012).","journal-title":"J. Urol."},{"key":"566_CR7","doi-asserted-by":"publisher","first-page":"1193","DOI":"10.1097\/AOG.0000000000000288","volume":"123","author":"NY Siddiqui","year":"2014","unstructured":"Siddiqui, N. Y. et al. Validity and reliability of the robotic Objective Structured Assessment of Technical Skills. Obstet. Gynecol. 123, 1193\u20131199 (2014).","journal-title":"Obstet. Gynecol."},{"key":"566_CR8","doi-asserted-by":"publisher","first-page":"1920","DOI":"10.1161\/CIRCULATIONAHA.115.001593","volume":"132","author":"RC Deo","year":"2015","unstructured":"Deo, R. C. Machine Learning in Medicine. Circulation 132, 1920\u20131930 (2015).","journal-title":"Circulation"},{"key":"566_CR9","doi-asserted-by":"publisher","first-page":"684","DOI":"10.1097\/SLA.0000000000004425","volume":"273","author":"CR Garrow","year":"2021","unstructured":"Garrow, C. R. et al. Machine Learning for Surgical Phase Recognition: A Systematic Review. Ann. Surg. 273, 684\u2013693 (2021).","journal-title":"Ann. Surg."},{"key":"566_CR10","doi-asserted-by":"publisher","first-page":"337ra364","DOI":"10.1126\/scitranslmed.aad9398","volume":"8","author":"A Shademan","year":"2016","unstructured":"Shademan, A. et al. Supervised autonomous robotic soft tissue surgery. Sci. Transl. Med 8, 337ra364 (2016).","journal-title":"Sci. Transl. Med"},{"key":"566_CR11","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1097\/ALN.0000000000002186","volume":"129","author":"CK Lee","year":"2018","unstructured":"Lee, C. K., Hofer, I., Gabel, E., Baldi, P. & Cannesson, M. Development and Validation of a Deep Neural Network Model for Prediction of Postoperative In-hospital Mortality. Anesthesiology 129, 649\u2013662 (2018).","journal-title":"Anesthesiology"},{"key":"566_CR12","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1038\/s41551-017-0132-7","volume":"1","author":"L Maier-Hein","year":"2017","unstructured":"Maier-Hein, L. et al. Surgical data science for next-generation interventions. Nat. Biomed. Eng. 1, 691\u2013696 (2017).","journal-title":"Nat. Biomed. Eng."},{"key":"566_CR13","unstructured":"Maier-Hein, L. et al. Surgical Data Science - from Concepts to Clinical Translation. arXiv:2011.02284 (2020). https:\/\/ui.adsabs.harvard.edu\/abs\/2020arXiv201102284M."},{"key":"566_CR14","doi-asserted-by":"publisher","first-page":"81808","DOI":"10.3390\/s17081808","volume":"17","author":"B Poursartip","year":"2017","unstructured":"Poursartip, B. et al. Energy-Based Metrics for Arthroscopic Skills Assessment. Sensors 17, 81808 (2017).","journal-title":"Sensors"},{"key":"566_CR15","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1007\/s00138-014-0646-x","volume":"26","author":"JH Zhu","year":"2015","unstructured":"Zhu, J. H., Luo, J. B., Soh, J. M. & Khalifa, Y. M. A computer vision-based approach to grade simulated cataract surgeries. Mach. Vis. Appl. 26, 115\u2013125 (2015).","journal-title":"Mach. Vis. Appl."},{"key":"566_CR16","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1093\/ons\/opz359","volume":"19","author":"N Mirchi","year":"2020","unstructured":"Mirchi, N. et al. Artificial Neural Networks to Assess Virtual Reality Anterior Cervical Discectomy Performance. Operative Neurosurg. 19, 65\u201375 (2020).","journal-title":"Operative Neurosurg."},{"key":"566_CR17","doi-asserted-by":"publisher","first-page":"01197","DOI":"10.2106\/JBJS.18.01197","volume":"101","author":"V Bissonnette","year":"2019","unstructured":"Bissonnette, V. et al. Artificial Intelligence Distinguishes Surgical Training Levels in a Virtual Reality Spinal Task. J. Bone Joint. Surg. Am. 101, 01197 (2019).","journal-title":"J. Bone Joint. Surg. Am."},{"key":"566_CR18","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1089\/end.2018.0035","volume":"32","author":"AJ Hung","year":"2018","unstructured":"Hung, A. J. et al. Utilizing Machine Learning and Automated Performance Metrics to Evaluate Robot-Assisted Radical Prostatectomy Performance and Predict Outcomes. J. Endourol. 32, 438\u2013444 (2018).","journal-title":"J. Endourol."},{"key":"566_CR19","doi-asserted-by":"publisher","unstructured":"Chen, A. B., Liang, S., Nguyen, J. H., Liu, Y. & Hung, A. J. Machine learning analyses of automated performance metrics during granular sub-stitch phases predict surgeon experience. Surgery (United States), https:\/\/doi.org\/10.1016\/j.surg.2020.09.020 (2020).","DOI":"10.1016\/j.surg.2020.09.020"},{"key":"566_CR20","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1007\/s11548-018-1881-9","volume":"14","author":"A Baghdadi","year":"2019","unstructured":"Baghdadi, A., Hussein, A. A., Ahmed, Y., Cavuoto, L. A. & Guru, K. A. A computer vision technique for automated assessment of surgical performance using surgeons\u2019 console-feed videos. Int. J. computer Assist. Radiol. Surg. 14, 697\u2013707 (2019).","journal-title":"Int. J. computer Assist. Radiol. Surg."},{"key":"566_CR21","doi-asserted-by":"publisher","unstructured":"Jin, A. et al. Tool Detection and Operative Skill Assessment in Surgical Videos Using Region-Based Convolutional Neural Networks. 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), 691\u2013699, https:\/\/doi.org\/10.1109\/WACV.2018.00081 (2018).","DOI":"10.1109\/WACV.2018.00081"},{"key":"566_CR22","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1097\/SLA.0000000000002478","volume":"269","author":"DP Azari","year":"2019","unstructured":"Azari, D. P. et al. Modeling Surgical Technical Skill Using Expert Assessment for Automated Computer Rating. Ann. Surg. 269, 574\u2013581 (2019).","journal-title":"Ann. Surg."},{"key":"566_CR23","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1007\/s11548-015-1194-1","volume":"10","author":"N Ahmidi","year":"2015","unstructured":"Ahmidi, N. et al. Automated objective surgical skill assessment in the operating room from unstructured tool motion in septoplasty. Int. J. computer Assist. Radiol. Surg. 10, 981\u2013991 (2015).","journal-title":"Int. J. computer Assist. Radiol. Surg."},{"key":"566_CR24","first-page":"061964","volume":"9","author":"D Lee","year":"2020","unstructured":"Lee, D. et al. Evaluation of Surgical Skills during Robotic Surgery by Deep Learning-Based Multiple Surgical Instrument Tracking in Training and Actual Operations. J. Clin. Med 9, 061964 (2020).","journal-title":"J. Clin. Med"},{"key":"566_CR25","doi-asserted-by":"publisher","first-page":"1097","DOI":"10.1007\/s11548-019-01956-8","volume":"14","author":"TS Kim","year":"2019","unstructured":"Kim, T. S. et al. Objective assessment of intraoperative technical skill in capsulorhexis using videos of cataract surgery. Int. J. computer Assist. Radiol. Surg. 14, 1097\u20131105 (2019).","journal-title":"Int. J. computer Assist. Radiol. Surg."},{"key":"566_CR26","doi-asserted-by":"publisher","first-page":"2025","DOI":"10.1109\/TBME.2016.2647680","volume":"64","author":"N Ahmidi","year":"2017","unstructured":"Ahmidi, N. et al. A Dataset and Benchmarks for Segmentation and Recognition of Gestures in Robotic Surgery. IEEE Trans. Biomed. Eng. 64, 2025\u20132041 (2017).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"566_CR27","first-page":"S254","volume":"11","author":"T Yamaguchi","year":"2016","unstructured":"Yamaguchi, T., Suzuki, K., Sugino, T. & Nakamura, R. Development of a visualization and quantitative assessment system of laparoscopic surgery skill based on trajectory analysis from USB camera image. Int. J. computer Assist. Radiol. Surg. 11, S254\u2013S256 (2016).","journal-title":"Int. J. computer Assist. Radiol. Surg."},{"key":"566_CR28","doi-asserted-by":"publisher","unstructured":"Brown, K. C., Bhattacharyya, K. D., Kulason, S., Zia, A. & Jarc, A. How to Bring Surgery to the Next Level: Interpretable Skills Assessment in Robotic-Assisted Surgery. Visceral Med., https:\/\/doi.org\/10.1159\/000512437 (2020).","DOI":"10.1159\/000512437"},{"key":"566_CR29","unstructured":"Twinanda, A. P., Mutter, D., Marescaux, J., de Mathelin, M. & Padoy, N. Single- and Multi-Task Architectures for Tool Presence Detection Challenge at M2CAI 2016. arXiv:1610.08851 (2016). https:\/\/ui.adsabs.harvard.edu\/abs\/2016arXiv161008851T."},{"key":"566_CR30","unstructured":"Allan, M. et al. 2017 Robotic Instrument Segmentation Challenge. arXiv:1902.06426 (2019). https:\/\/ui.adsabs.harvard.edu\/abs\/2019arXiv190206426A."},{"key":"566_CR31","doi-asserted-by":"publisher","first-page":"e26552","DOI":"10.2196\/26552","volume":"10","author":"K Lam","year":"2021","unstructured":"Lam, K., Iqbal, F. M., Purkayastha, S. & Kinross, J. M. Investigating the Ethical and Data Governance Issues of Artificial Intelligence in Surgery: Protocol for a Delphi Study. JMIR Res Protoc. 10, e26552 (2021).","journal-title":"JMIR Res Protoc."},{"key":"566_CR32","doi-asserted-by":"publisher","first-page":"1611","DOI":"10.1007\/s11548-019-02039-4","volume":"14","author":"H Ismail Fawaz","year":"2019","unstructured":"Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L. & Muller, P.-A. Accurate and interpretable evaluation of surgical skills from kinematic data using fully convolutional neural networks. Int. J. Computer Assist. Radiol. Surg. 14, 1611\u20131617 (2019).","journal-title":"Int. J. Computer Assist. Radiol. Surg."},{"key":"566_CR33","doi-asserted-by":"publisher","first-page":"4148","DOI":"10.1109\/LRA.2020.2989075","volume":"5","author":"DD Zhang","year":"2020","unstructured":"Zhang, D. D. et al. Automatic Microsurgical Skill Assessment Based on Cross-Domain Transfer Learning. IEEE Robot. Autom. Lett. 5, 4148\u20134155 (2020).","journal-title":"IEEE Robot. Autom. Lett."},{"key":"566_CR34","unstructured":"Goodfellow, I. J. et al. Generative Adversarial Networks. arXiv:1406.2661 (2014). https:\/\/ui.adsabs.harvard.edu\/abs\/2014arXiv1406.2661G."},{"key":"566_CR35","unstructured":"Vaswani, A. et al. Attention Is All You Need. arXiv:1706.03762 (2017). https:\/\/ui.adsabs.harvard.edu\/abs\/2017arXiv170603762V."},{"key":"566_CR36","doi-asserted-by":"publisher","first-page":"336","DOI":"10.1016\/j.ijsu.2010.02.007","volume":"8","author":"D Moher","year":"2010","unstructured":"Moher, D., Liberati, A., Tetzlaff, J. & Altman, D. G. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Int J. Surg. 8, 336\u2013341 (2010).","journal-title":"Int J. Surg."},{"key":"566_CR37","doi-asserted-by":"publisher","first-page":"1002","DOI":"10.1001\/jama.298.9.1002","volume":"298","author":"DA Reed","year":"2007","unstructured":"Reed, D. A. et al. Association Between Funding and Quality of Published Medical Education Research. JAMA 298, 1002\u20131009 (2007).","journal-title":"JAMA"},{"key":"566_CR38","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1109\/10.918597","volume":"48","author":"J Rosen","year":"2001","unstructured":"Rosen, J., Hannaford, B., Richards, C. G. & Sinanan, M. N. Markov modeling of minimally invasive surgery based on tool\/tissue interaction and force\/torque signatures for evaluating surgical skills. IEEE Trans. Biomed. Eng. 48, 579\u2013591 (2001).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"566_CR39","doi-asserted-by":"publisher","first-page":"1911","DOI":"10.1109\/TBME.2006.881784","volume":"53","author":"G Megali","year":"2006","unstructured":"Megali, G., Sinigaglia, S., Tonet, O. & Dario, P. Modelling and evaluation of surgical performance using hidden Markov models. IEEE Trans. Biomed. Eng. 53, 1911\u20131919 (2006).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"566_CR40","first-page":"417","volume":"81","author":"J Rosen","year":"2001","unstructured":"Rosen, J., Solazzo, M., Hannaford, B. & Sinanan, M. Objective laparoscopic skills assessments of surgical residents using Hidden Markov Models based on haptic information and tool\/tissue interactions. Stud. health Technol. Inform. 81, 417\u2013423 (2001).","journal-title":"Stud. health Technol. Inform."},{"key":"566_CR41","doi-asserted-by":"publisher","first-page":"1565","DOI":"10.1038\/nbt1206-1565","volume":"24","author":"WS Noble","year":"2006","unstructured":"Noble, W. S. What is a support vector machine? Nat. Biotechnol. 24, 1565\u20131567 (2006).","journal-title":"Nat. Biotechnol."},{"key":"566_CR42","doi-asserted-by":"crossref","unstructured":"Suthaharan, S. In Machine Learning Models and Algorithms for Big Data Classification: Thinking with Examples for Effective Learning 207-235 (Springer US, 2016).","DOI":"10.1007\/978-1-4899-7641-3_9"},{"key":"566_CR43","doi-asserted-by":"publisher","first-page":"985","DOI":"10.1109\/TNN.1999.788639","volume":"10","author":"V Cherkassky","year":"1999","unstructured":"Cherkassky, V. & Mulier, F. Vapnik-Chervonenkis (VC) learning theory and its applications. IEEE Trans. Neural Netw. 10, 985\u2013987 (1999).","journal-title":"IEEE Trans. Neural Netw."},{"key":"566_CR44","doi-asserted-by":"publisher","first-page":"807","DOI":"10.1016\/j.compbiomed.2013.04.002","volume":"43","author":"S Li","year":"2013","unstructured":"Li, S., Zhou, W., Yuan, Q., Geng, S. & Cai, D. Feature extraction and recognition of ictal EEG using EMD and SVM. Computers Biol. Med. 43, 807\u2013816 (2013).","journal-title":"Computers Biol. Med."},{"key":"566_CR45","unstructured":"Lin, W.-H. & Hauptmann, A. in Proceedings of the tenth ACM international conference on Multimedia 323\u2013326 (Association for Computing Machinery, Juan-les-Pins, France, 2002)."},{"key":"566_CR46","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1016\/j.jbiomech.2004.05.002","volume":"38","author":"R Begg","year":"2005","unstructured":"Begg, R. & Kamruzzaman, J. A machine learning approach for automated recognition of movement patterns using basic, kinetic and kinematic gait data. J. Biomech. 38, 401\u2013408 (2005).","journal-title":"J. Biomech."},{"key":"566_CR47","doi-asserted-by":"publisher","first-page":"e00938","DOI":"10.1016\/j.heliyon.2018.e00938","volume":"4","author":"OI Abiodun","year":"2018","unstructured":"Abiodun, O. I. et al. State-of-the-art in artificial neural network applications: A survey. Heliyon 4, e00938 (2018).","journal-title":"Heliyon"},{"key":"566_CR48","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.neucom.2016.12.038","volume":"234","author":"W Liu","year":"2017","unstructured":"Liu, W. et al. A survey of deep neural network architectures and their applications. Neurocomputing 234, 11\u201326 (2017).","journal-title":"Neurocomputing"},{"key":"566_CR49","doi-asserted-by":"publisher","first-page":"1202","DOI":"10.1109\/TIP.2017.2774045","volume":"27","author":"K Ma","year":"2018","unstructured":"Ma, K. et al. End-to-End Blind Image Quality Assessment Using Deep Neural Networks. IEEE Trans. Image Process. 27, 1202\u20131213 (2018).","journal-title":"IEEE Trans. Image Process."},{"key":"566_CR50","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1109\/MSP.2017.2765202","volume":"35","author":"A Creswell","year":"2018","unstructured":"Creswell, A. et al. Generative Adversarial Networks: An Overview. IEEE Signal Process. Mag. 35, 53 (2018).","journal-title":"IEEE Signal Process. Mag."},{"key":"566_CR51","unstructured":"Krizhevsky, A., Sutskever, I., Hinton, G. E. ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems 25 (2012)."},{"key":"566_CR52","unstructured":"Mikolov, T., Karafi\u00e1t, M., Burget, L., Cernock\u00fd, J. & Khudanpur, S. In INTERSPEECH. (eds. Takao Kobayashi, Keikichi Hirose, & Satoshi Nakamura) 1045\u20131048 (ISCA)."},{"key":"566_CR53","doi-asserted-by":"publisher","first-page":"2451","DOI":"10.1162\/089976600300015015","volume":"12","author":"FA Gers","year":"2000","unstructured":"Gers, F. A., Schmidhuber, J. & Cummins, F. Learning to Forget: Continual Prediction with LSTM. Neural Comput. 12, 2451\u20132471 (2000).","journal-title":"Neural Comput."},{"key":"566_CR54","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1016\/S0002-9610(97)89597-9","volume":"173","author":"R Reznick","year":"1997","unstructured":"Reznick, R., Regehr, G., MacRae, H., Martin, J. & McCulloch, W. Testing technical skill via an innovative \u201cbench station\u201d examination. Am. J. Surg. 173, 226\u2013230 (1997).","journal-title":"Am. J. Surg."},{"key":"566_CR55","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1016\/j.amjsurg.2007.02.003","volume":"193","author":"JD Doyle","year":"2007","unstructured":"Doyle, J. D., Webber, E. M. & Sidhu, R. S. A universal global rating scale for the evaluation of technical skills in the operating room. Am. J. Surg. 193, 551\u2013555 (2007). discussion 555.","journal-title":"Am. J. Surg."},{"key":"566_CR56","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1302\/0301-620X.90B4.20414","volume":"90","author":"NR Howells","year":"2008","unstructured":"Howells, N. R., Gill, H. S., Carr, A. J., Price, A. J. & Rees, J. L. Transferring simulated arthroscopic skills to the operating theatre: a randomised blinded study. J. Bone Jt. Surg. Br. 90, 494\u2013499 (2008).","journal-title":"J. Bone Jt. Surg. Br."},{"key":"566_CR57","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1055\/s-0034-1368161","volume":"28","author":"JC Selber","year":"2014","unstructured":"Selber, J. C. & Alrasheed, T. Robotic microsurgical training and evaluation. Semin Plast. Surg. 28, 5\u201310 (2014).","journal-title":"Semin Plast. Surg."},{"key":"566_CR58","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1109\/TITB.2009.2029614","volume":"13","author":"RC King","year":"2009","unstructured":"King, R. C., Atallah, L., Lo, B. P. L. & Yang, G. Z. Development of a Wireless Sensor Glove for Surgical Skills Assessment. IEEE Trans. Inf. Technol. Biomedicine 13, 673\u2013679 (2009).","journal-title":"IEEE Trans. Inf. Technol. Biomedicine"},{"key":"566_CR59","doi-asserted-by":"publisher","first-page":"657","DOI":"10.1007\/s00464-013-3226-7","volume":"28","author":"I Oropesa","year":"2014","unstructured":"Oropesa, I. et al. Supervised classification of psychomotor competence in minimally invasive surgery based on instruments motion analysis. Surgical Endosc. Other Interventional Tech. 28, 657\u2013670 (2014).","journal-title":"Surgical Endosc. Other Interventional Tech."},{"key":"566_CR60","doi-asserted-by":"publisher","unstructured":"Weede, O., M\u00f6hrle, F., W\u00f6rn, H., Falkinger, M. & Feussner, H. Movement Analysis for Surgical Skill Assessment and Measurement of Ergonomic Conditions. 2014 2nd International Conference on Artificial Intelligence, Modelling and Simulation, 97\u2013102, https:\/\/doi.org\/10.1109\/AIMS.2014.69 (2014).","DOI":"10.1109\/AIMS.2014.69"},{"key":"566_CR61","doi-asserted-by":"publisher","first-page":"1161","DOI":"10.1007\/s11548-017-1606-5","volume":"12","author":"A French","year":"2017","unstructured":"French, A., Lendvay, T. S., Sweet, R. M. & Kowalewski, T. M. Predicting surgical skill from the first N seconds of a task: value over task time using the isogony principle. Int. J. computer Assist. Radiol. Surg. 12, 1161\u20131170 (2017).","journal-title":"Int. J. computer Assist. Radiol. Surg."},{"key":"566_CR62","doi-asserted-by":"publisher","first-page":"1151","DOI":"10.1007\/s11548-017-1610-9","volume":"12","author":"RL Dockter","year":"2017","unstructured":"Dockter, R. L., Lendvay, T. S., Sweet, R. M. & Kowalewski, T. M. The minimally acceptable classification criterion for surgical skill: intent vectors and separability of raw motion data. Int. J. computer Assist. Radiol. Surg. 12, 1151\u20131159 (2017).","journal-title":"Int. J. computer Assist. Radiol. Surg."},{"key":"566_CR63","doi-asserted-by":"crossref","unstructured":"Uemura, M. et al. Feasibility of an AI-Based Measure of the Hand Motions of Expert and Novice Surgeons. Comput. Math. Methods Med. 2018, 9873273 (2018).","DOI":"10.1155\/2018\/9873273"},{"key":"566_CR64","doi-asserted-by":"publisher","first-page":"1840","DOI":"10.1007\/s00464-017-5873-6","volume":"32","author":"YA Oquendo","year":"2018","unstructured":"Oquendo, Y. A., Riddle, E. W., Hiller, D., Blinman, T. A. & Kuchenbecker, K. J. Automatically rating trainee skill at a pediatric laparoscopic suturing task. Surgical Endosc. Other Interventional Tech. 32, 1840\u20131857 (2018).","journal-title":"Surgical Endosc. Other Interventional Tech."},{"key":"566_CR65","doi-asserted-by":"publisher","first-page":"3732","DOI":"10.1007\/s00464-019-06667-4","volume":"33","author":"KF Kowalewski","year":"2019","unstructured":"Kowalewski, K. F. et al. Sensor-based machine learning for workflow detection and as key to detect expert level in laparoscopic suturing and knot-tying. Surgical Endosc. Other Interventional Tech. 33, 3732\u20133740 (2019).","journal-title":"Surgical Endosc. Other Interventional Tech."},{"key":"566_CR66","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1002\/alr.21053","volume":"2","author":"N Ahmidi","year":"2012","unstructured":"Ahmidi, N., Ishii, M., Fichtinger, G., Gallia, G. L. & Hager, G. D. An objective and automated method for assessing surgical skill in endoscopic sinus surgery using eye-tracking and tool-motion data. Int. Forum Allergy Rhinol. 2, 507\u2013515 (2012).","journal-title":"Int. Forum Allergy Rhinol."},{"key":"566_CR67","doi-asserted-by":"publisher","first-page":"1163","DOI":"10.1097\/ACM.0000000000000316","volume":"89","author":"RA Watson","year":"2014","unstructured":"Watson, R. A. Use of a Machine Learning Algorithm to Classify Expertise: Analysis of Hand Motion Patterns During a Simulated Surgical Task. Academic Med. 89, 1163\u20131167 (2014).","journal-title":"Academic Med."},{"key":"566_CR68","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1007\/s10916-016-0665-4","volume":"41","author":"XY Sun","year":"2017","unstructured":"Sun, X. Y., Byrns, S., Cheng, I., Zheng, B. & Basu, A. Smart Sensor-Based Motion Detection System for Hand Movement Training in Open Surgery. J. Med. Sys. 41, 4 (2017).","journal-title":"J. Med. Sys."},{"key":"566_CR69","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.cmpb.2019.05.008","volume":"177","author":"XA Nguyen","year":"2019","unstructured":"Nguyen, X. A., Ljuhar, D., Pacilli, M., Nataraja, R. M. & Chauhan, S. Surgical skill levels: Classification and analysis using deep neural network model and motion signals. Computer methods Prog. biomedicine 177, 1\u20138 (2019).","journal-title":"Computer methods Prog. biomedicine"},{"key":"566_CR70","first-page":"426","volume":"12","author":"B Varadarajan","year":"2009","unstructured":"Varadarajan, B., Reiley, C., Lin, H., Khudanpur, S. & Hager, G. Data-derived models for segmentation with application to surgical assessment and training. Med. Image Comput. Computer-Assist. 12, 426\u2013434 (2009).","journal-title":"Med. Image Comput. Computer-Assist."},{"key":"566_CR71","first-page":"435","volume":"12","author":"CE Reiley","year":"2009","unstructured":"Reiley, C. E. & Hager, G. D. Task versus subtask surgical skill evaluation of robotic minimally invasive surgery. Med. Image Comput. Computer-Assist. Intervention: MICCAI\u2026 Int. Conf. Med. Image Comput. Computer-Assist. Intervention 12, 435\u2013442 (2009).","journal-title":"Med. Image Comput. Computer-Assist. Intervention: MICCAI\u2026 Int. Conf. Med. Image Comput. Computer-Assist. Intervention"},{"key":"566_CR72","doi-asserted-by":"crossref","unstructured":"Tao, L., Elhamifar, E., Khudanpur, S., Hager, G. D. & Vidal, R. Sparse Hidden Markov Models for Surgical Gesture Classification and Skill Evaluation. Information Processing in Computer-Assisted Interventions, 167\u2013177 (2012).","DOI":"10.1007\/978-3-642-30618-1_17"},{"key":"566_CR73","doi-asserted-by":"publisher","first-page":"528","DOI":"10.1016\/j.jtcvs.2011.11.002","volume":"143","author":"R Kumar","year":"2012","unstructured":"Kumar, R. et al. Objective measures for longitudinal assessment of robotic surgery training. J. Thorac. cardiovascular Surg. 143, 528\u2013534 (2012).","journal-title":"J. Thorac. cardiovascular Surg."},{"key":"566_CR74","first-page":"26","volume":"16","author":"N Ahmidi","year":"2013","unstructured":"Ahmidi, N. et al. String motif-based description of tool motion for detecting skill and gestures in robotic surgery. Med. Image Comput. Computer-Assist. Intervention: MICCAI\u2026 Int. Conf. Med. Image Comput. Computer-Assist. Intervention 16, 26\u201333 (2013).","journal-title":"Med. Image Comput. Computer-Assist. Intervention: MICCAI\u2026 Int. Conf. Med. Image Comput. Computer-Assist. Intervention"},{"key":"566_CR75","doi-asserted-by":"crossref","unstructured":"Forestier, G., Petitjean, F., Senin, P., Despinoy, F. & Jannin, P. Discovering Discriminative and Interpretable Patterns for Surgical Motion Analysis. Artif. Intell. Med. 136\u2013145 (2017).","DOI":"10.1007\/978-3-319-59758-4_15"},{"key":"566_CR76","doi-asserted-by":"publisher","first-page":"2263","DOI":"10.1109\/TBME.2016.2634861","volume":"64","author":"JD Brown","year":"2017","unstructured":"Brown, J. D. et al. Using Contact Forces and Robot Arm Accelerations to Automatically Rate Surgeon Skill at Peg Transfer. IEEE Trans. Biomed. Eng. 64, 2263\u20132275 (2017).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"566_CR77","doi-asserted-by":"publisher","first-page":"731","DOI":"10.1007\/s11548-018-1735-5","volume":"13","author":"A Zia","year":"2018","unstructured":"Zia, A. & Essa, I. Automated surgical skill assessment in RMIS training. Int. J. computer Assist. Radiol. Surg. 13, 731\u2013739 (2018).","journal-title":"Int. J. computer Assist. Radiol. Surg."},{"key":"566_CR78","doi-asserted-by":"publisher","first-page":"1959","DOI":"10.1007\/s11548-018-1860-1","volume":"13","author":"ZH Wang","year":"2018","unstructured":"Wang, Z. H. & Fey, A. M. Deep learning with convolutional neural network for objective skill evaluation in robot-assisted surgery. Int. J. computer Assist. Radiol. Surg. 13, 1959\u20131970 (2018).","journal-title":"Int. J. computer Assist. Radiol. Surg."},{"key":"566_CR79","first-page":"1793","volume":"2018","author":"Z Wang","year":"2018","unstructured":"Wang, Z. & Fey, A. M. SATR-DL: Improving Surgical Skill Assessment And Task Recognition In Robot-Assisted Surgery With Deep Neural Networks. Conf. Proc.:\u2026 Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. IEEE Eng. Med. Biol. Soc. Annu. Conf. 2018, 1793\u20131796 (2018).","journal-title":"Conf. Proc.:\u2026 Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. IEEE Eng. Med. Biol. Soc. Annu. Conf."},{"key":"566_CR80","doi-asserted-by":"publisher","first-page":"1850","DOI":"10.1002\/rcs.1850","volume":"14","author":"MJ Fard","year":"2018","unstructured":"Fard, M. J. et al. Automated robot-assisted surgical skill evaluation: Predictive analytics approach. Int. J. Med. Robot. Comput. Assist. Surg. 14, 1850 (2018).","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"566_CR81","doi-asserted-by":"publisher","first-page":"635","DOI":"10.1007\/s11548-019-01920-6","volume":"14","author":"M Ershad","year":"2019","unstructured":"Ershad, M., Rege, R. & Majewicz Fey, A. Automatic and near real-time stylistic behavior assessment in robotic surgery. Int. J. computer Assist. Radiol. Surg. 14, 635\u2013643 (2019).","journal-title":"Int. J. computer Assist. Radiol. Surg."},{"key":"566_CR82","doi-asserted-by":"publisher","first-page":"105234","DOI":"10.1016\/j.cmpb.2019.105234","volume":"187","author":"NX Anh","year":"2020","unstructured":"Anh, N. X., Nataraja, R. M. & Chauhan, S. Towards near real-time assessment of surgical skills: A comparison of feature extraction techniques. Comput. Methods Programs Biomed 187, 105234 (2020).","journal-title":"Comput. Methods Programs Biomed"},{"key":"566_CR83","doi-asserted-by":"publisher","first-page":"e201664","DOI":"10.1001\/jamanetworkopen.2020.1664","volume":"3","author":"S Khalid","year":"2020","unstructured":"Khalid, S., Goldenberg, M., Grantcharov, T., Taati, B. & Rudzicz, F. Evaluation of Deep Learning Models for Identifying Surgical Actions and Measuring Performance. JAMA Netw. Open 3, e201664 (2020).","journal-title":"JAMA Netw. Open"},{"key":"566_CR84","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.cmpb.2017.09.007","volume":"152","author":"J Jiang","year":"2017","unstructured":"Jiang, J., Xing, Y., Wang, S. & Liang, K. Evaluation of robotic surgery skills using dynamic time warping. Computer methods Prog. biomedicine 152, 71\u201383 (2017).","journal-title":"Computer methods Prog. biomedicine"},{"key":"566_CR85","first-page":"471","volume":"15","author":"N Ahmidi","year":"2012","unstructured":"Ahmidi, N., Hager, G. D., Ishii, L., Gallia, G. L. & Ishii, M. Robotic path planning for surgeon skill evaluation in minimally-invasive sinus surgery. Med. Image Comput. Computer-Assist. Intervention: MICCAI\u2026 Int. Conf. Med. Image Comput. Computer-Assist. Intervention 15, 471\u2013478 (2012).","journal-title":"Med. Image Comput. Computer-Assist. Intervention: MICCAI\u2026 Int. Conf. Med. Image Comput. Computer-Assist. Intervention"},{"key":"566_CR86","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1177\/1553350619853112","volume":"26","author":"D Topalli","year":"2019","unstructured":"Topalli, D. & Cagiltay, N. E. Classification of Intermediate and Novice Surgeons\u2019 Skill Assessment Through Performance Metrics. Surgical Innov. 26, 621\u2013629 (2019).","journal-title":"Surgical Innov."},{"key":"566_CR87","doi-asserted-by":"publisher","first-page":"8363","DOI":"10.1001\/jamanetworkopen.2019.8363","volume":"2","author":"A Winkler-Schwartz","year":"2019","unstructured":"Winkler-Schwartz, A. et al. Machine Learning Identification of Surgical and Operative Factors Associated With Surgical Expertise in Virtual Reality Simulation. JAMA network open 2, 8363 (2019).","journal-title":"JAMA network open"},{"key":"566_CR88","doi-asserted-by":"publisher","first-page":"e1964","DOI":"10.1002\/rcs.1964","volume":"15","author":"W Peng","year":"2019","unstructured":"Peng, W., Xing, Y., Liu, R., Li, J. & Zhang, Z. An automatic skill evaluation framework for robotic surgery training. Int. J. Med. Robot. Computer Assist. Surg. 15, e1964 (2019).","journal-title":"Int. J. Med. Robot. Computer Assist. Surg."},{"key":"566_CR89","doi-asserted-by":"publisher","first-page":"1357","DOI":"10.1007\/s11517-020-02155-3","volume":"58","author":"S Siyar","year":"2020","unstructured":"Siyar, S. et al. Machine learning distinguishes neurosurgical skill levels in a virtual reality tumor resection task. Med. Biol. Eng. Comput. 58, 1357\u20131367 (2020).","journal-title":"Med. Biol. Eng. Comput."},{"key":"566_CR90","doi-asserted-by":"publisher","unstructured":"Islam, G. & Kahol, K. Application of computer vision algorithm in surgical skill assessment. 7th International Conference on Broadband Communications and Biomedical Applications, 108\u2013111, https:\/\/doi.org\/10.1109\/IB2Com.2011.6217902 (2011).","DOI":"10.1109\/IB2Com.2011.6217902"},{"key":"566_CR91","doi-asserted-by":"publisher","unstructured":"Islam, G., Baoxin, L. & Kahol, K. Developing a real-time low-cost system for surgical skill training and assessment. 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), 1\u20134, https:\/\/doi.org\/10.1109\/ICMEW.2013.6618269 (2013).","DOI":"10.1109\/ICMEW.2013.6618269"},{"key":"566_CR92","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1016\/j.jbi.2015.11.002","volume":"59","author":"G Islam","year":"2016","unstructured":"Islam, G., Kahol, K., Li, B. X., Smith, M. & Patel, V. L. Affordable, web-based surgical skill training and evaluation tool. J. Biomed. Inform. 59, 102\u2013114 (2016).","journal-title":"J. Biomed. Inform."},{"key":"566_CR93","doi-asserted-by":"publisher","first-page":"1853","DOI":"10.1002\/rcs.1853","volume":"14","author":"NP Sgouros","year":"2018","unstructured":"Sgouros, N. P., Loukas, C., Koufi, V., Troupis, T. G. & Georgiou, E. An automated skills assessment framework for laparoscopic training tasks. Int. J. Med. Robot. 14, 1853 (2018).","journal-title":"Int. J. Med. Robot."},{"key":"566_CR94","doi-asserted-by":"publisher","first-page":"00057","DOI":"10.4293\/JSLS.2020.00057","volume":"24","author":"C Loukas","year":"2020","unstructured":"Loukas, C., Gazis, A. & Kanakis, M. A. Surgical Performance Analysis and Classification Based on Video Annotation of Laparoscopic Tasks. JSLS 24, 00057 (2020).","journal-title":"JSLS"},{"key":"566_CR95","unstructured":"Sharma, Y. et al. Video Based Assessment of OSATS Using Sequential Motion Textures. Proceedings of the 5th Workshop on Modeling and Monitoring of Computer Assisted Interventions. (2014)."},{"key":"566_CR96","first-page":"430","volume":"2015","author":"A Zia","year":"2015","unstructured":"Zia, A. et al. Automated Assessment of Surgical Skills Using Frequency. Anal. Med. Image Comput. Computer-Assist. Intervention - MICCAI 2015, 430\u2013438 (2015).","journal-title":"Anal. Med. Image Comput. Computer-Assist. Intervention - MICCAI"},{"key":"566_CR97","doi-asserted-by":"publisher","first-page":"1623","DOI":"10.1007\/s11548-016-1468-2","volume":"11","author":"A Zia","year":"2016","unstructured":"Zia, A. et al. Automated video-based assessment of surgical skills for training and evaluation in medical schools. Int J. Comput Assist Radio. Surg. 11, 1623\u20131636 (2016).","journal-title":"Int J. Comput Assist Radio. Surg."},{"key":"566_CR98","doi-asserted-by":"publisher","first-page":"e4","DOI":"10.1016\/j.juro.2018.02.113","volume":"199","author":"B Miller","year":"2018","unstructured":"Miller, B., Azari, D., Radwin, R. & Le, B. Use of computer vision motion analysis to aid in surgical skill assessment of suturing tasks. J. Urol. 199, e4 (2018).","journal-title":"J. Urol."},{"key":"566_CR99","doi-asserted-by":"publisher","first-page":"1217","DOI":"10.1007\/s11548-019-01995-1","volume":"14","author":"I Funke","year":"2019","unstructured":"Funke, I., Mees, S. T., Weitz, J. & Speidel, S. Video-based surgical skill assessment using 3Dconvolutional neural networks. Int. J. computer Assist. Radiol. Surg. 14, 1217\u20131225 (2019).","journal-title":"Int. J. computer Assist. Radiol. Surg."},{"key":"566_CR100","first-page":"5842","volume":"2019","author":"KR Gorantla","year":"2019","unstructured":"Gorantla, K. R. & Esfahani, E. T. Surgical Skill Assessment using Motor Control Features and Hidden Markov Model. Conf. Proc.:\u2026 Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. IEEE Eng. Med. Biol. Soc. Annu. Conf. 2019, 5842\u20135845 (2019).","journal-title":"Conf. Proc.:\u2026 Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. IEEE Eng. Med. Biol. Soc. Annu. Conf."},{"key":"566_CR101","doi-asserted-by":"crossref","first-page":"e505","DOI":"10.1097\/JU.0000000000000593","volume":"203","author":"J Gahan","year":"2020","unstructured":"Gahan, J., Steinberg, R., Garbens, A., Qu, X. & Larson, E. Machine learning using a multi-task convolutional neural networks can accurately assess robotic skills. J. Urol. 203, e505 (2020).","journal-title":"J. Urol."},{"key":"566_CR102","first-page":"752","volume":"9","author":"JJH Leong","year":"2006","unstructured":"Leong, J. J. H. et al. HMM assessment of quality of movement trajectory in laparoscopic surgery. Comput. Aided Surg. 9, 752\u2013759 (2006).","journal-title":"Comput. Aided Surg."},{"key":"566_CR103","doi-asserted-by":"publisher","first-page":"2079","DOI":"10.1007\/s11548-020-02269-x","volume":"15","author":"JD Kelly","year":"2020","unstructured":"Kelly, J. D., Petersen, A., Lendvay, T. S. & Kowalewski, T. M. Bidirectional long short-term memory for surgical skill classification of temporally segmented tasks. Int. J. Computer Assist. Radiol. Surg. 15, 2079\u20132088 (2020).","journal-title":"Int. J. Computer Assist. Radiol. Surg."},{"key":"566_CR104","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1007\/s11548-018-1704-z","volume":"13","author":"A Zia","year":"2018","unstructured":"Zia, A., Sharma, Y., Bettadapura, V., Sarin, E. L. & Essa, I. Video and accelerometer-based motion analysis for automated surgical skills assessment. Int. J. Computer Assist. Radiol. Surg. 13, 443\u2013455 (2018).","journal-title":"Int. J. Computer Assist. Radiol. Surg."},{"key":"566_CR105","unstructured":"Zhang, W. Shift-invariant pattern recognition neural network and its optical architecture. Proceedings of Annual Conference of the Japan Society of Applied Physics 125, 525\u2013532 (1988)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00566-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00566-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00566-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,25]],"date-time":"2022-11-25T08:24:37Z","timestamp":1669364677000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-022-00566-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,3]]},"references-count":105,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["566"],"URL":"https:\/\/doi.org\/10.1038\/s41746-022-00566-0","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,3]]},"assertion":[{"value":"19 July 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 March 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"24"}}