{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T11:11:28Z","timestamp":1771067488241,"version":"3.50.1"},"reference-count":63,"publisher":"SAGE Publications","issue":"8","license":[{"start":{"date-parts":[[2019,4,23]],"date-time":"2019-04-23T00:00:00Z","timestamp":1555977600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"name":"Society of Academic Urologists"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Hum Factors"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:sec><jats:title>Objective:<\/jats:title><jats:p> This study explores how common machine learning techniques can predict surgical maneuvers from a continuous video record of surgical benchtop simulations. <\/jats:p><\/jats:sec><jats:sec><jats:title>Background:<\/jats:title><jats:p> Automatic computer vision recognition of surgical maneuvers (suturing, tying, and transition) could expedite video review and objective assessment of surgeries. <\/jats:p><\/jats:sec><jats:sec><jats:title>Method:<\/jats:title><jats:p> We recorded hand movements of 37 clinicians performing simple and running subcuticular suturing benchtop simulations, and applied three machine learning techniques (decision trees, random forests, and hidden Markov models) to classify surgical maneuvers every 2 s (60 frames) of video. <\/jats:p><\/jats:sec><jats:sec><jats:title>Results:<\/jats:title><jats:p> Random forest predictions of surgical video correctly classified 74% of all video segments into suturing, tying, and transition states for a randomly selected test set. Hidden Markov model adjustments improved the random forest predictions to 79% for simple interrupted suturing on a subset of randomly selected participants. <\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion:<\/jats:title><jats:p> Random forest predictions aided by hidden Markov modeling provided the best prediction of surgical maneuvers. Training of models across all users improved prediction accuracy by 10% compared with a random selection of participants. <\/jats:p><\/jats:sec><jats:sec><jats:title>Application:<\/jats:title><jats:p> Marker-less video hand tracking can predict surgical maneuvers from a continuous video record with similar accuracy as robot-assisted surgical platforms, and may enable more efficient video review of surgical procedures for training and coaching. <\/jats:p><\/jats:sec>","DOI":"10.1177\/0018720819838901","type":"journal-article","created":{"date-parts":[[2019,4,23]],"date-time":"2019-04-23T22:39:25Z","timestamp":1556059165000},"page":"1326-1339","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":15,"title":["Using Surgeon Hand Motions to Predict Surgical Maneuvers"],"prefix":"10.1177","volume":"61","author":[{"given":"David P.","family":"Azari","sequence":"first","affiliation":[{"name":"University of Wisconsin\u2013Madison, USA"}]},{"given":"Yu Hen","family":"Hu","sequence":"additional","affiliation":[{"name":"University of Wisconsin\u2013Madison, USA"}]},{"given":"Brady L.","family":"Miller","sequence":"additional","affiliation":[{"name":"University of Wisconsin\u2013Madison, USA"}]},{"given":"Brian V.","family":"Le","sequence":"additional","affiliation":[{"name":"University of Wisconsin\u2013Madison, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7973-0641","authenticated-orcid":false,"given":"Robert G.","family":"Radwin","sequence":"additional","affiliation":[{"name":"University of Wisconsin\u2013Madison, USA"}]}],"member":"179","published-online":{"date-parts":[[2019,4,23]]},"reference":[{"key":"bibr1-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1097\/01.sla.0000262780.17950.e5"},{"key":"bibr2-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40811-3_4"},{"key":"bibr3-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-015-1194-1"},{"key":"bibr4-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2016.2647680"},{"key":"bibr5-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1080\/00140139.2014.966155"},{"key":"bibr6-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1080\/00140139.2016.1146347"},{"key":"bibr7-0018720819838901","volume-title":"Quantifying surgical skill","author":"Azari D. P.","year":"2018"},{"key":"bibr8-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0000000000002478"},{"key":"bibr9-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1177\/0018720815613919"},{"key":"bibr10-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-14231-9"},{"key":"bibr11-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-22095-1_30"},{"key":"bibr12-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-014-0165-0"},{"key":"bibr13-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2016.09.003"},{"key":"bibr14-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"bibr15-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1080\/00140139.2015.1051594"},{"key":"bibr16-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1109\/ChinaSIP.2014.6889256"},{"key":"bibr17-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1177\/0018720812458121"},{"key":"bibr18-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1561\/0600000035"},{"key":"bibr19-0018720819838901","volume-title":"Dynamics of skill acquisition: A constraints-led approach","author":"Davids K.","year":"2008"},{"key":"bibr20-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2015.2493100"},{"key":"bibr21-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46720-7_64"},{"key":"bibr22-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2009.5414322"},{"key":"bibr23-0018720819838901","doi-asserted-by":"publisher","DOI":"10.5121\/ijcga.2014.4202"},{"key":"bibr24-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2016.05.004"},{"key":"bibr25-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-017-1606-5"},{"key":"bibr26-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1145\/1083784.1083789"},{"key":"bibr27-0018720819838901","unstructured":"Gao Y., Vedula S. S., Reiley C. E., Ahmidi N., Varadarajan B., Lin H. C., Hager G. D. (2014). JHU-ISI Gesture and Skill Assessment Working Set (JIGSAWS): A surgical activity dataset for human motion modeling. In Modeling and Monitoring of Computer Assisted Interventions MCAI\u2013MICCAI Workshop (pp. 1\u201310). Retrieved from https:\/\/cirl.lcsr.jhu.edu\/wp-content\/uploads\/2015\/11\/JIGSAWS.pdf"},{"key":"bibr28-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1006\/cviu.1998.0716"},{"key":"bibr29-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2014.04.054"},{"key":"bibr30-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1001\/jamasurg.2015.4442"},{"key":"bibr31-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2017.02.020"},{"issue":"1","key":"bibr32-0018720819838901","first-page":"34","volume-title":"International Conference on Medical Image Computing and Computer-Assisted Intervention","volume":"7510","author":"Haro B. B.","year":"2012"},{"key":"bibr33-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1001\/jamasurg.2016.4619"},{"key":"bibr34-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1109\/HAPTIC.2002.998962"},{"key":"bibr35-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1117\/12.256280"},{"key":"bibr36-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2015.154"},{"key":"bibr37-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2016.7487305"},{"key":"bibr38-0018720819838901","volume-title":"Structure in surgical motion","author":"Lin H. C.","year":"2010"},{"key":"bibr39-0018720819838901","first-page":"316","volume":"125","author":"Mackel T.","year":"2007","journal-title":"Studies in Health Technology and Informatics"},{"key":"bibr40-0018720819838901","unstructured":"Maier-Hein L., Vedula S., Speidel S., Navab N., Kikinis R., Park A. Jannin P. (2017). Surgical data science: Enabling next-generation surgery. Retrieved from https:\/\/arxiv.org\/abs\/1701.06482"},{"key":"bibr41-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2010.10.001"},{"key":"bibr42-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2008.07.017"},{"key":"bibr43-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2006.10.016"},{"key":"bibr44-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2017.07.004"},{"key":"bibr45-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1109\/5.18626"},{"key":"bibr46-0018720819838901","unstructured":"Reiley C. E., Lin H. C., Varadarajan B., Vagvolgyi B., Khudanpur S., Yuh D. D., Hager G. D. (2008). Automatic recognition of surgical motions using statistical modeling for capturing variability. Studies in Health Technology and Informatics, 132, 396\u2013401. Retrieved from http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/18391329"},{"key":"bibr47-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2005.869771"},{"key":"bibr48-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1109\/10.918597"},{"key":"bibr49-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2016.09.002"},{"key":"bibr50-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1109\/ISCV.1995.477012"},{"key":"bibr51-0018720819838901","first-page":"93","volume":"7","author":"Sutton C.","year":"2002","journal-title":"Graphical Models"},{"key":"bibr52-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1561\/2200000013"},{"key":"bibr53-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30618-1_17"},{"key":"bibr54-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40760-4_43"},{"key":"bibr55-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2013.12.009"},{"key":"bibr56-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-bioeng-071516-044435"},{"key":"bibr57-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2015.11.009"},{"key":"bibr58-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(02)00100-0"},{"key":"bibr59-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000000316"},{"key":"bibr60-0018720819838901","first-page":"159","volume-title":"Medical instrumentation: Accessibility and usability considerations","author":"Yen T. Y.","year":"2007"},{"key":"bibr61-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2013.04.007"},{"key":"bibr62-0018720819838901","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-017-1600-y"},{"key":"bibr63-0018720819838901","volume-title":"Hidden Markov models for time series","author":"Zucchini W.","year":"2016","edition":"2"}],"container-title":["Human Factors: The Journal of the Human Factors and Ergonomics Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0018720819838901","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0018720819838901","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0018720819838901","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,1]],"date-time":"2025-03-01T05:02:57Z","timestamp":1740805377000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0018720819838901"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,23]]},"references-count":63,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["10.1177\/0018720819838901"],"URL":"https:\/\/doi.org\/10.1177\/0018720819838901","relation":{},"ISSN":["0018-7208","1547-8181"],"issn-type":[{"value":"0018-7208","type":"print"},{"value":"1547-8181","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,4,23]]}}}