{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T21:05:34Z","timestamp":1777669534676,"version":"3.51.4"},"reference-count":83,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2021,3,7]],"date-time":"2021-03-07T00:00:00Z","timestamp":1615075200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/100010477","name":"Intuitive Surgical","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100010477","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Hum Factors"],"published-print":{"date-parts":[[2022,2]]},"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>The purpose of this study was to identify, synthesize, and discuss objective behavioral or physiological metrics of surgeons\u2019 nontechnical skills (NTS) in the literature.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>NTS, or interpersonal or cognitive skills, have been identified to contribute to safe and efficient surgical performance; however, current assessments are subjective, checklist-based tools. Intraoperative skill evaluation, such as technical skills, has been previously utilized as an objective measure to address such limitations.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Five databases in engineering, behavioral science, and medicine were searched following PRISMA reporting guidelines. Eligibility criteria included studies with NTS objective measurements, surgeons, and took place within simulated or live operations.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Twenty-three articles were included in this review. Objective metrics included communication metrics and measures from physiological responses such as changes in brain activation and motion of the eye. Frequencies of content-coded communication in surgery were utilized in 16 studies and were associated with not only the communication construct but also cognitive constructs of situation awareness and decision making. This indicates the underlying importance of communication in evaluating the NTS constructs. To synthesize the scoped literature, a framework based on the one-way communication model was used to map the objective measures to NTS constructs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Objective NTS measurement of surgeons is still preliminary, and future work on leveraging objective metrics in parallel with current assessment tools is needed.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Application<\/jats:title>\n                    <jats:p>Findings from this work identify objective NTS metrics for measurement applications in a surgical environment.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/0018720821995319","type":"journal-article","created":{"date-parts":[[2021,3,7]],"date-time":"2021-03-07T13:13:31Z","timestamp":1615122811000},"page":"42-73","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":29,"title":["Objective Measures of Surgeon Non-Technical Skills in Surgery: A Scoping Review"],"prefix":"10.1177","volume":"64","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8136-2094","authenticated-orcid":false,"given":"Jackie S.","family":"Cha","sequence":"first","affiliation":[{"name":"Purdue University, Indiana, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5083-1713","authenticated-orcid":false,"given":"Denny","family":"Yu","sequence":"additional","affiliation":[{"name":"Purdue University, Indiana, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2021,3,7]]},"reference":[{"key":"bibr1-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.amsu.2015.10.006"},{"key":"bibr2-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2013.12.002"},{"key":"bibr3-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2009.10.007"},{"key":"bibr4-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1136\/qshc.2009.036129"},{"key":"bibr5-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2017.07.006"},{"key":"bibr6-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1111\/ans.12824"},{"key":"bibr7-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.bja.2018.07.028"},{"key":"bibr8-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1017\/9781316286302"},{"key":"bibr9-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2007.01.033"},{"key":"bibr10-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2018.08.028"},{"key":"bibr11-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1089\/end.2016.0498"},{"key":"bibr12-0018720821995319","first-page":"847","author":"Cunningham S.","year":"2012","journal-title":"Volume 2: Applied Fluid Mechanics; Electromechanical Systems and Mechatronics; Advanced Energy Systems; Thermal Engineering; Human Factors and Cognitive Engineering"},{"key":"bibr14-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1007\/s10111-018-0527-6"},{"key":"bibr15-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/0042-6989(95)00294-4"},{"key":"bibr16-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1002\/bjs.10795"},{"key":"bibr17-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2014.04.011"},{"key":"bibr13-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2020.02.016"},{"key":"bibr18-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1518\/001872095779049499"},{"key":"bibr19-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1177\/1555343415572631"},{"key":"bibr20-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1002\/chp.21156"},{"key":"bibr21-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1093\/bja\/aeg112"},{"key":"bibr22-0018720821995319","first-page":"97","volume-title":"Human factors and aerospace safety","author":"Flin R.","year":"2003","edition":"1"},{"key":"bibr23-0018720821995319","volume-title":"Safety at the sharp end: A guide to non-technical skills","author":"Flin R.","year":"2008"},{"key":"bibr24-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1067\/msy.2003.169"},{"key":"bibr25-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.2012.04343.x"},{"key":"bibr26-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1080\/0142159X.2018.1562166"},{"key":"bibr27-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1002\/bjs.10493"},{"key":"bibr52-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2012.02.020"},{"key":"bibr28-0018720821995319","doi-asserted-by":"publisher","DOI":"10.3233\/EFI-180221"},{"key":"bibr29-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.jamcollsurg.2015.09.013"},{"key":"bibr30-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.jamcollsurg.2011.10.016"},{"key":"bibr31-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2006.02.018"},{"key":"bibr32-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2018.02.021"},{"key":"bibr33-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(76)90015-3"},{"key":"bibr34-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1177\/0018720819874160"},{"key":"bibr35-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1080\/00140139.2016.1159736"},{"key":"bibr36-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijnurstu.2014.01.007"},{"key":"bibr37-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0000000000001651"},{"key":"bibr38-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.surge.2018.07.001"},{"key":"bibr39-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1136\/qshc.2003.008425"},{"key":"bibr40-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-200203000-00013"},{"key":"bibr41-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1126\/science.288.5472.1835"},{"key":"bibr42-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/S1553-7250(11)37047-X"},{"key":"bibr43-0018720821995319","doi-asserted-by":"publisher","DOI":"10.11613\/BM.2012.031"},{"key":"bibr44-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2019.10.012"},{"key":"bibr45-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/S0926-6410(01)00076-3"},{"key":"bibr46-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijnurstu.2011.08.012"},{"key":"bibr47-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.327.7422.1032"},{"key":"bibr48-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1097\/00005110-200402000-00008"},{"key":"bibr49-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-11750-3_2"},{"key":"bibr50-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.20131"},{"key":"bibr51-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2474-13-93"},{"key":"bibr53-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3540-07.2007"},{"key":"bibr54-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijnurstu.2009.01.009"},{"key":"bibr55-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1111\/bju.14150"},{"key":"bibr56-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0b013e3181e464fb"},{"key":"bibr57-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1007\/s00420-013-0847-z"},{"key":"bibr58-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0090320"},{"key":"bibr59-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1093\/ejcts\/ezs068"},{"key":"bibr60-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2753.2006.00712.x"},{"key":"bibr61-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-012-2287-3"},{"key":"bibr62-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2017-006701"},{"key":"bibr63-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.urology.2018.07.059"},{"key":"bibr64-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1145\/1743666.1743703"},{"key":"bibr65-0018720821995319","first-page":"658","volume":"163","author":"Tien G.","year":"2011","journal-title":"Studies in health technology and informatics"},{"key":"bibr66-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2014.04.032"},{"key":"bibr67-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1177\/1541931213601118"},{"key":"bibr68-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2015.02.034"},{"key":"bibr69-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.apergo.2018.02.015"},{"key":"bibr70-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2015.12.009"},{"key":"bibr71-0018720821995319","doi-asserted-by":"publisher","DOI":"10.7326\/M18-0850"},{"key":"bibr72-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1007\/s00268-007-9053-z"},{"key":"bibr73-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.jtcvs.2009.10.048"},{"key":"bibr74-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.urology.2017.11.060"},{"key":"bibr75-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0000000000001051"},{"key":"bibr76-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1201\/9781420055948"},{"key":"bibr77-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2016.11.017"},{"key":"bibr78-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1177\/0018720819874544"},{"key":"bibr79-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1901\/jeab.2005.121-04"},{"key":"bibr80-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1007\/s00268-007-9320-z"},{"key":"bibr81-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2005.06.017"},{"key":"bibr83-0018720821995319","first-page":"18720820969071","author":"Zhang T.","year":"2020","journal-title":"Human factors"},{"key":"bibr82-0018720821995319","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2011.01.016"}],"container-title":["Human Factors: The Journal of the Human Factors and Ergonomics Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0018720821995319","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0018720821995319","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0018720821995319","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T07:53:12Z","timestamp":1777449192000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0018720821995319"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,7]]},"references-count":83,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,2]]}},"alternative-id":["10.1177\/0018720821995319"],"URL":"https:\/\/doi.org\/10.1177\/0018720821995319","relation":{},"ISSN":["0018-7208","1547-8181"],"issn-type":[{"value":"0018-7208","type":"print"},{"value":"1547-8181","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,7]]}}}