{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T15:52:51Z","timestamp":1777737171671,"version":"3.51.4"},"reference-count":40,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T00:00:00Z","timestamp":1767225600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Innovations\ufffd(Phila)"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:sec>\n                    <jats:title>Objective:<\/jats:title>\n                    <jats:p>\n                      Surgical education requires assessment tools as part of competency-based education (CBE). In robotic surgery, objective performance indicators (OPIs) are a novel objective method of measuring surgeon performance. We developed\n                      <jats:bold>V<\/jats:bold>\n                      ideo and\n                      <jats:bold>O<\/jats:bold>\n                      bjective\n                      <jats:bold>R<\/jats:bold>\n                      obotic\n                      <jats:bold>T<\/jats:bold>\n                      ask\n                      <jats:bold>E<\/jats:bold>\n                      valuation inde\n                      <jats:bold>X<\/jats:bold>\n                      on\n                      <jats:bold>S<\/jats:bold>\n                      uperior\n                      <jats:bold>P<\/jats:bold>\n                      ulmonary\n                      <jats:bold>V<\/jats:bold>\n                      ein dissection (VORTEX-SPV), combining video review and OPIs, to assess cardiothoracic (CT) fellow competency on SPV dissection during lobectomy.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>CT fellows performed robotic lobectomy on an ex vivo perfused porcine model. Synchronized video and kinematic data were captured. Seven thoracic surgery attendings completed the robotic lobectomy to provide expert-level OPI data. VORTEX-SPV is a 12-item assessment with 4 performance levels including completion, safety, economy of motion, and optimized performance. We scored video-based review items (items 1 to 6) as 0 or 1 with an inter-rater agreement of 91%. We calculated OPIs from 6 categories (e.g., wrist articulation, instrument movement, energy, smoothness, clutching, instrument time) as within (1) or beyond (0) 2 standard deviations of the expert mean. We used Rasch modeling and item response theory to evaluate reliability and validity.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      We assessed 2 cohorts of CT fellows (2019,\n                      <jats:italic toggle=\"yes\">n<\/jats:italic>\n                      = 50; 2023,\n                      <jats:italic toggle=\"yes\">n<\/jats:italic>\n                      = 59). There were 60% (65 of 109) who had complete data. Reliability was high (expected a posteriori = 0.90). Fourteen trainees scored up to the level of completion, 10 at safety, 17 at economy of motion, and 24 achieved optimized performance. All items appropriately increased in difficulty (Spearman\u2019s rho coefficient = 0.93).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>VORTEX-SPV combines video review and objective performance data with strong reliability and validity evidence, serving as a robotic surgery assessment framework to facilitate CBE.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/15569845251407699","type":"journal-article","created":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T09:30:20Z","timestamp":1771493420000},"page":"64-72","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Integrating Video and Objective Performance Data: Development of VORTEX-SPV for Assessing Robotic Lobectomy Skills"],"prefix":"10.1177","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-3928-819X","authenticated-orcid":false,"given":"Alyssa D.","family":"Murillo","sequence":"first","affiliation":[{"name":"Department of Surgery, University of California San Francisco (UCSF), CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7462-3214","authenticated-orcid":false,"given":"Riley","family":"Brian","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of California San Francisco (UCSF), CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2348-010X","authenticated-orcid":false,"given":"Camilla","family":"Gomes","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of California San Francisco (UCSF), CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2818-8477","authenticated-orcid":false,"given":"Laleh","family":"Foroutani","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of California San Francisco (UCSF), CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amir Ashraf","family":"Ganjouei","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of California San Francisco (UCSF), CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hueylan","family":"Chern","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of California San Francisco (UCSF), CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patricia S.","family":"O\u2019Sullivan","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of California San Francisco (UCSF), CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2843-8077","authenticated-orcid":false,"given":"Daniel S.","family":"Oh","sequence":"additional","affiliation":[{"name":"Department of Surgery, University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2026,2,19]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1097\/AS9.0000000000000148"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa1515724"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0000000000005991"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1001\/archsurg.2011.178"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0b013e3182a191ca"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2013.06.020"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2019.05.059"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.5009\/gnl.2010.4.1.31"},{"key":"e_1_3_3_10_2","unstructured":"American Board of Surgery. Entrustable professional activities (EPAs) https:\/\/www.absurgery.org\/get-certified\/epas\/ (2023 accessed 19 April 2024)."},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jtcvs.2023.01.007"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.anai.2021.12.010"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0039-6060(03)00154-5"},{"key":"e_1_3_3_14_2","unstructured":"Society of American Gastrointestinal and Endoscopic Surgeons (SAGES). SAGES\/MIRA consensus document on robotic surgery https:\/\/www.sages.org\/publications\/guidelines\/consensus-document-robotic-surgery\/ (2025 accessed 19 March 2025)."},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-015-4070-8"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1002\/bjs.1800840237"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11701-016-0572-1"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1159\/000512437"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11701-022-01476-9"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamasurg.2023.0363"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1177\/15569845231204607"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781003286929"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.psych.47.1.273"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-200410001-00022"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.100.3.363"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1553-2712.2008.00227.x"},{"key":"e_1_3_3_27_2","unstructured":"Intuitive Surgical. Thoracic Basic Plus Technology and Surgeon-led Procedure Training TR200.THOR.Si https:\/\/globalsrv.intusurg.com\/training\/agendas\/TR200.THOR.Si.pdf (2019 accessed 19 March 2024)."},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jtcvs.2023.07.051"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11701-020-01131-1"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-019-07035-y"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1111\/bju.14599"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1111\/bju.14735"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-020-07708-z"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2016.2545247"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2018.00615"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.3109\/10929080600989189"},{"key":"e_1_3_3_37_2","unstructured":"Intuitive Surgical. Intuitive Hub https:\/\/www.intuitive.com\/en-us\/products-and-services\/intuitive-hub (2024 accessed 19 March 2024)."},{"key":"e_1_3_3_38_2","first-page":"109","volume-title":"Handbook of item response theory: models","author":"Masters GN.","year":"2016","unstructured":"Masters GN. Partial credit model. In: van der Linden WJ (ed) Handbook of item response theory: models. Boca Raton, FL: Taylor and Francis, 2016, pp.109\u2013126."},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2019.12.009"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2016.12.014"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2014-006759"}],"container-title":["Innovations: Technology and Techniques in Cardiothoracic and Vascular Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15569845251407699","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/15569845251407699","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15569845251407699","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T11:18:53Z","timestamp":1777461533000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/15569845251407699"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["10.1177\/15569845251407699"],"URL":"https:\/\/doi.org\/10.1177\/15569845251407699","relation":{},"ISSN":["1556-9845","1559-0879"],"issn-type":[{"value":"1556-9845","type":"print"},{"value":"1559-0879","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1]]}}}