{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T19:05:52Z","timestamp":1777921552678,"version":"3.51.4"},"reference-count":21,"publisher":"SAGE Publications","issue":"12","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Laparoendoscopic &amp; Advanced Surgical Techniques"],"published-print":{"date-parts":[[2021,12,1]]},"abstract":"<jats:sec>\n                    <jats:title>Background:<\/jats:title>\n                    <jats:p>Simulation has an increasing role in surgical training; however, using validated tools such as the Objective Structured Assessment of Technical Skills (OSATS) is time-consuming, which may be a potential barrier to simulation-based training. This study tests the hypothesis that assessors with technical expertise are necessary to objectively score a technical task.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>Three tasks, ring transfer, needle pass, and atresia cut, were performed using a synthetic thoracoscopic simulator for esophageal atresia\/tracheoesophageal fistula. Three pediatric surgeons, 6 novice adults, and 3 children aged 9\u201313 years scored each attempt using the overall global OSATS rating from 1 to 5 (1 \u201crepeated or awkward movements\u201d to 5 \u201cfluid movement. No awkwardness\u201d).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      For the ring transfer, all assessors scored novice participants significantly less than expert and intermediate scores (surgeon\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      \u2009=\u2009.0004, nonsurgeon adults\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      \u2009=\u2009.0009 and children\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      \u2009=\u2009.0003). For the needle pass, all assessors gave significantly different scores between novices and experts (surgeon\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      \u2009=\u2009.0007, nonsurgeon adult\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      \u2009=\u2009.0008, and children\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      \u2009=\u2009.0040). For the atresia cut, surgeon assessors gave significantly higher scores for experts and intermediate and novice (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      \u2009=\u2009.0004). Nonsurgeon assessors gave experts and intermediates significantly higher scores than novices (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      \u2009=\u2009.0001). Surgeon assessors achieved good reliability for ring transfer (0.8252) and needle pass (0.7769) compared with nonsurgeon assessors who showed poor reliability for the ring transfer (0.3959) and moderate for the needle pass (0.6551).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>Expertise in performing these procedures is not a prerequisite for an assessor to evaluate the technical skill, hence assessors of skill acquisition can be nonexpert, a nonsurgeon, or even a child. The variability in all groups suggests that reliability overall is increased with multiple assessors. Although nonsurgeon assessors may be appropriate for formative assessments, they lack the reliability to provide assessment of competence for high stakes complex tasks. Summative assessment will likely require at least 1 surgeon\/expert assessor to provide reliability.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1089\/lap.2021.0321","type":"journal-article","created":{"date-parts":[[2021,10,22]],"date-time":"2021-10-22T11:05:29Z","timestamp":1634900729000},"page":"1363-1366","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Is Technical Expertise Necessary to Assess Technical Expertise? Let's Ask the Kids"],"prefix":"10.1177","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5901-8596","authenticated-orcid":false,"given":"David","family":"Nair","sequence":"first","affiliation":[{"name":"Canterbury District Health Board, Department of Paediatric Surgery, Christchurch, New Zealand."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan M.","family":"Wells","sequence":"additional","affiliation":[{"name":"Canterbury District Health Board, Department of Paediatric Surgery, Christchurch, New Zealand."},{"name":"University of Otago, Department of Surgery, Christchurch, New Zealand."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ma","family":"Yi","sequence":"additional","affiliation":[{"name":"Canterbury District Health Board, Department of Biostatistics, Christchurch, New Zealand."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Spencer","family":"Beasley","sequence":"additional","affiliation":[{"name":"Canterbury District Health Board, Department of Paediatric Surgery, Christchurch, New Zealand."},{"name":"University of Otago, Department of Surgery, Christchurch, New Zealand."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2021,12,13]]},"reference":[{"key":"e_1_3_5_2_2","doi-asserted-by":"publisher","DOI":"10.21037\/atm.2016.12.24"},{"key":"e_1_3_5_3_2","doi-asserted-by":"publisher","DOI":"10.1055\/s-0032-1322553"},{"key":"e_1_3_5_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpedsurg.2011.02.026"},{"key":"e_1_3_5_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpedsurg.2019.05.022"},{"key":"e_1_3_5_6_2","doi-asserted-by":"publisher","DOI":"10.1089\/lap.2016.0249"},{"key":"e_1_3_5_7_2","doi-asserted-by":"publisher","DOI":"10.1097\/01.sla.0000136941.46529.56"},{"key":"e_1_3_5_8_2","doi-asserted-by":"publisher","DOI":"10.1089\/lap.2018.0254"},{"key":"e_1_3_5_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2007.09.044"},{"key":"e_1_3_5_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-017-5417-0"},{"key":"e_1_3_5_11_2","doi-asserted-by":"publisher","DOI":"10.1002\/bjs.1800840237"},{"key":"e_1_3_5_12_2","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.1.1.30"},{"key":"e_1_3_5_13_2","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0b013e3181b6c90b"},{"key":"e_1_3_5_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2009.07.035"},{"key":"e_1_3_5_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2005.04.004"},{"key":"e_1_3_5_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00426-013-0525-5"},{"key":"e_1_3_5_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2013.09.024"},{"key":"e_1_3_5_18_2","doi-asserted-by":"publisher","DOI":"10.1089\/end.2015.0104"},{"key":"e_1_3_5_19_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00464-010-1190-z"},{"key":"e_1_3_5_20_2","doi-asserted-by":"publisher","DOI":"10.1308\/rcsann.2015.0024"},{"key":"e_1_3_5_21_2","doi-asserted-by":"publisher","DOI":"10.1089\/end.2015.0191"},{"key":"e_1_3_5_22_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1014585522084"}],"container-title":["Journal of Laparoendoscopic &amp; Advanced Surgical Techniques"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1089\/lap.2021.0321","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1089\/lap.2021.0321","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1089\/lap.2021.0321","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T19:56:14Z","timestamp":1777665374000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1089\/lap.2021.0321"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,1]]},"references-count":21,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2021,12,1]]}},"alternative-id":["10.1089\/lap.2021.0321"],"URL":"https:\/\/doi.org\/10.1089\/lap.2021.0321","relation":{},"ISSN":["1092-6429","1557-9034"],"issn-type":[{"value":"1092-6429","type":"print"},{"value":"1557-9034","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,1]]}}}