{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T17:42:00Z","timestamp":1793295720143,"version":"4.5.0"},"reference-count":22,"publisher":"Georg Thieme Verlag KG","issue":"02","funder":[{"name":"Project of the 14th five year plan of Educational Science in Hunan Province","award":["XJK21AGD002"],"award-info":[{"award-number":["XJK21AGD002"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Ultraschall Med"],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>\n            Purpose To collect validity evidence for a simulator-based obstetric ultrasound competency assessment tool (OUCAT).<\/jats:p><jats:p>\n            Methods 89 sonographers from three centers (XY, MC, DT), including novices (n=21), experienced trainees (n=44), and experts (n=24), participated in the competency assessment. Validity evidence of OUCAT was collected according to Standards for Educational and Psychological Testing. Content validity was ensured by reviewing guidelines and reaching expert consensus. The response process was ensured via training raters. Internal structure was explored through internal consistency, inter-rater reliability, and test-retest reliability. Relations to other variables were explored by comparing OUCAT scores of sonographers with different experience. Evidence for consequences was collected by determining the pass\/fail level.<\/jats:p><jats:p>\n            Results OUCAT included 123 items, of which 117 items could effectively distinguish novices from experts (P&lt;0.05). The internal consistency was represented by the Cronbach\u2019s \u03b1 coefficient (0.978). The inter-rater reliability was high, with XY being 0.868, MC being 0.877, and DT being 0.937 (P&lt;0.001). Test-retest reliability was 0.732 (P=0.001). The performance of experts was significantly better than experienced trainees, and the performance of experienced trainees was significantly better than novices (70.3\u00b110.7 vs. 39.8\u00b115.0 vs. 20.5\u00b110.6, P&lt;0.001). The pass\/fail level determined by contrast group method was 45 points. The passing rate of novices, experienced trainees and experts was 0% (0\/21), 31.8% (14\/44), and 100% (24\/24), respectively.<\/jats:p><jats:p>\n            Conclusion Simulator-based OUCAT exhibits good reliability and validity in assessing obstetric ultrasound skills.<\/jats:p>","DOI":"10.1055\/a-2122-6746","type":"journal-article","created":{"date-parts":[[2023,7,4]],"date-time":"2023-07-04T22:55:31Z","timestamp":1688511331000},"page":"168-175","source":"Crossref","is-referenced-by-count":8,"title":["Validity evidence for simulator-based obstetric ultrasound competency assessment tool: a multi-center study"],"prefix":"10.1055","volume":"45","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0777-1890","authenticated-orcid":false,"given":"Yongfeng","family":"Zhao","sequence":"additional","affiliation":[{"name":"Ultrasound, Central South University Third Xiangya Hospital, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ping","family":"Zhou","sequence":"additional","affiliation":[{"name":"Ultrasound, Central South University Third Xiangya Hospital, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenhui","family":"Zhu","sequence":"additional","affiliation":[{"name":"Ultrasound, Central South University Third Xiangya Hospital, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jidong","family":"Xiao","sequence":"additional","affiliation":[{"name":"Ultrasound, Central South University Third Xiangya Hospital, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wengang","family":"Liu","sequence":"additional","affiliation":[{"name":"Ultrasound, Central South University Third Xiangya Hospital, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yingchun","family":"Luo","sequence":"additional","affiliation":[{"name":"Ultrasound, Hunan Provincial Maternal and Child Health Care Hospital, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junhui","family":"Zhang","sequence":"additional","affiliation":[{"name":"Ultrasound, Hunan Provincial Maternal and Child Health Care Hospital, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lan","family":"Yang","sequence":"additional","affiliation":[{"name":"Ultrasound, Nanjing Drum Tower Hospital, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yan","family":"Xu","sequence":"additional","affiliation":[{"name":"Ultrasound, Nanjing Drum Tower Hospital, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaohong","family":"Tang","sequence":"additional","affiliation":[{"name":"Clinical Skill Center, Central South University Third Xiangya Hospital, Changsha, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"194","published-online":{"date-parts":[[2023,10,6]]},"reference":[{"key":"ref1","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1002\/uog.8831","article-title":"Practice guidelines for performance of the routine mid-trimester fetal ultrasound scan","volume":"37","author":"LJ Salomon","year":"2011","journal-title":"Ultrasound Obstet Gynecol"},{"key":"ref2","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1002\/uog.14707","article-title":"Ultrasound simulators in obstetrics and gynecology: state of the art","volume":"46","author":"GE Chalouhi","year":"2015","journal-title":"Ultrasound Obstet Gynecol"},{"key":"ref3","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1002\/uog.13208","article-title":"ISUOG Education Committee recommendations for basic training in obstetric and gynecological ultrasound","volume":"43","year":"2014","journal-title":"Ultrasound Obstet Gynecol"},{"key":"ref4","doi-asserted-by":"crossref","first-page":"S106","DOI":"10.1002\/aet2.10368","article-title":"Tools for Measuring Clinical Ultrasound Competency: Recommendations From the Ultrasound Competency Work Group","volume":"4","author":"SC Damewood","year":"2020","journal-title":"AEM Educ Train"},{"key":"ref5","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1080\/0142159X.2017.1315082","article-title":"Core principles of assessment in competency-based medical education","volume":"39","author":"J Lockyer","year":"2017","journal-title":"Med Teach"},{"key":"ref6","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1002\/uog.18967","article-title":"Obstetric and gynecologic ultrasound curriculum and competency assessment in residency training programs: consensus report","volume":"51","author":"A Abuhamad","year":"2018","journal-title":"Ultrasound Obstet Gynecol"},{"key":"ref7","volume-title":"The Physics and Technology of Diagnostic Ultrasound: A Practitioner\u2019s Guide","author":"RW Gill","year":"2012"},{"key":"ref8","doi-asserted-by":"crossref","first-page":"e42","DOI":"10.1055\/a-1300-1680","article-title":"Simulation-Based Ultrasound Training in Obstetrics and Gynecology: A Systematic Review and Meta-Analysis","volume":"42","author":"C Taksoe-Vester","year":"2021","journal-title":"Ultraschall in Med"},{"key":"ref9","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.ejogrb.2020.12.034","article-title":"Metrics used to evaluate obstetric ultrasound skills on simulators: A systematic review","volume":"258","author":"M Le Lous","year":"2021","journal-title":"Eur J Obstet Gynecol Reprod Biol"},{"key":"ref10","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1002\/uog.13198","article-title":"Reliable and valid assessment of ultrasound operator competence in obstetrics and gynecology","volume":"43","author":"MG Tolsgaard","year":"2014","journal-title":"Ultrasound Obstet Gynecol"},{"key":"ref11","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1002\/uog.14780","article-title":"Sustained effect of simulation-based ultrasound training on clinical performance: a randomized trial","volume":"46","author":"MG Tolsgaard","year":"2015","journal-title":"Ultrasound Obstet Gynecol"},{"key":"ref12","doi-asserted-by":"crossref","first-page":"525.e1","DOI":"10.1016\/j.ajog.2015.10.932","article-title":"Evaluation of trainees\u2019 ability to perform obstetrical ultrasound using simulation: challenges and opportunities","volume":"214","author":"GE Chalouhi","year":"2016","journal-title":"Am J Obstet Gynecol"},{"key":"ref13","volume-title":"Standards for educational and psychological testing","author":"American Educational Research Association, American Psychological Association, National Council on Measurement in Education","year":"2014"},{"key":"ref14","doi-asserted-by":"crossref","first-page":"50","DOI":"10.3390\/diagnostics9020050","article-title":"Four Virtual-Reality Simulators for Diagnostic Abdominal Ultrasound Training in Radiology","volume":"9","author":"ML Ostergaard","year":"2019","journal-title":"Diagnostics (Basel)"},{"key":"ref15","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1016\/j.jogoh.2017.04.004","article-title":"Improving students\u2019 ability to perform a standardized foetal biometry plane using ultrasound simulators","volume":"46","author":"M Le Lous","year":"2017","journal-title":"J Gynecol Obstet Hum Reprod"},{"key":"ref16","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1055\/s-0041-107976","article-title":"Collecting Validity Evidence for the Assessment of Mastery Learning in Simulation-Based Ultrasound Training","volume":"37","author":"L Dyre","year":"2016","journal-title":"Ultraschall in Med"},{"key":"ref17","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1002\/pd.5855","article-title":"Dimensionless squared jerk: An objective differential to assess experienced and novice probe movement in obstetric ultrasound","volume":"41","author":"BP Dromey","year":"2021","journal-title":"Prenat Diagn"},{"key":"ref18","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.jogc.2016.10.009","article-title":"Simulator Based Obstetric Ultrasound Training: A Prospective, Randomized Single-Blinded Study","volume":"39","author":"H Rosen","year":"2017","journal-title":"J Obstet Gynaecol Can"},{"key":"ref19","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1002\/uog.12394","article-title":"Usability of virtual-reality simulation training in obstetric ultrasonography: a prospective cohort study","volume":"42","author":"C Burden","year":"2013","journal-title":"Ultrasound Obstet Gynecol"},{"key":"ref20","doi-asserted-by":"crossref","first-page":"201","DOI":"10.7863\/ultra.16.01037","article-title":"The Predictive Value of Ultrasound Learning Curves Across Simulated and Clinical Settings","volume":"36","author":"ME Madsen","year":"2017","journal-title":"J Ultrasound Med"},{"key":"ref21","doi-asserted-by":"crossref","first-page":"822","DOI":"10.1002\/pd.2016","article-title":"A score-based method for quality control of fetal images at routine second-trimester ultrasound examination","volume":"28","author":"LJ Salomon","year":"2008","journal-title":"Prenat Diagn"},{"key":"ref22","doi-asserted-by":"crossref","DOI":"10.56021\/9781421444116","volume-title":"Curriculum development for medical education: a six-step approach. 4th edition","author":"PA Thomas","year":"2022"}],"container-title":["Ultraschall in der Medizin - European Journal of Ultrasound"],"original-title":[],"language":"de","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/a-2122-6746.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,5]],"date-time":"2024-11-05T11:33:16Z","timestamp":1730806396000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/a-2122-6746"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,4]]},"references-count":22,"journal-issue":{"issue":"02","published-online":{"date-parts":[[2024,4,4]]},"published-print":{"date-parts":[[2024,4]]}},"URL":"https:\/\/doi.org\/10.1055\/a-2122-6746","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["0172-4614","1438-8782"],"issn-type":[{"value":"0172-4614","type":"print"},{"value":"1438-8782","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,7,4]]},"published":{"date-parts":[[2023,7,4]]}}}