{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,20]],"date-time":"2025-07-20T03:29:33Z","timestamp":1752982173184,"version":"3.37.3"},"reference-count":18,"publisher":"Public Library of Science (PLoS)","issue":"11","license":[{"start":{"date-parts":[[2023,11,2]],"date-time":"2023-11-02T00:00:00Z","timestamp":1698883200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST 107-2511-H-038 -003 -"],"award-info":[{"award-number":["MOST 107-2511-H-038 -003 -"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>The current Objective Structured Clinical Examination (OSCE) is complex, costly, and difficult to provide high-quality assessments. This pilot study employed a focus group and debugging stage to test the Crowdsource Authoring Assessment Tool (CAAT) for the creation and sharing of assessment tools used in editing and customizing, to match specific users\u2019 needs, and to provide higher-quality checklists. Competency assessment international experts (n = 50) were asked to 1) participate in and experience the CAAT system when editing their own checklist, 2) edit a urinary catheterization checklist using CAAT, and 3) complete a Technology Acceptance Model (TAM) questionnaire consisting of 14 items to evaluate its four domains. The study occurred between October 2018 and May 2019. The median time for developing a new checklist using the CAAT was 65.76 minutes whereas the traditional method required 167.90 minutes. The CAAT system enabled quicker checklist creation and editing regardless of the experience and native language of participants. Participants also expressed the CAAT enhanced checklist development with 96% of them willing to recommend this tool to others. The use of a crowdsource authoring tool as revealed by this study has efficiently reduced the time to almost a third it would take when using the traditional method. In addition, it allows collaborations to partake on a simple platform which also promotes contributions in checklist creation, editing, and rating.<\/jats:p>","DOI":"10.1371\/journal.pone.0278571","type":"journal-article","created":{"date-parts":[[2023,11,2]],"date-time":"2023-11-02T17:54:11Z","timestamp":1698947651000},"page":"e0278571","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["Crowdsource authoring as a tool for enhancing the quality of competency assessments in healthcare professions"],"prefix":"10.1371","volume":"18","author":[{"given":"Che-Wei","family":"Lin","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel L.","family":"Clinciu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1088-2775","authenticated-orcid":true,"given":"Daniel","family":"Salcedo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chih-Wei","family":"Huang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Enoch Yi No","family":"Kang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6497-4232","authenticated-orcid":true,"given":"Yu-Chuan (Jack)","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2023,11,2]]},"reference":[{"issue":"5955","key":"pone.0278571.ref001","doi-asserted-by":"crossref","first-page":"447451","DOI":"10.1136\/bmj.1.5955.447","article-title":"Assessment of clinical competence using objective structured examination","volume":"1","author":"R. Harden","year":"1975","journal-title":"Br Med J"},{"issue":"3","key":"pone.0278571.ref002","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1177\/0163278704267044","article-title":"Performance assessment in medical education: where we\u2019ve been and where we\u2019re going","volume":"27","author":"L. D. Howley","year":"2004","journal-title":"Evaluation & the health professions"},{"issue":"9260","key":"pone.0278571.ref003","doi-asserted-by":"crossref","first-page":"945","DOI":"10.1016\/S0140-6736(00)04221-5","article-title":"Assessment of clinical competence","volume":"357","author":"V. Wass","year":"2001","journal-title":"The Lancet"},{"issue":"4","key":"pone.0278571.ref004","article-title":"Electronic acquisition of OSCE performance using tablets","volume":"32","author":"A. Hochlehnert","year":"2015","journal-title":"GMS Zeitschrift f\u00fcr Medizinische Ausbildung"},{"issue":"5","key":"pone.0278571.ref005","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1046\/j.1365-2923.1997.d01-45.x","article-title":"Clinical skills training: developing objective assessment instruments","volume":"31","author":"H. M. OConnor","year":"1997","journal-title":"Medical education"},{"issue":"5","key":"pone.0278571.ref006","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1046\/j.1365-2923.2003.01495.x","article-title":"Setting standards on educational tests","volume":"37","author":"J. J. Norcini","year":"2003","journal-title":"Medical education"},{"issue":"2","key":"pone.0278571.ref007","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1111\/j.1365-2923.1991.tb00037.x","article-title":"Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability","volume":"25","author":"G. Norman","year":"1991","journal-title":"Medical education"},{"issue":"12","key":"pone.0278571.ref008","doi-asserted-by":"crossref","first-page":"1208","DOI":"10.1080\/0142159X.2017.1390214","article-title":"Twelve tips for developing an OSCE that measures what you want","volume":"40","author":"V. J. Daniels","year":"2018","journal-title":"Medical teacher"},{"issue":"2","key":"pone.0278571.ref009","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/S40037-016-0265-5","article-title":"Beyond standard checklist assessment: Question sequence may impact student performance","volume":"5","author":"J. LaRochelle","year":"2016","journal-title":"Perspectives on medical education"},{"issue":"10","key":"pone.0278571.ref010","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1080\/0142159X.2018.1507263","article-title":"The medical school without walls: Reflections on the future of medical education","volume":"40","author":"D. Davis","year":"2018","journal-title":"Medical teacher"},{"issue":"10","key":"pone.0278571.ref011","doi-asserted-by":"crossref","first-page":"1010","DOI":"10.1080\/0142159X.2018.1498613","article-title":"Ten key features of the future medical school\u2014not an impossible dream","volume":"40","author":"R. M. Harden","year":"2018","journal-title":"Medical teacher"},{"issue":"10","key":"pone.0278571.ref012","doi-asserted-by":"crossref","first-page":"980","DOI":"10.1080\/0142159X.2018.1506417","article-title":"What does the future hold? No one knows for sure\u2026","volume":"40","author":"J. Rourke","year":"2018","journal-title":"Medical teacher"},{"issue":"3","key":"pone.0278571.ref013","doi-asserted-by":"crossref","first-page":"208","DOI":"10.3109\/0142159X.2014.874552","article-title":"Curriculum inventory: Modeling, sharing and comparing medical education programs","volume":"36","author":"R. H. Ellaway","year":"2014","journal-title":"Medical teacher"},{"key":"pone.0278571.ref014","unstructured":"Wikipedia. https:\/\/en.wikipedia.org\/wiki\/Wikipedia:Size_comparisons#:~:text=Currently%2C%20the%20English%20Wikipedia%20alone,million%20articles%20in%2030%209%20languages."},{"issue":"1","key":"pone.0278571.ref015","doi-asserted-by":"crossref","first-page":"187203","DOI":"10.1007\/s11606-013-2536-8","article-title":"Crowdsourcing\u2014harnessing the masses to advance health and medicine, a systematic review","volume":"29","author":"B. L. Ranard","year":"2014","journal-title":"Journal of general internal medicine"},{"key":"pone.0278571.ref016","doi-asserted-by":"crossref","unstructured":"Gao, H., Barbier, G., & Goolsby, R. (2011) Harnessing the Crowdsourcing Power of Social Media for Disaster Relief. IEEE, 1541-1672\/11\/.","DOI":"10.21236\/ADA581803"},{"issue":"4","key":"pone.0278571.ref017","doi-asserted-by":"crossref","first-page":"695","DOI":"10.2307\/25148660","article-title":"User acceptance of hedonic information systems","volume":"28","author":"H. van der Heijden","year":"2004","journal-title":"Mis Quarterly"},{"issue":"4","key":"pone.0278571.ref018","first-page":"86","article-title":"The practice of crowdsourcing is transforming the Web and giving rise to a new field","volume":"54","author":"A. Doan","year":"2011","journal-title":"Communications of the ACM"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0278571","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,2]],"date-time":"2023-11-02T17:54:29Z","timestamp":1698947669000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0278571"}},"subtitle":[],"editor":[{"given":"Yaser Mohammed","family":"Al-Worafi","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2023,11,2]]},"references-count":18,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,11,2]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0278571","relation":{},"ISSN":["1932-6203"],"issn-type":[{"type":"electronic","value":"1932-6203"}],"subject":[],"published":{"date-parts":[[2023,11,2]]}}}