{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T23:02:45Z","timestamp":1791932565720,"version":"4.3.4"},"reference-count":47,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Med Educ"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec sec-type=\"background\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Point-of-care ultrasound training is being increasingly integrated into undergraduate medical education, leading to a substantial demand for trained faculty to provide instruction and feedback.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"objective\">\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aimed to develop an adjunct tool, a deep learning\u2013based feedback model, to facilitate student learning.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"methods\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Renal ultrasound images (N=2807) were used to train a cascaded deep learning\u2013based feedback model that classified images into three categories: optimal, suboptimal, and incorrect. Suboptimal images were further subcategorized as images with artifact, incorrect gain, and\/or incorrect positioning. The model was deployed among year 5 medical students receiving bedside ultrasound training, who were invited to upload renal ultrasound images to an online platform for automated image quality grading and feedback. A mixed methods analysis was used to evaluate students\u2019 learning experience. Focus group interviews were organized to qualitatively analyze the successes and challenges of implementation. Quantitative analysis was based on responses to a 5-point Likert scale questionnaire and performance on the objective structured clinical examination (OSCE). Objective structured clinical examination scores were compared with mean OSCE scores from the 2 years preceding implementation of the deep learning\u2013based feedback model.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"results\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Focus group interviews identified that the deep learning\u2013based feedback model encouraged self-regulated learning but also recognized that discordant curricular design and hardware limitations impeded its use. The 11-item online questionnaire had a response rate of 42.4% (98\/231 students). Among respondents, 32% (31\/98) to 48% (47\/98) found the model helpful in assisting ultrasound training (Likert score of 4\u20105 for items 1-3), while 49% (48\/98) to 76% (74\/98) were satisfied with its usability and their interaction with the model (Likert score of 4\u20105 for items 4-11). The mean OSCE score was 9.73 (SD 0.76) out of 10, compared with mean scores of 9.35 (SD 1.03;\n                      <jats:italic>P<\/jats:italic>\n                      =.06) and 9.45 (SD 0.97;\n                      <jats:italic>P<\/jats:italic>\n                      =.15) out of 10 in the 2 individual years preceding implementation of the model.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"conclusions\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>A cascaded deep learning\u2013based feedback model was developed and deployed among year 5 medical students receiving bedside ultrasound training, with positive learner responses and enhanced self-regulated learning. The innovation was associated with increased student engagement and improved ultrasound skill acquisition among novice learners.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/72110","type":"journal-article","created":{"date-parts":[[2026,1,31]],"date-time":"2026-01-31T11:30:06Z","timestamp":1769859006000},"page":"e72110-e72110","source":"Crossref","is-referenced-by-count":1,"title":["Development of a Deep Learning\u2013Based Feedback Model to Assist Medical Students Learning Renal Ultrasound Acquisition: Mixed Methods Study"],"prefix":"10.2196","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-8559-5401","authenticated-orcid":false,"given":"Andy Cheuk Nam","family":"Hwang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5350-5588","authenticated-orcid":false,"given":"Rahul","family":"Singh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0042-771X","authenticated-orcid":false,"given":"Elizabeth Ann","family":"Barrett","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1116-1171","authenticated-orcid":false,"given":"Peng","family":"Cao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6677-3194","authenticated-orcid":false,"given":"Varut","family":"Vardhanabhuti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6671-5963","authenticated-orcid":false,"given":"Pauline Yeung","family":"Ng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8127-4593","authenticated-orcid":false,"given":"Gordon Tin Chun","family":"Wong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1705-051X","authenticated-orcid":false,"given":"Michael Tiong Hong","family":"Co","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0627-5297","authenticated-orcid":false,"given":"Elaine Yuen-Phin","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,3,9]]},"reference":[{"issue":"3","key":"R1","doi-asserted-by":"publisher","first-page":"219","DOI":"10.7861\/clinmedicine.18-3-219","article-title":"Point-of-care ultrasound (POCUS): unnecessary gadgetry or evidence-based medicine?","volume":"18","author":"Smallwood","journal-title":"Clin Med (Northfield)"},{"issue":"2","key":"R2","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1111\/1742-6723.14099","article-title":"Accuracy and clinical use of biliary point-of-care ultrasound: a retrospective cohort study","volume":"35","author":"Archer","journal-title":"Emerg Med Australas"},{"issue":"1","key":"R3","doi-asserted-by":"publisher","DOI":"10.1186\/s13054-023-04495-6","article-title":"Diagnostic accuracy of point-of-care ultrasound for shock: a systematic review and meta-analysis","volume":"27","author":"Yoshida","journal-title":"Crit Care"},{"issue":"11","key":"R4","doi-asserted-by":"publisher","first-page":"2459","DOI":"10.1002\/jum.15633","article-title":"The current status of ultrasound education in United States medical schools","volume":"40","author":"Nicholas","journal-title":"J Ultrasound Med"},{"issue":"1143","key":"R5","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1136\/postgradmedj-2020-137773","article-title":"Point-of-care ultrasound augments physical examination learning by undergraduate medical students","volume":"97","author":"Wong","journal-title":"Postgrad Med J"},{"issue":"3","key":"R6","doi-asserted-by":"publisher","first-page":"255","DOI":"10.12809\/hkmj2411666","article-title":"Cross-specialty point-of-care ultrasound education in The University of Hong Kong","volume":"30","author":"Cheung","journal-title":"Hong Kong Med J"},{"issue":"5","key":"R7","doi-asserted-by":"publisher","first-page":"723","DOI":"10.1097\/ACM.0000000000004512","article-title":"The state of point-of-care ultrasound training in undergraduate medical education: findings from a national survey","volume":"97","author":"Russell","journal-title":"Acad Med"},{"issue":"1","key":"R8","doi-asserted-by":"publisher","DOI":"10.1186\/s13089-023-00329-2","article-title":"Learning curves for point-of-care ultrasound image acquisition for novice learners in a longitudinal curriculum","volume":"15","author":"Breunig","journal-title":"Ultrasound J"},{"issue":"1","key":"R9","doi-asserted-by":"publisher","first-page":"21","DOI":"10.11152\/mu-4235","article-title":"Learning curves in abdominal ultrasound in medical students","volume":"26","author":"Moga","journal-title":"Med Ultrason"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.15766\/mep_2374-8265.11037","article-title":"Integrating basic and clinical sciences using point-of-care renal ultrasound for preclerkship education","volume":"16","author":"Alerhand","journal-title":"MedEdPORTAL"},{"issue":"Suppl 2","key":"R11","doi-asserted-by":"publisher","first-page":"460","DOI":"10.1186\/s12909-020-02280-5","article-title":"Feedback in the clinical setting","volume":"20","author":"Burgess","journal-title":"BMC Med Educ"},{"key":"R12","doi-asserted-by":"crossref","unstructured":"Carless D . Excellence in University Assessment: Learning from Award-Winning Practice. Routledge; 2015. ISBN: 9781315740621","DOI":"10.4324\/9781315740621"},{"issue":"3","key":"R13","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1007\/s10734-017-0220-3","article-title":"Developing evaluative judgement: enabling students to make decisions about the quality of work","volume":"76","author":"Tai","journal-title":"High Educ"},{"issue":"6","key":"R14","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1016\/j.ajog.2006.08.021","article-title":"To the point: medical education reviews--providing feedback","volume":"196","author":"Bienstock","journal-title":"Am J Obstet Gynecol"},{"issue":"2","key":"R15","doi-asserted-by":"publisher","first-page":"214","DOI":"10.4300\/JGME-D-14-00461.1","article-title":"Barriers and facilitators to effective feedback: a qualitative analysis of data from multispecialty resident focus groups","volume":"7","author":"Reddy","journal-title":"J Grad Med Educ"},{"issue":"7","key":"R16","doi-asserted-by":"publisher","first-page":"1401","DOI":"10.1080\/07294360.2019.1657807","article-title":"Conditions that enable effective feedback","volume":"38","author":"Henderson","journal-title":"High Educ Res Dev"},{"issue":"8","key":"R17","doi-asserted-by":"publisher","first-page":"1237","DOI":"10.1080\/02602938.2019.1599815","article-title":"The challenges of feedback in higher education","volume":"44","author":"Henderson","journal-title":"Assess Eval High Educ"},{"issue":"8","key":"R18","doi-asserted-by":"publisher","first-page":"836","DOI":"10.1080\/0142159X.2022.2083489","article-title":"Technology enhanced assessment: Ottawa consensus statement and recommendations","volume":"44","author":"Fuller","journal-title":"Med Teach"},{"issue":"1","key":"R19","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1097\/ACM.0000000000001323","article-title":"Fostering the development of master adaptive learners: a conceptual model to guide skill acquisition in medical education","volume":"92","author":"Cutrer","journal-title":"Acad Med"},{"issue":"3","key":"R20","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1002\/ase.1480","article-title":"Anatomy drawing screencasts: enabling flexible learning for medical students","volume":"8","author":"Pickering","journal-title":"Anat Sci Educ"},{"issue":"2","key":"R21","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1007\/s00431-021-04149-1","article-title":"Blended and e-learning in pediatric education: harnessing lessons learned from the COVID-19 pandemic","volume":"181","author":"Fitzgerald","journal-title":"Eur J Pediatr"},{"issue":"3","key":"R22","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1080\/01421590050006160","article-title":"AMEE medical education guide no. 19: personal learning plans","volume":"22","author":"Challis","journal-title":"Med Teach"},{"issue":"2","key":"R23","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1207\/s15430421tip4102_2","article-title":"Becoming a self-regulated learner: an overview","volume":"41","author":"Zimmerman","journal-title":"Theory Pract"},{"issue":"422","key":"R24","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2017.00422","article-title":"A review of self-regulated learning: six models and four directions for research","volume":"8","author":"Panadero","journal-title":"Front Psychol"},{"issue":"6","key":"R25","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","journal-title":"Commun ACM"},{"key":"R26","doi-asserted-by":"crossref","unstructured":"He K Zhang X Ren S Sun J . Deep residual learning for image recognition. Presented at: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); Jun 27-30, 2016; Las Vegas, NV. [doi: 10.1109\/CVPR.2016.90]","DOI":"10.1109\/CVPR.2016.90"},{"key":"R27","doi-asserted-by":"crossref","unstructured":"Hu J Shen L Sun G . Squeeze-and-excitation networks. Presented at: 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition; Jun 18-23, 2018; Salt Lake City, UT. [doi: 10.1109\/CVPR.2018.00745]","DOI":"10.1109\/CVPR.2018.00745"},{"key":"R28","volume":"97","author":"Tan","journal-title":"Proc Machine Learning Res"},{"key":"R29","doi-asserted-by":"crossref","unstructured":"Deng J Dong W Socher R Li LJ . ImageNet: a large-scale hierarchical image database. Presented at: 2009 IEEE Conference on Computer Vision and Pattern Recognition; Jun 20-25, 2009; Miami, FL. [doi: 10.1109\/CVPR.2009.5206848]","DOI":"10.1109\/CVPR.2009.5206848"},{"issue":"2","key":"R30","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0057687","article-title":"International multispecialty consensus on how to evaluate ultrasound competence: a Delphi consensus survey","volume":"8","author":"Tolsgaard","journal-title":"PLoS One"},{"key":"R31","unstructured":"Brooke J. SUS . SUS \u2013 a quick and dirty usability scale. In: Jordan PW Thomas B McClelland IL Weerdmeester B , editors. Usability Evaluation in Industry. 1st ed. 1996:189-194. ISBN: 978-0748404605"},{"issue":"3","key":"R32","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1016\/0149-7189(79)90094-6","article-title":"Assessment of client\/patient satisfaction: development of a general scale","volume":"2","author":"Larsen","journal-title":"Eval Program Plann"},{"issue":"6","key":"R33","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1080\/0142159X.2023.2180340","article-title":"The fundamentals of artificial intelligence in medical education research: AMEE Guide No. 156","volume":"45","author":"Tolsgaard","journal-title":"Med Teach"},{"issue":"4","key":"R34","doi-asserted-by":"publisher","first-page":"446","DOI":"10.1080\/0142159X.2024.2314198","article-title":"A scoping review of artificial intelligence in medical education: BEME guide no. 84","volume":"46","author":"Gordon","journal-title":"Med Teach"},{"issue":"4","key":"R35","doi-asserted-by":"publisher","first-page":"36835888","DOI":"10.3390\/jcm12041352","article-title":"Artificial intelligence (AI) versus POCUS expert: a validation study of three automatic AI-based, real-time, hemodynamic echocardiographic assessment tools","volume":"12","author":"Gohar","journal-title":"J Clin Med"},{"issue":"3","key":"R36","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0299461","article-title":"The effect of real-time EF automatic tool on cardiac ultrasound performance among medical students","volume":"19","author":"Aronovitz","journal-title":"PLoS One"},{"issue":"3","key":"R37","doi-asserted-by":"publisher","first-page":"100023","DOI":"10.1016\/j.chpulm.2023.100023","article-title":"Acquisition of cardiac point-of-care ultrasound images with deep learning: a randomized trial for educational outcomes with novices","volume":"1","author":"Baum","journal-title":"Chest Pulmonary"},{"issue":"2","key":"R38","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1177\/1742271X241287923","article-title":"Artificial intelligence-assisted focused cardiac ultrasound training: a survey among undergraduate medical students","volume":"33","author":"Soliman-Aboumarie","journal-title":"Ultrasound"},{"key":"R39","doi-asserted-by":"publisher","DOI":"10.1155\/2023\/5225872","article-title":"Empowering medical students: harnessing artificial intelligence for precision point-of-care echocardiography assessment of left ventricular ejection fraction","author":"Dadon","journal-title":"Int J Clin Pract"},{"key":"R40","doi-asserted-by":"publisher","DOI":"10.3389\/fendo.2024.1372397","article-title":"Improving the diagnostic performance of inexperienced readers for thyroid nodules through digital self-learning and artificial intelligence assistance","volume":"15","author":"Lee","journal-title":"Front Endocrinol (Lausanne)"},{"issue":"9","key":"R41","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1515\/jpm-2024-0347","article-title":"The utilization of artificial intelligence in enhancing 3D\/4D ultrasound analysis of fetal facial profiles","volume":"52","author":"Bachnas","journal-title":"J Perinat Med"},{"issue":"2","key":"R42","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1207\/s15326985ep4102_4","article-title":"The four-phase model of interest development","volume":"41","author":"Hidi","journal-title":"Educ Psychol"},{"key":"R43","doi-asserted-by":"publisher","DOI":"10.1016\/j.tate.2018.03.018","article-title":"Load reduction instruction: exploring a framework that assesses explicit instruction through to independent learning","volume":"73","author":"Martin","journal-title":"Teach Teach Educ"},{"issue":"2","key":"R44","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1080\/0142159X.2017.1407868","article-title":"Twelve tips on how to provide self-regulated learning (SRL) enhanced feedback on clinical performance","volume":"41","author":"Leggett","journal-title":"Med Teach"},{"issue":"1","key":"R45","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-024-05439-6","article-title":"Designing feedback processes in the workplace-based learning of undergraduate health professions education: a scoping review","volume":"24","author":"Fuentes-Cimma","journal-title":"BMC Med Educ"},{"issue":"1","key":"R46","doi-asserted-by":"publisher","first-page":"572","DOI":"10.1186\/s12909-022-03629-8","article-title":"The pedagogical value of near-peer feedback in online OSCEs","volume":"22","author":"Sader","journal-title":"BMC Med Educ"},{"issue":"7","key":"R47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.12968\/hmed.2022.0446","article-title":"Feedback literacy as a model to explore how learners respond to feedback","volume":"84","author":"Spooner","journal-title":"Br J Hosp Med"}],"container-title":["JMIR Medical Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/mededu.jmir.org\/2026\/1\/e72110","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:02:14Z","timestamp":1782842534000},"score":1,"resource":{"primary":{"URL":"https:\/\/mededu.jmir.org\/2026\/1\/e72110"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,9]]},"references-count":47,"URL":"https:\/\/doi.org\/10.2196\/72110","relation":{},"ISSN":["2369-3762"],"issn-type":[{"value":"2369-3762","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,9]]},"article-number":"v12i3e72110"}}