{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T02:33:20Z","timestamp":1787020400655,"version":"build-2736575974"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2015,2,1]],"date-time":"2015-02-01T00:00:00Z","timestamp":1422748800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Educ"],"published-print":{"date-parts":[[2015,12]]},"DOI":"10.1186\/s12909-015-0294-5","type":"journal-article","created":{"date-parts":[[2015,1,31]],"date-time":"2015-01-31T09:59:20Z","timestamp":1422698360000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Clinical assessment of transthoracic echocardiography skills: a generalizability study"],"prefix":"10.1186","volume":"15","author":[{"given":"Dorte","family":"Guldbrand Nielsen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Signe Lichtenstein","family":"Jensen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lotte","family":"O\u2019Neill","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2015,2,1]]},"reference":[{"key":"294_CR1","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1016\/S0735-1097(02)02885-1","volume":"41","author":"MA Quinones","year":"2003","unstructured":"Quinones MA, Douglas PS, Foster E, Gorcsan 3rd J, Lewis JF, Pearlamn AS, et al. ACC\/AHA Clinical Competence Statement on Echocardiography: a report of the American College of Cardiology\/American Heart Association\/American College of Physicians-American Society of Internal Medicine task force on clinical competence. J Am Coll Cardiol. 2003;41:687\u2013708.","journal-title":"J Am Coll Cardiol"},{"issue":"3","key":"294_CR2","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1016\/j.jacc.2007.11.012","volume":"51","author":"T Ryan","year":"2008","unstructured":"Ryan T, Armstron WF, Khandheria BK. Task Force 4: Training in Echocardiography. J Am Coll Cardiol. 2008;51(3):361\u20137.","journal-title":"J Am Coll Cardiol"},{"key":"294_CR3","doi-asserted-by":"publisher","first-page":"893","DOI":"10.1093\/ejechocard\/jep151","volume":"10","author":"BA Popescu","year":"2009","unstructured":"Popescu BA, Andrade MJ, Badano L, Fox KF, Flachskampf F, Lancellotti P, et al. European Association of Echocardiography recommendations for training, competence, and quality improvement in echocardiography. Eur J Echocardiogr. 2009;10:893\u2013905.","journal-title":"Eur J Echocardiogr"},{"key":"294_CR4","first-page":"2381","volume":"34","author":"J Bauersachs","year":"2013","unstructured":"Bauersachs J, Bax J, Burri H, Caforio ALP, Calvo F, Charron P, et al. ESC Core Curriculum for the General Cardiologist. Eur Soc Cardiol Committ Educ Eur Heart J. 2013;34:2381\u2013411.","journal-title":"Eur Soc Cardiol Committ Educ Eur Heart J"},{"key":"294_CR5","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1016\/j.euje.2006.11.001","volume":"8","author":"KF Fox","year":"2007","unstructured":"Fox KF, Popescu BA, Janiszewski S, Nihoyannopoulos P, Fraser AG, Pinto FJ. Report on the European Association of Echocardiography Accreditations in Echocardiography: December 2003 - September 2006. Eur J Echocardiogr. 2007;8:74\u20139.","journal-title":"Eur J Echocardiogr"},{"key":"294_CR6","doi-asserted-by":"publisher","first-page":"901","DOI":"10.1046\/j.1365-2923.2002.01316.x","volume":"35","author":"J-J Rethans","year":"2002","unstructured":"Rethans J-J, Norcini JJ, Bar\u00f3n-Maldonado M, Blacmore D, Jolly BC, LaDuca T, et al. The relationship between competence and performance: implications for assessing practice performance. Med Educ. 2002;35:901\u20139.","journal-title":"Med Educ"},{"key":"294_CR7","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1186\/1472-6920-13-47","volume":"13","author":"DG Nielsen","year":"2013","unstructured":"Nielsen DG, Gotzsche O, Eika B. Objective structured assessment of technical competence in transthoracic echocardiography: a validity study in a standardized setting. BMC Med Educ. 2013;13:47.","journal-title":"BMC Med Educ"},{"key":"294_CR8","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198528470.001.0001","volume-title":"Health Measurement Scales","author":"DL Streiner","year":"2003","unstructured":"Streiner DL, Norman GR. Health Measurement Scales. 3rd ed. Oxford: Oxford University Press; 2003.","edition":"3"},{"key":"294_CR9","first-page":"17","volume-title":"Educational Measurement","author":"MT Kane","year":"2006","unstructured":"Kane MT. Validation. In: Brennan RL, editor. Educational Measurement. Westport, CT: ACE\/Praeger; 2006. p. 17\u201364."},{"key":"294_CR10","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3456-0","volume-title":"Generalizability Theory","author":"RL Brennan","year":"2001","unstructured":"Brennan RL. Generalizability Theory. New York: Springer Verlag; 2001."},{"key":"294_CR11","volume-title":"Recommendations for standardized minimum demands for adult transthoracic echocardiography","author":"DCS","year":"2008","unstructured":"DCS. Anbefalinger for standardiseret minimumskrav for transthorakal ekkokardiografi hos voksne. In: Recommendations for standardized minimum demands for adult transthoracic echocardiography. Copenhagen: Danish Cardiology Society; 2008."},{"key":"294_CR12","unstructured":"Genova programs, Center for Advanced Studies in Measurement and Assessment (CASMA); University of Iowa http:\/\/www.uiowa.edu\/~casma\/computer_programs.htm [Accessed 01 April 2014]."},{"issue":"9","key":"294_CR13","doi-asserted-by":"publisher","first-page":"1006","DOI":"10.1111\/j.1365-2929.2004.01932.x","volume":"38","author":"SM Downing","year":"2004","unstructured":"Downing SM. Reliability: on the reproducibility of assessment data. Med Educ. 2004;38(9):1006\u201312.","journal-title":"Med Educ"},{"key":"294_CR14","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1037\/h0071663","volume":"4","author":"EL Thorndike","year":"1920","unstructured":"Thorndike EL. A constant error in psychological ratings. J Appl Psychol. 1920;4:25\u20139.","journal-title":"J Appl Psychol"},{"issue":"7","key":"294_CR15","doi-asserted-by":"publisher","first-page":"618","DOI":"10.1111\/j.1365-2929.2006.02511.x","volume":"40","author":"G Norman","year":"2006","unstructured":"Norman G, Bordage G, Page G, Keane D. How specific is case specificity? Med Educ. 2006;40(7):618\u201323.","journal-title":"Med Educ"},{"issue":"10","key":"294_CR16","doi-asserted-by":"publisher","first-page":"926","DOI":"10.1111\/j.1365-2923.2007.02843.x","volume":"41","author":"J Crossley","year":"2007","unstructured":"Crossley J, Russel J, Jolly B, Ricketts C, Roberts C, Schuwirth L, et al. \u2018I\u2019m picking up good regressions\u2019: the governance of generalizability analyses. Med Educ. 2007;41(10):926\u201334.","journal-title":"Med Educ"},{"key":"294_CR17","volume-title":"Generalizability Theory. A primer","author":"RJ Shavelson","year":"1991","unstructured":"Shavelson RJ, Webb NM. Generalizability Theory. A primer. Thousand Oaks: Sage Publications; 1991."},{"issue":"1","key":"294_CR18","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1007\/s10459-013-9463-7","volume":"19","author":"SS Sebok","year":"2014","unstructured":"Sebok SS, Luu K, Klinger DA. Psychometric properties of the multiple mini-interview used for medical admissions: findings from generalizability and Rasch analyses. Adv Health Sci Educ Theory Pract. 2014;19(1):71\u201384.","journal-title":"Adv Health Sci Educ Theory Pract"},{"issue":"8","key":"294_CR19","doi-asserted-by":"publisher","first-page":"684","DOI":"10.3109\/0142159X.2013.801548","volume":"35","author":"M Homer","year":"2013","unstructured":"Homer M, Setna Z, Jha V, Higham J, Roberts T, Boursicot K. Estimating and comparing the reliability of a suite of workplace-based assessments: an obstetrics and gynaecology setting. Med Teach. 2013;35(8):684\u201391.","journal-title":"Med Teach"},{"key":"294_CR20","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1186\/1472-6920-12-121","volume":"12","author":"LA Baig","year":"2012","unstructured":"Baig LA, Violato C. Temporal stability of objective structured clinical exams: a longitudinal study employing item response theory. BMC Med Educ. 2012;12:121.","journal-title":"BMC Med Educ"},{"issue":"10","key":"294_CR21","doi-asserted-by":"publisher","first-page":"1330","DOI":"10.1097\/ACM.0b013e318267630f","volume":"87","author":"MD Hanson","year":"2012","unstructured":"Hanson MD, Kulasegaram KM, Woods NN, Fechtig L, Anderson G. Modified personal interviews: resurrecting reliable personal interviews for admissions? Acad Med. 2012;87(10):1330\u20134.","journal-title":"Acad Med"},{"issue":"8","key":"294_CR22","doi-asserted-by":"publisher","first-page":"635","DOI":"10.3109\/0142159X.2012.687845","volume":"34","author":"L Lohfeld","year":"2012","unstructured":"Lohfeld L, Goldie J, Schwartz L, Eva K, Cotton P, Morrison J, et al. Testing the validity of a scenario-based questionnaire to assess the ethical sensitivity of undergraduate medical students. Med Teach. 2012;34(8):635\u201342.","journal-title":"Med Teach"},{"issue":"8","key":"294_CR23","doi-asserted-by":"publisher","first-page":"1077","DOI":"10.1097\/ACM.0b013e31825cea4b","volume":"87","author":"RA Richter Lagha","year":"2012","unstructured":"Richter Lagha RA, Boscardin CK, May W, Fung CC. A comparison of two standard-setting approaches in high-stakes clinical performance assessment using generalizability theory. Acad Med. 2012;87(8):1077\u201382.","journal-title":"Acad Med"},{"issue":"5","key":"294_CR24","doi-asserted-by":"publisher","first-page":"703","DOI":"10.1007\/s10459-011-9344-x","volume":"17","author":"T Dornan","year":"2012","unstructured":"Dornan T, Muijtjens A, Graham J, Scherpbier A, Boshuizen H. Manchester Clinical Placement Index (MCPI). Conditions for medical students\u2019 learning in hospital and community placements. Adv Health Sci Educ Theory Pract. 2012;17(5):703\u201316.","journal-title":"Adv Health Sci Educ Theory Pract"},{"issue":"1","key":"294_CR25","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1007\/s10459-011-9343-y","volume":"18","author":"A Alves de Lima","year":"2013","unstructured":"Alves de Lima A, Conde D, Costabel J, Corso J, Van der Vleuten C. A laboratory study on the reliability estimations of the mini-CEX. Adv Health Sci Educ Theory Pract. 2013;18(1):5\u201313.","journal-title":"Adv Health Sci Educ Theory Pract"},{"issue":"3","key":"294_CR26","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1016\/j.pec.2011.10.008","volume":"87","author":"OS Karabilgin","year":"2012","unstructured":"Karabilgin OS, Vatansever K, Caliskan SA, Durak H\u0130. Assessing medical student competency in communication in the pre-clinical phase: objective structured video exam and SP exam. Patient Educ Couns. 2012;87(3):293\u20139.","journal-title":"Patient Educ Couns"},{"issue":"8","key":"294_CR27","doi-asserted-by":"publisher","first-page":"1032","DOI":"10.1097\/ACM.0b013e3182223ab7","volume":"86","author":"S Uijtdehaage","year":"2011","unstructured":"Uijtdehaage S, Doyle L, Parker N. Enhancing the reliability of the multiple mini-interview for selecting prospective health care leaders. Acad Med. 2011;86(8):1032\u20139.","journal-title":"Acad Med"},{"key":"294_CR28","doi-asserted-by":"publisher","first-page":"67","DOI":"10.2147\/AMEP.S12962","volume":"1","author":"GR Bergus","year":"2010","unstructured":"Bergus GR, Woodhead JC, Kreiter CD. Using systematically observed clinical encounters (SOCEs) to assess medical students\u2019 skills in clinical settings. Adv Med Educ Pract. 2010;1:67\u201373.","journal-title":"Adv Med Educ Pract"},{"issue":"5","key":"294_CR29","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1093\/bja\/aep055","volume":"102","author":"JM Weller","year":"2009","unstructured":"Weller JM, Jolly B, Misur MP, Merry AF, Jones A, Crossley JG, et al. Mini-clinical evaluation exercise in anaesthesia training. Br J Anaesth. 2009;102(5):633\u201341.","journal-title":"Br J Anaesth"},{"issue":"4","key":"294_CR30","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1046\/j.1365-2923.2001.00928.x","volume":"35","author":"V Wass","year":"2001","unstructured":"Wass V, Jones R, Van der Vleuten C. Standardized or real patients to test clinical competence? The long case revisited. Med Educ. 2001;35(4):321\u20135.","journal-title":"Med Educ"},{"issue":"4","key":"294_CR31","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1007\/s10459-007-9063-5","volume":"13","author":"VC Burch","year":"2008","unstructured":"Burch VC, Norman GR, Schmidt HG, van der Vleuten CP. Are specialist certification examinations a reliable measure of physician competence? Adv Health Sci Educ Theory Pract. 2008;13(4):521\u201333.","journal-title":"Adv Health Sci Educ Theory Pract"},{"issue":"4","key":"294_CR32","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1177\/0163278708324444","volume":"31","author":"SA Fernandez","year":"2008","unstructured":"Fernandez SA, Wiet GJ, Butler NN, Welling B, Jarjoura D. Reliability of surgical skills scores in otolaryngology residents: analysis using generalizability theory. Eval Health Prof. 2008;31(4):419\u201336.","journal-title":"Eval Health Prof"},{"issue":"4","key":"294_CR33","doi-asserted-by":"publisher","first-page":"326","DOI":"10.1046\/j.1365-2923.2001.00929.x","volume":"35","author":"V Wass","year":"2001","unstructured":"Wass V, McGibbon D, Van der Vleuten C. Composite undergraduate clinical examinations: how should the components be combined to maximize reliability? Med Educ. 2001;35(4):326\u201330.","journal-title":"Med Educ"}],"container-title":["BMC Medical Education"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12909-015-0294-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12909-015-0294-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12909-015-0294-5","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12909-015-0294-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,6]],"date-time":"2024-06-06T19:08:53Z","timestamp":1717700933000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-015-0294-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,2,1]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2015,12]]}},"alternative-id":["294"],"URL":"https:\/\/doi.org\/10.1186\/s12909-015-0294-5","relation":{},"ISSN":["1472-6920"],"issn-type":[{"value":"1472-6920","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,2,1]]},"assertion":[{"value":"25 July 2014","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 January 2015","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 February 2015","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"9"}}