{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T17:56:49Z","timestamp":1791223009328,"version":"4.1.0"},"reference-count":27,"publisher":"SLACK, Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Nurs Educ"],"abstract":"<jats:sec>\n                    <jats:title>Background:<\/jats:title>\n                    <jats:p>\n                      Clinical judgment skills, a key component of nursing competency, are difficult to accurately and consistently assess. To support evaluation of these skills using Lasater's (\n                      <jats:xref ref-type=\"bibr\">2007<\/jats:xref>\n                      ) clinical judgment rubric (LCJR), rater training resources were developed and evaluated.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method:<\/jats:title>\n                    <jats:p>A one-group pretest-posttest design evaluated the effect of developed resources on agreement between two novice raters (NRs) and resource developers. NR-CE had content expertise; NR-NNE had no nursing experience.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      Pre-training, total scores showed poor agreement between novice and trained raters (ICC\n                      <jats:sub>absolute<\/jats:sub>\n                      (2,1) LCJR\n                      <jats:sub>total for NR-CE<\/jats:sub>\n                      = \u2212.59; LCJR\n                      <jats:sub>total for NR-N<\/jats:sub>\n                      <jats:italic toggle=\"yes\">\n                        <jats:sub>NE<\/jats:sub>\n                      <\/jats:italic>\n                      = .24). Posttraining, agreement was higher (ICC\n                      <jats:sub>absolute<\/jats:sub>\n                      (2,1) LCJR\n                      <jats:sub>total NR-<\/jats:sub>\n                      <jats:italic toggle=\"yes\">\n                        <jats:sub>CE<\/jats:sub>\n                      <\/jats:italic>\n                      = .70; LCJR\n                      <jats:sub>total NR-N<\/jats:sub>\n                      <jats:italic toggle=\"yes\">\n                        <jats:sub>NE<\/jats:sub>\n                      <\/jats:italic>\n                      = .76). Dimension-level scoring showed more variability in reliability estimates.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion:<\/jats:title>\n                    <jats:p>Training supported raters with and without content expertise in developing a shared mental model of CJS. Future work should replicate these findings with larger samples for more confidence in results and examine convergent validity by comparing ratings to external benchmarks.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3928\/01484834-20260820-01","type":"journal-article","created":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T17:30:47Z","timestamp":1791221447000},"page":"1-4","source":"Crossref","is-referenced-by-count":0,"title":["Supporting Reliable Assessment of Clinical Judgment Skills in Simulation Environments"],"prefix":"10.3928","author":[{"given":"Megan","family":"Stuhlman","sequence":"first","affiliation":[{"name":"Carolinas Simulation Center, Atrium Health"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Darla S.","family":"Morton","sequence":"additional","affiliation":[{"name":"Carolinas Simulation Center, Atrium Health"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy","family":"Smith","sequence":"additional","affiliation":[{"name":"Carolinas College of Health Sciences, Charlotte, North Carolina."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Noble","sequence":"additional","affiliation":[{"name":"Carolinas Simulation Center, Atrium Health"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Crystal","family":"Bencken","sequence":"additional","affiliation":[{"name":"Carolinas Simulation Center, Atrium Health"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cherice","family":"Avila","sequence":"additional","affiliation":[{"name":"Carolinas Simulation Center, Atrium Health"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pamela D.","family":"Buck","sequence":"additional","affiliation":[{"name":"Carolinas Simulation Center, Atrium Health"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stacy S.","family":"Capel","sequence":"additional","affiliation":[{"name":"Carolinas Simulation Center, Atrium Health"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kendra","family":"Mickens","sequence":"additional","affiliation":[{"name":"Carolinas Simulation Center, Atrium Health"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catherine B.","family":"Trent","sequence":"additional","affiliation":[{"name":"Carolinas Simulation Center, Atrium Health"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2308","published-online":{"date-parts":[[2026,10,5]]},"reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"publisher","DOI":"10.3928\/01484834-20111130-03"},{"key":"e_1_3_2_3_1","doi-asserted-by":"publisher","DOI":"10.5480\/1536-5026-33.5.334"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1108"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.3390\/ijerph19020936"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1097\/NNE.0000000000000672"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1037\/1040-3590.7.3.309"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/chp.21270"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1002\/chp.21156"},{"key":"e_1_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.20982\/tqmp.08.1.p023"},{"key":"e_1_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.NEP.0000000000001399"},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.26603\/001c.25793"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.NEP.0000000000000619"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.NEP.0000000000000114"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/ets2.12152"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.4135\/9781071878781.n13"},{"key":"e_1_3_2_18_1","first-page":"264","volume-title":"Handbook of Survey Research","author":"Krosnick J. A.","year":"2010","unstructured":"Krosnick, J. A., & Presser, A. (2010). Question and questionnaire design. In Marsden P. V. & Wright J. D. (Eds.), Handbook of Survey Research (2nd ed., pp. 264\u2013313). Elsevier Inc.","edition":"2"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.3928\/01484834-20071101-04"},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.3928\/01484834-20240108-05"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1186\/s41077-023-00268-x"},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.70106"},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.7275\/q7rm-gg74"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0001-6918(99)00050-5"},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0222694"},{"issue":"3","key":"e_1_3_2_26_1","first-page":"20","article-title":"Evaluation of inter-rater agreement and inter-rater reliability for observational data: An overview of concepts and methods","volume":"41","author":"Shweta, Bajpai R.C.","year":"2015","unstructured":"Shweta, Bajpai R.C., & Chaturvedi, H. K. (2015). Evaluation of inter-rater agreement and inter-rater reliability for observational data: An overview of concepts and methods. Journal of the Indian Academy of Applied Psychology, 41(3), 20\u201327. https:\/\/www.jiaap.in\/public\/index.php\/blog\/evaluation-of-inter-rater-agreement-and-inter-rater-reliability-for-observational-data-an-overview-of-concepts-and-methods","journal-title":"Journal of the Indian Academy of Applied Psychology"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pecinn.2025.100433"},{"key":"e_1_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.3928\/01484834-20060601-04"}],"container-title":["Journal of Nursing Education"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T17:30:48Z","timestamp":1791221448000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.healio.com\/doi\/10.3928\/01484834-20260820-01"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,5]]},"references-count":27,"alternative-id":["10.3928\/01484834-20260820-01"],"URL":"https:\/\/doi.org\/10.3928\/01484834-20260820-01","relation":{},"ISSN":["0148-4834","1938-2421"],"issn-type":[{"value":"0148-4834","type":"print"},{"value":"1938-2421","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,5]]}}}