{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,10]],"date-time":"2026-11-10T16:41:41Z","timestamp":1794328901169,"version":"4.9.0"},"reference-count":31,"publisher":"Public Library of Science (PLoS)","issue":"5","license":[{"start":{"date-parts":[[2025,5,9]],"date-time":"2025-05-09T00:00:00Z","timestamp":1746748800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS One"],"abstract":"<jats:p>The purpose of this study was to examine the reliability and agreement between human raters (novice, intermediate, and expert) and TuMeke Risk Suite when assessing work with the Rapid Entire Body Assessment (REBA). Twenty-one videos portraying veterinarians performing an equine radiograph were assessed with REBA by human raters and TuMeke Risk Suite (ergonomic artificial intelligence software). Intra-rater reliability of the final REBA score was highest for TuMeke Risk Suite (ICC\u2009=\u20091.0), then the expert rater (ICC\u2009=\u20090.89 (0.78\u20130.95)), and lowest for the novice rater (ICC\u2009=\u20090.51 (0.25\u20130.74)). Agreement between the expert rater and TuMeke Risk Suite was highest for scores of the trunk, leg, and upper arm, and lowest for the neck, wrist, and lower arm. The REBA tool in TuMeke Risk Suite may be of benefit to less experienced users to enhance reliability of their REBA assessments, especially when the trunk, legs, and upper arm are of primary interest.<\/jats:p>","DOI":"10.1371\/journal.pone.0323262","type":"journal-article","created":{"date-parts":[[2025,5,9]],"date-time":"2025-05-09T13:29:05Z","timestamp":1746797345000},"page":"e0323262","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":8,"title":["Reliability and agreement during the Rapid Entire Body Assessment: Comparing rater expertise and artificial intelligence"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-8812-5792","authenticated-orcid":true,"given":"Denise","family":"Balogh","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoxiao","family":"Cui","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Monique","family":"Mayer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niels","family":"Koehncke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ryan","family":"Dueck","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3952-1140","authenticated-orcid":true,"given":"Angelica E.","family":"Lang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2025,5,9]]},"reference":[{"issue":"2","key":"pone.0323262.ref001","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/0003-6870(93)90080-S","article-title":"RULA: a survey method for the investigation of work-related upper limb disorders","volume":"24","author":"L McAtamney","year":"1993","journal-title":"Appl Ergon"},{"key":"pone.0323262.ref002","volume-title":"Applications manual for the revised NIOSH lifting equation","author":"TR Waters","year":"1994"},{"issue":"3","key":"pone.0323262.ref003","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/0003-6870(95)00078-X","article-title":"PATH: a work sampling-based approach to ergonomic job analysis for construction and other non-repetitive work","volume":"27","author":"B Buchholz","year":"1996","journal-title":"Appl Ergon"},{"issue":"1","key":"pone.0323262.ref004","doi-asserted-by":"crossref","first-page":"107","DOI":"10.3844\/ajeassp.2016.107.118","article-title":"Rapid Entire Body Assessment: A Literature Review","volume":"9","author":"DA Madani","year":"2016","journal-title":"Am J Eng Appl Sci"},{"issue":"7","key":"pone.0323262.ref005","doi-asserted-by":"crossref","first-page":"912","DOI":"10.1080\/00140139.2016.1237678","article-title":"The Revised Strain Index: an improved upper extremity exposure assessment model","volume":"60","author":"A Garg","year":"2017","journal-title":"Ergonomics"},{"issue":"2","key":"pone.0323262.ref006","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/S0003-6870(99)00039-3","article-title":"Rapid entire body assessment (REBA)","volume":"31","author":"S Hignett","year":"2000","journal-title":"Appl Ergon"},{"issue":"8","key":"pone.0323262.ref007","doi-asserted-by":"crossref","first-page":"2635","DOI":"10.3390\/ijerph17082635","article-title":"An Overview of REBA Method Applications in the World","volume":"17","author":"M Hita-Guti\u00e9rrez","year":"2020","journal-title":"Int J Environ Res Public Health"},{"key":"pone.0323262.ref008","doi-asserted-by":"crossref","first-page":"102882","DOI":"10.1016\/j.apergo.2019.102882","article-title":"Ergonomics assessment methods used by ergonomics professionals","volume":"81","author":"BD Lowe","year":"2019","journal-title":"Appl Ergon"},{"key":"pone.0323262.ref009","article-title":"Application of the Rapid Entire Body Assessment (REBA) in assessing chairside ergonomic risk of dental students","author":"V Raman","year":"2020","journal-title":"Br Dent J"},{"key":"pone.0323262.ref010","first-page":"717","article-title":"A postural risk assessment of manual dairy farm workers using REBA technique","author":"U Gurnani","year":"2023","journal-title":"Advances in Modelling and Optimization of Manufacturing and Industrial Systems"},{"issue":"1","key":"pone.0323262.ref011","first-page":"219","article-title":"The Ergonomic Assessment of Cycle Rickshaw Operators Using Rapid Upper Limb Assessment (Rula) Tool and Rapid Entire Body Assessment (Reba) Tool","volume":"1","author":"MS Gorde","year":"2019","journal-title":"Syst Safety"},{"issue":"3","key":"pone.0323262.ref012","doi-asserted-by":"crossref","DOI":"10.1016\/j.apmr.2022.12.076","article-title":"Ergonomic Assessment of Surgical Residents Using the Rapid Upper Limb and Rapid Entire Body Assessments","volume":"104","author":"N Monagle","year":"2023","journal-title":"Arch Phys Med Rehabil"},{"key":"pone.0323262.ref013","doi-asserted-by":"crossref","first-page":"103218","DOI":"10.1016\/j.ergon.2021.103218","article-title":"Development of a fully automated RULA assessment system based on computer vision","volume":"86","author":"GK Nayak","year":"2021","journal-title":"Int J Ind Ergon"},{"key":"pone.0323262.ref014","doi-asserted-by":"crossref","first-page":"106816","DOI":"10.1016\/j.cie.2020.106816","article-title":"Ergonomic risk assessment based on computer vision and machine learning","volume":"149","author":"M MassirisFern\u00e1ndez","year":"2020","journal-title":"Comput Ind Eng"},{"key":"pone.0323262.ref015","year":"2024"},{"issue":"09","key":"pone.0323262.ref016","article-title":"Ergonomic Assessment Method of Risk Factors for Musculoskeletal Disorders Associated with Sitting Postures","volume":"36","author":"J Li","year":"2022","journal-title":"Int J Patt Recogn Artif Intell"},{"key":"pone.0323262.ref017","year":"2024"},{"key":"pone.0323262.ref018","author":"Professional certification","year":"2024"},{"issue":"2","key":"pone.0323262.ref019","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/S0003-6870(97)00018-5","article-title":"The ability of non-ergonomists in the health care setting to make manual handling risk assessments and implement changes","volume":"30","author":"JA Jones","year":"1999","journal-title":"Appl Ergon"},{"issue":"5","key":"pone.0323262.ref020","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1016\/S0003-6870(03)00067-X","article-title":"Giving ergonomics away? The application of ergonomics methods by novices","volume":"34","author":"NA Stanton","year":"2003","journal-title":"Appl Ergon"},{"issue":"8","key":"pone.0323262.ref021","doi-asserted-by":"crossref","first-page":"1219","DOI":"10.1080\/00140130802087094","article-title":"The Cochran-Weiss-Shanteau performance index as an indicator of upper limb risk assessment expertise","volume":"51","author":"CA Williams","year":"2008","journal-title":"Ergonomics"},{"key":"pone.0323262.ref022","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.apergo.2015.11.021","article-title":"Evaluating the ability of novices to identify and quantify physical demand elements following an introductory education session: A pilot study","volume":"54","author":"B Coffey","year":"2016","journal-title":"Appl Ergon"},{"issue":"2","key":"pone.0323262.ref023","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research","volume":"15","author":"TK Koo","year":"2016","journal-title":"J Chiropr Med"},{"issue":"9","key":"pone.0323262.ref024","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1016\/j.theriogenology.2010.01.003","article-title":"Method agreement analysis: a review of correct methodology","volume":"73","author":"PF Watson","year":"2010","journal-title":"Theriogenology"},{"issue":"1","key":"pone.0323262.ref025","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The Measurement of Observer Agreement for Categorical Data","volume":"33","author":"JR Landis","year":"1977","journal-title":"Biometrics"},{"key":"pone.0323262.ref026","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.ergon.2019.02.010","article-title":"Intra-rater and inter-rater reliability of the rapid entire body assessment (REBA) tool","volume":"71","author":"AH Schwartz","year":"2019","journal-title":"Int J Ind Ergon"},{"issue":"3","key":"pone.0323262.ref027","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1590\/bjpt-rbf.2014.0035","article-title":"Translation, cross-cultural adaptation to Brazilian- Portuguese and reliability analysis of the instrument Rapid Entire Body Assessment-REBA","volume":"18","author":"AM Lamar\u00e3o","year":"2014","journal-title":"Braz J Phys Ther"},{"key":"pone.0323262.ref028","doi-asserted-by":"crossref","first-page":"161","DOI":"10.37268\/mjphm\/vol.20\/no.Special1\/art.707","article-title":"Validity and inter-rater reliability of postural analysis among new raters","volume":"20","author":"A Widyanti","year":"2020","journal-title":"Malays J Public Health Med"},{"issue":"7","key":"pone.0323262.ref029","doi-asserted-by":"crossref","first-page":"1284","DOI":"10.1177\/0018720820923839","article-title":"Wrist Posture Estimation Differences and Reliability Between Video Analysis and Electrogoniometer Methods","volume":"63","author":"CD McKinnon","year":"2021","journal-title":"Hum Factors"},{"issue":"3","key":"pone.0323262.ref030","doi-asserted-by":"crossref","first-page":"719","DOI":"10.3390\/s18030719","article-title":"Inertial Measurement Units for Clinical Movement Analysis: Reliability and Concurrent Validity","volume":"18","author":"M Al-Amri","year":"2018","journal-title":"Sensors (Basel)"},{"issue":"4","key":"pone.0323262.ref031","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1519\/JSC.0b013e3182606df2","article-title":"Interrater and intrarater reliability of the functional movement screen","volume":"27","author":"CA Smith","year":"2013","journal-title":"J Strength Cond Res"}],"container-title":["PLOS One"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0323262","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,9]],"date-time":"2025-05-09T13:29:13Z","timestamp":1746797353000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0323262"}},"subtitle":[],"editor":[{"given":"Hamed","family":"Aghaei","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2025,5,9]]},"references-count":31,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,5,9]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0323262","relation":{"has-part":[{"id-type":"doi","id":"https:\/\/doi.org\/10.1371\/journal.pone.0323262.g001","asserted-by":"subject"},{"id-type":"doi","id":"https:\/\/doi.org\/10.1371\/journal.pone.0323262.g002","asserted-by":"subject"},{"id-type":"doi","id":"https:\/\/doi.org\/10.1371\/journal.pone.0323262.t001","asserted-by":"subject"},{"id-type":"doi","id":"https:\/\/doi.org\/10.1371\/journal.pone.0323262.t002","asserted-by":"subject"},{"id-type":"doi","id":"https:\/\/doi.org\/10.1371\/journal.pone.0323262.t003","asserted-by":"subject"},{"id-type":"doi","id":"https:\/\/doi.org\/10.1371\/journal.pone.0323262.t004","asserted-by":"subject"},{"id-type":"doi","id":"https:\/\/doi.org\/10.1371\/journal.pone.0323262.t005","asserted-by":"subject"},{"id-type":"doi","id":"https:\/\/doi.org\/10.1371\/journal.pone.0323262.s001","asserted-by":"subject"},{"id-type":"doi","id":"https:\/\/doi.org\/10.1371\/journal.pone.0323262.s002","asserted-by":"subject"},{"id-type":"doi","id":"https:\/\/doi.org\/10.1371\/journal.pone.0323262.s003","asserted-by":"subject"}]},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,9]]}}}