{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T16:37:47Z","timestamp":1793119067768,"version":"4.5.0"},"reference-count":28,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2021,9,7]],"date-time":"2021-09-07T00:00:00Z","timestamp":1630972800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Contrast-enhanced magnetic resonance imaging (MRI) remains the most comprehensive modality to assess juvenile idiopathic arthritis (JIA)-related inflammation and osteochondral damage in the temporomandibular joints (TMJ). This study tested the reliability of a new JIA MRI scoring system for TMJ (JAMRIS-TMJ) and the impact of variations in calibration and reader specialty. Thirty-one MRI exams of bilateral TMJs were scored independently using the JAMRIS-TMJ by 20 readers consisting of radiologists and non-radiologist clinicians in three reading groups, with or without a calibrating atlas and\/or tutorial. The inter-reader reliability in the multidisciplinary cohort assessed by the generalizability coefficient was 0.61\u20130.67 for the inflammatory and 0.66\u20130.74 for the damage domain. The atlas and tutorial did not improve agreement within radiologists, but improved the agreement between radiologist and non-radiologist groups. Agreements between different calibration levels were 0.02 to 0.08 lower by the generalizability coefficient compared to agreement within calibration levels; agreement between specialty groups was 0.04 to 0.10 lower than within specialty groups. Averaging two radiologists raised the reliability above 0.8 for both domains. Therefore, the reliability of JAMRIS-TMJ was moderate-to-good depending on the presence of specialty and calibration differences. The atlas and tutorial are necessary to improve reliability when the reader cohort consists of multiple specialties.<\/jats:p>","DOI":"10.3390\/jcm10184047","type":"journal-article","created":{"date-parts":[[2021,9,7]],"date-time":"2021-09-07T10:24:25Z","timestamp":1631010265000},"page":"4047","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Assessing the Reliability of the OMERACT Juvenile Idiopathic Arthritis Magnetic Resonance Scoring System for Temporomandibular Joints (JAMRIS-TMJ)"],"prefix":"10.3390","volume":"10","author":[{"given":"Mirkamal","family":"Tolend","sequence":"first","affiliation":[{"name":"Institute of Medical Science, University of Toronto, Toronto, ON M5S 1A8, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea S.","family":"Doria","sequence":"additional","affiliation":[{"name":"Institute of Medical Science, University of Toronto, Toronto, ON M5S 1A8, Canada"},{"name":"Department of Diagnostic Imaging, The Hospital for Sick Children, Toronto, ON M5G 1X8, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arthur B.","family":"Meyers","sequence":"additional","affiliation":[{"name":"Department of Radiology, Cincinnati Children\u2019s Hospital Medical Center, Cincinnati, OH 45229, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tore A.","family":"Larheim","sequence":"additional","affiliation":[{"name":"Department of Maxillofacial Radiology, Institute of Clinical Dentistry, University of Oslo, 0317 Oslo, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shelly","family":"Abramowicz","sequence":"additional","affiliation":[{"name":"Division of Oral and Maxillofacial Surgery, Departments of Surgery and Pediatrics, Emory University School of Medicine, Atlanta, GA 30322, USA"},{"name":"Oral and Maxillofacial Surgery, Children\u2019s Healthcare of Atlanta, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julien","family":"Aguet","sequence":"additional","affiliation":[{"name":"Department of Diagnostic Imaging, The Hospital for Sick Children, Toronto, ON M5G 1X8, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5075-4474","authenticated-orcid":false,"given":"Simone","family":"Appenzeller","sequence":"additional","affiliation":[{"name":"Department of Orthopedics, Rheumatology and Traumatology, School of Medical Science, University of Campinas, Campinas 13083-970, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linda Z.","family":"Arvidsson","sequence":"additional","affiliation":[{"name":"Department of Maxillofacial Radiology, Institute of Clinical Dentistry, University of Oslo, 0317 Oslo, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lauren W.","family":"Averill","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, Nemours Children\u2019s Health System, Alfred I. duPont Hospital for Children, Wilmington, DE 19803, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian M.","family":"Feldman","sequence":"additional","affiliation":[{"name":"Institute of Medical Science, University of Toronto, Toronto, ON M5S 1A8, Canada"},{"name":"Division of Rheumatology, The Hospital for Sick Children, Toronto, ON M5G 1X8, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Saurabh","family":"Guleria","sequence":"additional","affiliation":[{"name":"Austin Radiological Association, Austin, TX 78731, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emilio J.","family":"Inarejos Clemente","sequence":"additional","affiliation":[{"name":"Department of Diagnostic Imaging, Hospital Sant Joan de Deu, 08950 Barcelona, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5314-2297","authenticated-orcid":false,"given":"Jacob L.","family":"Jaremko","sequence":"additional","affiliation":[{"name":"Department of Radiology & Diagnostic Imaging, University of Alberta, Edmonton, AB T6G 2B7, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thitiporn","family":"Junhasavasdikul","sequence":"additional","affiliation":[{"name":"Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok 10400, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thekla","family":"von Kalle","sequence":"additional","affiliation":[{"name":"Department of Pediatric Radiology, Radiologisches Institut, Olgahospital Klinikum Stuttgart, 70174 Stuttgart, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eva","family":"Kirkhus","sequence":"additional","affiliation":[{"name":"Department of Radiology, Oslo University Hospital, 0424 Oslo, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bernd","family":"Koos","sequence":"additional","affiliation":[{"name":"Department of Orthodontics, University Hospital T\u00fcbingen, 72076 T\u00fcbingen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1075-5952","authenticated-orcid":false,"given":"Elka","family":"Miller","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, Children\u2019s Hospital of Eastern Ontario, University of Ottawa, Ottawa, ON K1H 8L1, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5506-084X","authenticated-orcid":false,"given":"Rahim","family":"Moineddin","sequence":"additional","affiliation":[{"name":"Department of Family & Community Medicine, University of Toronto, Toronto, ON M5G 1V7, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jyoti","family":"Panwar","sequence":"additional","affiliation":[{"name":"Department of Radiology, Christian Medical College and Hospital, Vellore 632004, Tamil Nadu, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zachary S.","family":"Peacock","sequence":"additional","affiliation":[{"name":"Department of Oral and Maxillofacial Surgery, Massachusetts General Hospital, Boston, MA 02114, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cory M.","family":"Resnick","sequence":"additional","affiliation":[{"name":"Department of Plastic and Oral Surgery, Boston Children\u2019s Hospital, Boston, MA 02115, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marion A.","family":"van Rossum","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Emma Children\u2019s Hospital, Amsterdam University Medical Center, 1105 AZ Amsterdam, The Netherlands"},{"name":"Amsterdam Rheumatology and Immunology Center, Reade, 1007 MB Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Stimec","sequence":"additional","affiliation":[{"name":"Department of Diagnostic Imaging, The Hospital for Sick Children, Toronto, ON M5G 1X8, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"George","family":"Tomlinson","sequence":"additional","affiliation":[{"name":"Department of Medicine, University Health Network, Toronto, ON M5G 2C4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nikolay","family":"Tzaribachev","sequence":"additional","affiliation":[{"name":"Pediatric Rheumatology Research Institute, 24576 Bad Bramstedt, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9122-2431","authenticated-orcid":false,"given":"Christian J.","family":"Kellenberger","sequence":"additional","affiliation":[{"name":"Department of Diagnostic Imaging, University Children\u2019s Hospital Z\u00fcrich, 8032 Z\u00fcrich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1053\/j.sodo.2015.02.006","article-title":"TMJ Imaging in JIA Patients\u2014An Overview","volume":"21","author":"Larheim","year":"2015","journal-title":"Semin. Orthod."},{"key":"ref_2","first-page":"1925","article-title":"Temporomandibular Joint Arthritis in Juvenile Idiopathic Arthritis: Prevalence, Clinical and Radiological Signs, and Relation to Dentofacial Morphology","volume":"34","author":"Billiau","year":"2007","journal-title":"J. Rheumatol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1002\/art.23401","article-title":"High Prevalence of Temporomandibular Joint Arthritis at Disease Onset in Children with Juvenile Idiopathic Arthritis, as Detected by Magnetic Resonance Imaging but Not by Ultrasound","volume":"58","author":"Weiss","year":"2008","journal-title":"Arthritis Rheum."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"510","DOI":"10.3899\/jrheum.100325","article-title":"Temporomandibular Joint Involvement in Children with Juvenile Idiopathic Arthritis","volume":"38","author":"Cannizzaro","year":"2011","journal-title":"J. Rheumatol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5","DOI":"10.3109\/03009748209098105","article-title":"The Temporomandibular Joint in Juvenile Rheumatoid Arthritis. Radiographic Changes Related to Clinical and Laboratory Parameters in 100 Children","volume":"11","author":"Larheim","year":"1982","journal-title":"Scand. J. Rheumatol."},{"key":"ref_6","first-page":"17","article-title":"Mandibular Condyle Lesions, Jaw Movements, and Occlusal Status in 15-Year-Old Children with Juvenile Rheumatoid Arthritis","volume":"98","author":"Karhulahti","year":"1990","journal-title":"Scand. J. Dent. Res."},{"key":"ref_7","first-page":"83","article-title":"Temporomandibular Disorders in Juvenile Chronic Arthritis Patients. A Clinical Study","volume":"24","author":"Svensson","year":"2000","journal-title":"Swed Dent. J."},{"key":"ref_8","first-page":"1418","article-title":"van Temporomandibular Involvement in Juvenile Idiopathic Arthritis","volume":"31","author":"Twilt","year":"2004","journal-title":"J. Rheumatol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1390","DOI":"10.1002\/art.10986","article-title":"Daily Pain and Symptoms in Children with Polyarticular Arthritis","volume":"48","author":"Schanberg","year":"2003","journal-title":"Arthritis Rheum."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e24","DOI":"10.1542\/pir.27.4.e24","article-title":"Juvenile Idiopathic Arthritis: A Review for the Pediatrician","volume":"27","author":"Goldmuntz","year":"2006","journal-title":"Pediatr. Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"680","DOI":"10.1093\/rheumatology\/kep068","article-title":"Early Diagnosis of Temporomandibular Joint Involvement in Juvenile Idiopathic Arthritis: A Pilot Study Comparing Clinical Examination and Ultrasound to Magnetic Resonance Imaging","volume":"48","author":"Muller","year":"2009","journal-title":"Rheumatology"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1237","DOI":"10.1007\/s10067-019-04731-x","article-title":"Is Power Doppler Ultrasound Useful to Evaluate Temporomandibular Joint Inflammatory Activity in Juvenile Idiopathic Arthritis?","volume":"39","author":"Zwir","year":"2020","journal-title":"Clin. Rheumatol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1111\/joor.12769","article-title":"Temporomandibular Joint Damage in Juvenile Idiopathic Arthritis: Diagnostic Validity of Diagnostic Criteria for Temporomandibular Disorders","volume":"46","author":"Rongo","year":"2019","journal-title":"J. Oral Rehabil."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12969-020-0401-y","article-title":"Quantitative Analysis of Facial Asymmetry Based on Three-Dimensional Photography: A Valuable Indicator for Asymmetrical Temporomandibular Joint Affection in Juvenile Idiopathic Arthritis Patients?","volume":"18","author":"Bernini","year":"2020","journal-title":"Pediatr. Rheumatol. Online J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"909","DOI":"10.3899\/jrheum.190168","article-title":"Magnetic Resonance Imaging Followup of Temporomandibular Joint Inflammation, Deformation, and Mandibular Growth in Juvenile Idiopathic Arthritis Patients Receiving Systemic Treatment","volume":"47","author":"Bollhalder","year":"2020","journal-title":"J. Rheumatol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1002\/acr.23340","article-title":"Toward Establishing a Standardized Magnetic Resonance Imaging Scoring System for Temporomandibular Joints in Juvenile Idiopathic Arthritis","volume":"70","author":"Tolend","year":"2018","journal-title":"Arthritis Care Res."},{"key":"ref_17","unstructured":"Tolend, M., Junhasavasdikul, T., Cron, R.Q., Clemente, E.J.I., von Kalle, T., Kellenberger, C.J., Koos, B., Miller, E., van Rossum, M.A., and Saurenmann, R.K. (2021). Discrete Choice Experiment on a Magnetic Resonance Imaging Scoring System for Temporomandibular Joints in Juvenile Idiopathic Arthritis. Arthritis Care Res."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1028","DOI":"10.3899\/jrheum.181218","article-title":"Instrument Selection Using the OMERACT Filter 2.1: The OMERACT Methodology","volume":"46","author":"Beaton","year":"2019","journal-title":"J. Rheumatol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1007\/s00247-017-4000-0","article-title":"Temporomandibular Joint Atlas for Detection and Grading of Juvenile Idiopathic Arthritis Involvement by Magnetic Resonance Imaging","volume":"48","author":"Kellenberger","year":"2018","journal-title":"Pediatr. Radiol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"960","DOI":"10.3109\/0142159X.2012.703791","article-title":"Generalizability Theory for the Perplexed: A Practical Introduction and Guide: AMEE Guide No. 68","volume":"34","author":"Bloch","year":"2012","journal-title":"Med. Teach."},{"key":"ref_21","unstructured":"Brennan, R.L. (2001). Generalizability Theory, Springer. Statistics for Social and Behavioral Sciences."},{"key":"ref_22","first-page":"1","article-title":"Design Based on Intra-Class Correlation Coefficients","volume":"1","author":"Doros","year":"2010","journal-title":"Am. J. Biostat."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3205","DOI":"10.1002\/sim.935","article-title":"Planning a Reproducibility Study: How Many Subjects and How Many Replicates per Subject for an Expected Width of the 95 per Cent Confidence Interval of the Intraclass Correlation Coefficient","volume":"20","author":"Giraudeau","year":"2001","journal-title":"Stat. Med."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1002\/acr.22177","article-title":"Imaging of the Temporomandibular Joint in Juvenile Idiopathic Arthritis","volume":"66","author":"Vaid","year":"2014","journal-title":"Arthritis Care Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"506","DOI":"10.1007\/s00056-013-0166-8","article-title":"Classification of Temporomandibular Joint Erosion, Arthritis, and Inflammation in Patients with Juvenile Idiopathic Arthritis","volume":"74","author":"Koos","year":"2013","journal-title":"J. Orofac. Orthop."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1937","DOI":"10.1016\/j.joms.2016.03.010","article-title":"Quantifying Synovial Enhancement of the Pediatric Temporomandibular Joint","volume":"74","author":"Peacock","year":"2016","journal-title":"J. Oral Maxillofac. Surg."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2363","DOI":"10.1016\/j.joms.2016.06.189","article-title":"Quantifying the Effect of Temporomandibular Joint Intra-Articular Steroid Injection on Synovial Enhancement in Juvenile Idiopathic Arthritis","volume":"74","author":"Resnick","year":"2016","journal-title":"J. Oral Maxillofac. Surg."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2344","DOI":"10.3174\/ajnr.A5424","article-title":"Optimization of Quantitative Dynamic Postgadolinium MRI Technique Using Normalized Ratios for the Evaluation of Temporomandibular Joint Synovitis in Patients with Juvenile Idiopathic Arthritis","volume":"38","author":"Caruso","year":"2017","journal-title":"Am. J. Neuroradiol."}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/10\/18\/4047\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:58:12Z","timestamp":1760165892000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/10\/18\/4047"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,7]]},"references-count":28,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["jcm10184047"],"URL":"https:\/\/doi.org\/10.3390\/jcm10184047","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,7]]}}}