{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T14:09:42Z","timestamp":1786975782150,"version":"build-2736575974"},"reference-count":49,"publisher":"American Medical Association (AMA)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Netw Open"],"abstract":"\n Importance<\/jats:title>\n Radiotherapy (RT) plan quality is an established predictive factor associated with cancer recurrence and survival outcomes. The addition of radiologists to the peer review (PR) process may increase RT plan quality.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n To determine the rate of changes to the RT plan with and without radiology involvement in PR of radiation targets.<\/jats:p>\n <\/jats:sec>\n \n Data Sources<\/jats:title>\n PubMed, Scopus, and Web of Science were queried for peer-reviewed articles published from inception up to March 6, 2024. Search terms included key words associated with PR of contoured targets for the purposes of RT planning with or without radiology involvement.<\/jats:p>\n <\/jats:sec>\n \n Study Selection<\/jats:title>\n Studies reporting PR of contoured radiation targets with or without radiology involvement. Studies were excluded if they lacked full text, reported clinical trial\u2013specific quality assurance, or reported PR without dedicated review of RT targets.<\/jats:p>\n <\/jats:sec>\n \n Data Extraction and Synthesis<\/jats:title>\n Data were extracted according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Titles and abstracts were screened by 2 reviewers. In the case of discordance, discussion was used to reach consensus regarding inclusion for full-text review. RT plan changes were characterized as major when the change was expected to have a substantial clinical impact, as defined by the original study. Pooled outcomes were estimated using random-effects models.<\/jats:p>\n <\/jats:sec>\n \n Main Outcomes and Measures<\/jats:title>\n Primary outcome was pooled rate of RT plan changes. Secondary outcomes included pooled rates of major and minor changes to RT targets or organs at risk.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n Of 4185 screened studies, 31 reporting 39\u202f509 RT plans were included (390 with radiology and 39\u202f119 without). The pooled rate of plan changes was 29.0% (95% CI, 20.7%-37.2%). Radiologist participation in PR was associated with significant increases in plan change rates (49.4% [95% CI, 28.6%-70.1%] vs 25.0% [95% CI, 17.0%-33.1%];\n P<\/jats:italic>\n \u2009=\u2009.02) and in clinically relevant major changes (47.0% [95% CI, 34.1%-59.8%] vs 10.2% [95% CI, 4.6%-15.8%];\n P<\/jats:italic>\n \u2009&amp;lt;\u2009.001). There was no difference in minor changes (15.2% [95% CI, 9.7%-20.6%] vs 13.8% [95% CI, 9.3%-18.3%];\n P<\/jats:italic>\n \u2009=\u2009.74). Subgroup analyses identified increases in the rates of changes to the gross tumor and planning target volumes with radiology-based PR. The highest rates of plan changes were observed in head and neck or lung cancer studies, studies performing PR prior to RT planning, and prospective studies.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions and Relevance<\/jats:title>\n In this systematic review and meta-analysis of radiation oncology PR of contoured targets, radiologist involvement in peer review was associated with a significant increase in the rate of total and clinically meaningful changes to the RT targets with no change in minor change rates. These results support the value of interdisciplinary collaboration with radiology during RT planning.<\/jats:p>\n <\/jats:sec>","DOI":"10.1001\/jamanetworkopen.2024.52667","type":"journal-article","created":{"date-parts":[[2024,12,27]],"date-time":"2024-12-27T11:31:13Z","timestamp":1735299073000},"page":"e2452667","source":"Crossref","is-referenced-by-count":5,"title":["Radiologist Involvement in Radiation Oncology Peer Review"],"prefix":"10.1001","volume":"7","author":[{"given":"Ryan T.","family":"Hughes","sequence":"first","affiliation":[{"name":"Department of Radiation Oncology, Wake Forest University School of Medicine, Winston-Salem, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niema B.","family":"Razavian","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, Wake Forest University School of Medicine, Winston-Salem, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sydney","family":"Smith","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"suffix":"Jr","given":"Ralph B.","family":"D\u2019Agostino","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Data Science, Wake Forest University School of Medicine, Winston-Salem, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul M.","family":"Bunch","sequence":"additional","affiliation":[{"name":"Department of Radiology, Wake Forest University School of Medicine, Winston-Salem, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Janardhana","family":"Ponnatapura","sequence":"additional","affiliation":[{"name":"Department of Radiology, Wake Forest University School of Medicine, Winston-Salem, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Trevor J.","family":"Royce","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, Wake Forest University School of Medicine, Winston-Salem, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James D.","family":"Ververs","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, Wake Forest University School of Medicine, Winston-Salem, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chandylen L.","family":"Nightingale","sequence":"additional","affiliation":[{"name":"Department of Social Sciences and Health Policy, Wake Forest University School of Medicine, Winston-Salem, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kathryn E.","family":"Weaver","sequence":"additional","affiliation":[{"name":"Department of Social Sciences and Health Policy, Wake Forest University School of Medicine, Winston-Salem, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael K.","family":"Farris","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, Wake Forest University School of Medicine, Winston-Salem, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","published-online":{"date-parts":[[2024,12,27]]},"reference":[{"issue":"3","key":"zoi241467r1","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1016\/j.prro.2012.11.010","article-title":"Enhancing the role of case-oriented peer review to improve quality and safety in radiation oncology: executive summary.","volume":"3","author":"Marks","year":"2013","journal-title":"Pract Radiat Oncol"},{"issue":"3","key":"zoi241467r2","doi-asserted-by":"publisher","first-page":"590","DOI":"10.1016\/j.ijrobp.2012.01.029","volume":"84","author":"Lawrence","year":"2012","journal-title":"Int J Radiat Oncol Biol Phys"},{"issue":"12","key":"zoi241467r3","doi-asserted-by":"publisher","first-page":"2341","DOI":"10.1007\/s12094-020-02394-8","article-title":"100% Peer review in radiation oncology: is it feasible?","volume":"22","author":"Martin-Garcia","year":"2020","journal-title":"Clin Transl Oncol"},{"key":"zoi241467r4","doi-asserted-by":"publisher","DOI":"10.1200\/JOP.2015.006882","author":"Reddeman","year":"2016","journal-title":"J Oncol Pract"},{"issue":"5","key":"zoi241467r5","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1016\/j.prro.2020.05.012","article-title":"A blinded, prospective study of error detection during physician chart rounds in radiation oncology.","volume":"10","author":"Talcott","year":"2020","journal-title":"Pract Radiat Oncol"},{"issue":"1","key":"zoi241467r6","doi-asserted-by":"publisher","first-page":"34","DOI":"10.14338\/IJPT-19-00059.1","article-title":"Development of a comprehensive, contour-based, peer review workflow at a community proton center.","volume":"7","author":"Cooper","year":"2020","journal-title":"Int J Part Ther"},{"issue":"1","key":"zoi241467r7","doi-asserted-by":"publisher","first-page":"60","DOI":"10.3857\/roj.2019.00080","article-title":"Enhancing value of quality assurance rounds in improving radiotherapy management: a retrospective analysis from King Hussein Cancer Center in Jordan.","volume":"37","author":"Khader","year":"2019","journal-title":"Radiat Oncol J"},{"issue":"1043","key":"zoi241467r8","doi-asserted-by":"publisher","DOI":"10.1259\/bjr.20140422","article-title":"Impact of the introduction of weekly radiotherapy quality assurance meetings at one UK cancer centre.","volume":"87","author":"Brammer","year":"2014","journal-title":"Br J Radiol"},{"issue":"1","key":"zoi241467r9","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1016\/j.prro.2016.08.011","article-title":"Detailed prospective peer review in a community radiation oncology clinic.","volume":"7","author":"Mitchell","year":"2017","journal-title":"Pract Radiat Oncol"},{"issue":"4","key":"zoi241467r10","doi-asserted-by":"publisher","first-page":"e325","DOI":"10.1016\/j.prro.2023.01.003","article-title":"A decade of prospective peer review: impact on safety culture and lessons learned in a multicenter radiation medicine department.","volume":"13","author":"Tchelebi","year":"2023","journal-title":"Pract Radiat Oncol"},{"key":"zoi241467r11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1200\/JGO.19.00039","article-title":"Impact of peer review in the radiation treatment planning process: experience of a tertiary care university hospital in Pakistan.","volume":"5","author":"Qureshi","year":"2019","journal-title":"J Glob Oncol"},{"issue":"4","key":"zoi241467r12","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1007\/s13187-018-1357-1","article-title":"Assessment of radiology training during radiation oncology residency.","volume":"34","author":"Matalon","year":"2019","journal-title":"J Cancer Educ"},{"issue":"2","key":"zoi241467r13","doi-asserted-by":"publisher","first-page":"192","DOI":"10.3174\/ajnr.A7773","article-title":"The impact of interactive MRI-based radiologist review on radiotherapy target volume delineation in head and neck cancer.","volume":"44","author":"Adjogatse","year":"2023","journal-title":"AJNR Am J Neuroradiol"},{"issue":"1","key":"zoi241467r14","doi-asserted-by":"publisher","first-page":"146","DOI":"10.3174\/ajnr.A4963","article-title":"Impact of neuroradiology-based peer review on head and neck radiotherapy target delineation.","volume":"38","author":"Braunstein","year":"2017","journal-title":"AJNR Am J Neuroradiol"},{"issue":"1130","key":"zoi241467r15","doi-asserted-by":"publisher","DOI":"10.1259\/bjr.20211219","article-title":"The quantitative impact of joint peer review with a specialist radiologist in head and neck cancer radiotherapy planning.","volume":"95","author":"Chiu","year":"2022","journal-title":"Br J Radiol"},{"issue":"10","key":"zoi241467r16","doi-asserted-by":"publisher","first-page":"630","DOI":"10.1016\/j.clon.2014.04.030","article-title":"Incorporating a radiologist in a radiation oncology department: a new model of care?","volume":"26","author":"Dimigen","year":"2014","journal-title":"Clin Oncol (R Coll Radiol)"},{"issue":"11","key":"zoi241467r17","doi-asserted-by":"publisher","first-page":"2566","DOI":"10.1016\/j.acra.2023.01.019","article-title":"Bridging the communication gaps: a prospective single-arm pilot study testing the feasibility of interdisciplinary radiotherapy planning in locally advanced lung cancer.","volume":"30","author":"Farris","year":"2023","journal-title":"Acad Radiol"},{"issue":"1143","key":"zoi241467r18","doi-asserted-by":"publisher","DOI":"10.1259\/bjr.20210238","article-title":"The impact of neuroradiology collaboration in head and neck cancer radiotherapy peer review.","volume":"96","author":"Gatfield","year":"2023","journal-title":"Br J Radiol"},{"issue":"3","key":"zoi241467r19","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1016\/j.ijrobp.2016.11.050","article-title":"Multi-institutional randomized trial testing the utility of an interactive three-dimensional contouring atlas among radiation oncology residents.","volume":"98","author":"Gillespie","year":"2017","journal-title":"Int J Radiat Oncol Biol Phys"},{"issue":"1","key":"zoi241467r20","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.radonc.2017.10.016","article-title":"Delineation of the primary tumour clinical target volumes (CTV-P) in laryngeal, hypopharyngeal, oropharyngeal and oral cavity squamous cell carcinoma: AIRO, CACA, DAHANCA, EORTC, GEORCC, GORTEC, HKNPCSG, HNCIG, IAG-KHT, LPRHHT, NCIC CTG, NCRI, NRG Oncology, PHNS, SBRT, SOMERA, SRO, SSHNO, TROG consensus guidelines.","volume":"126","author":"Gr\u00e9goire","year":"2018","journal-title":"Radiother Oncol"},{"issue":"1","key":"zoi241467r21","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/S0167-8140(01)00444-3","article-title":"Conformal radiotherapy for lung cancer: different delineation of the gross tumor volume (GTV) by radiologists and radiation oncologists.","volume":"62","author":"Giraud","year":"2002","journal-title":"Radiother Oncol"},{"issue":"160","key":"zoi241467r22","doi-asserted-by":"publisher","first-page":"n160","DOI":"10.1136\/bmj.n160","article-title":"PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews.","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"issue":"9","key":"zoi241467r23","doi-asserted-by":"publisher","first-page":"712","DOI":"10.1046\/j.1445-2197.2003.02748.x","article-title":"Methodological index for non-randomized studies (minors): development and validation of a new instrument.","volume":"73","author":"Slim","year":"2003","journal-title":"ANZ J Surg"},{"issue":"7109","key":"zoi241467r24","doi-asserted-by":"publisher","first-page":"629","DOI":"10.1136\/bmj.315.7109.629","article-title":"Bias in meta-analysis detected by a simple, graphical test.","volume":"315","author":"Egger","year":"1997","journal-title":"BMJ"},{"key":"zoi241467r26","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v036.i03","author":"Viechtbauer","year":"2010","journal-title":"J Stat Software"},{"issue":"8","key":"zoi241467r27","doi-asserted-by":"publisher","first-page":"1603","DOI":"10.1002\/hed.24800","article-title":"Prospective analysis of radiation oncology image and plan-driven peer review for head and neck cancer.","volume":"39","author":"Zairis","year":"2017","journal-title":"Head Neck"},{"issue":"10","key":"zoi241467r28","doi-asserted-by":"publisher","first-page":"e1","DOI":"10.1016\/j.clon.2019.06.010","article-title":"Quality assurance peer review for radiotherapy for haematological malignancies.","volume":"31","author":"Samuel","year":"2019","journal-title":"Clin Oncol (R Coll Radiol)"},{"issue":"9","key":"zoi241467r29","doi-asserted-by":"publisher","first-page":"514","DOI":"10.1016\/j.clon.2015.05.010","article-title":"The impact of colleague peer review on the radiotherapy treatment planning process in the radical treatment of lung cancer.","volume":"27","author":"Rooney","year":"2015","journal-title":"Clin Oncol (R Coll Radiol)"},{"issue":"6","key":"zoi241467r30","doi-asserted-by":"publisher","first-page":"344","DOI":"10.1016\/j.clon.2019.03.001","article-title":"Quality assurance peer review of head and neck contours in a large cancer centre via a weekly meeting approach.","volume":"31","author":"Ramasamy","year":"2019","journal-title":"Clin Oncol (R Coll Radiol)"},{"issue":"6","key":"zoi241467r31","doi-asserted-by":"publisher","DOI":"10.1016\/j.adro.2021.100766","article-title":"Analysis of virtual versus in-person prospective peer review workflow in a multisite academic radiation oncology department.","volume":"6","author":"McClelland","year":"2021","journal-title":"Adv Radiat Oncol"},{"issue":"2","key":"zoi241467r32","doi-asserted-by":"publisher","first-page":"e39","DOI":"10.1016\/j.prro.2015.09.009","article-title":"Enhancing safety and quality through preplanning peer review for patients undergoing stereotactic body radiation therapy.","volume":"6","author":"Matuszak","year":"2016","journal-title":"Pract Radiat Oncol"},{"issue":"12","key":"zoi241467r33","doi-asserted-by":"publisher","first-page":"e192","DOI":"10.1016\/j.clon.2016.08.012","article-title":"Peer review of radiotherapy planning: quantifying outcomes and a proposal for prospective data collection.","volume":"28","author":"Mackenzie","year":"2016","journal-title":"Clin Oncol (R Coll Radiol)"},{"issue":"1","key":"zoi241467r34","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.radonc.2014.11.042","article-title":"Predictors of breast radiotherapy plan modifications: quality assurance rounds in a large cancer centre.","volume":"114","author":"Lymberiou","year":"2015","journal-title":"Radiother Oncol"},{"key":"zoi241467r35","doi-asserted-by":"publisher","DOI":"10.1017\/S1460396922000152","article-title":"Peer review quality assurance in stereotactic body radiotherapy planning: the impact of case volume.","volume":"22","author":"Huo","year":"2022","journal-title":"J Radiother Pract"},{"issue":"3","key":"zoi241467r36","doi-asserted-by":"publisher","DOI":"10.1016\/j.adro.2022.100917","article-title":"Peer review of head and neck cancer planning target volumes in radiation oncology.","volume":"7","author":"Hesse","year":"2022","journal-title":"Adv Radiat Oncol"},{"issue":"3","key":"zoi241467r37","doi-asserted-by":"publisher","first-page":"e205","DOI":"10.1016\/j.prro.2023.12.012","article-title":"Systematic implementation of effective quality assurance processes for the assessment of radiation target volumes in head and neck cancer.","volume":"14","author":"Gogineni","year":"2024","journal-title":"Pract Radiat Oncol"},{"issue":"12","key":"zoi241467r38","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1016\/j.clon.2017.09.005","article-title":"Implementing head and neck contouring peer review without pathway delay: the on-demand approach.","volume":"29","author":"Fong","year":"2017","journal-title":"Clin Oncol (R Coll Radiol)"},{"issue":"3","key":"zoi241467r39","doi-asserted-by":"publisher","first-page":"422","DOI":"10.1111\/1754-9485.13031","article-title":"Quality and access\u2014early experience of implementing a virtual stereotactic chart round across a national network.","volume":"64","author":"Fitzgerald","year":"2020","journal-title":"J Med Imaging Radiat Oncol"},{"issue":"3","key":"zoi241467r40","doi-asserted-by":"publisher","first-page":"532","DOI":"10.1016\/j.ijrobp.2016.11.019","article-title":"Prospective qualitative and quantitative analysis of real-time peer review quality assurance rounds incorporating direct physical examination for head and neck cancer radiation therapy.","volume":"98","author":"Cardenas","year":"2017","journal-title":"Int J Radiat Oncol Biol Phys"},{"issue":"1155","key":"zoi241467r41","doi-asserted-by":"publisher","first-page":"680","DOI":"10.1093\/bjr\/tqae019","article-title":"Enhancing quality assurance in radiotherapy for gynaecological cancers: implementation of an on-demand peer review process.","volume":"97","author":"Bhattacharyya","year":"2024","journal-title":"Br J Radiol"},{"issue":"5","key":"zoi241467r42","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.prro.2013.11.004","article-title":"Prospective peer review quality assurance for outpatient radiation therapy.","volume":"4","author":"Ballo","year":"2014","journal-title":"Pract Radiat Oncol"},{"issue":"3","key":"zoi241467r43","doi-asserted-by":"publisher","DOI":"10.1016\/j.adro.2023.101406","article-title":"Implementation of a novel chart rounds application to facilitate peer review in a virtual academic environment.","volume":"9","author":"Ali","year":"2023","journal-title":"Adv Radiat Oncol"},{"key":"zoi241467r44","doi-asserted-by":"publisher","DOI":"10.1017\/S1460396922000309","author":"Farris","year":"2022","journal-title":"J Radiother Pract"},{"key":"zoi241467r45","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijrobp.2013.03.036","author":"Fairchild","year":"2013","journal-title":"Int J Radiat Oncol Biol Phys"},{"issue":"6","key":"zoi241467r46","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1093\/jnci\/djt001","article-title":"Radiotherapy protocol deviations and clinical outcomes: a meta-analysis of cooperative group clinical trials.","volume":"105","author":"Ohri","year":"2013","journal-title":"J Natl Cancer Inst"},{"issue":"2","key":"zoi241467r47","doi-asserted-by":"publisher","DOI":"10.1148\/rycan.2021200075","article-title":"A framework for sharing radiation dose distribution maps in the electronic medical record for improving multidisciplinary patient management.","volume":"3","author":"Savjani","year":"2021","journal-title":"Radiol Imaging Cancer"},{"issue":"6","key":"zoi241467r48","doi-asserted-by":"publisher","first-page":"e512","DOI":"10.1016\/j.prro.2022.06.007","article-title":"Feasibility and clinical utility of a workflow interfacing radiation oncology lung stereotactic body radiation therapy treatment planning and diagnostic radiology.","volume":"12","author":"Hutten","year":"2022","journal-title":"Pract Radiat Oncol"},{"issue":"3","key":"zoi241467r49","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1067\/j.cpradiol.2019.02.009","article-title":"Bridging the radiation oncology and diagnostic radiology communication gap: a survey to determine usefulness and optimal presentation of radiotherapy treatment plans for radiologists.","volume":"49","author":"Schaub","year":"2020","journal-title":"Curr Probl Diagn Radiol"},{"key":"zoi241467r25","unstructured":"R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing; 2022. Accessed June 19, 2024. https:\/\/www.R-project.org\/"}],"container-title":["JAMA Network Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/articlepdf\/2828498\/hughes_2024_oi_241467_1734628362.53789.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,27]],"date-time":"2024-12-27T11:31:16Z","timestamp":1735299076000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamanetworkopen\/fullarticle\/2828498"}},"subtitle":["A Systematic Review and Meta-Analysis"],"short-title":[],"issued":{"date-parts":[[2024,12,27]]},"references-count":49,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2024,12,2]]}},"URL":"https:\/\/doi.org\/10.1001\/jamanetworkopen.2024.52667","relation":{},"ISSN":["2574-3805"],"issn-type":[{"value":"2574-3805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,27]]}}}