{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T19:40:16Z","timestamp":1791229216404,"version":"4.1.0"},"reference-count":15,"publisher":"Wiley","issue":"6","license":[{"start":{"date-parts":[[2025,7,5]],"date-time":"2025-07-05T00:00:00Z","timestamp":1751673600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Cytopathology"],"published-print":{"date-parts":[[2025,11]]},"abstract":"<jats:title>ABSTRACT<\/jats:title><jats:sec><jats:title>Objectives<\/jats:title><jats:p>The Peer Review (PR) consists of the daily examination, by all cytologists, of Pap slides that resulted abnormal\/difficult, in order to reach a consensus on the final diagnosis (FD). We explore data from 5\u2009years (2017\u20132021) of PR to: (i) evaluate the agreement (both inter\u2010observer and versus FD) over time; (ii) identify new quality indicators.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>5673 slides were submitted to PR and examined by an average of 8 cytologists (range: 4\u201313). The agreement between cytologists and between the individual diagnosis with FD were evaluated by Kappa (<jats:italic>k<\/jats:italic>) and weighted Kappa (wK) and compared between \u2018experts\u2019 and \u2018less experienced\u2019 readers.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The inter\u2010observer agreement showed a moderate agreement among readers (whole team <jats:italic>k<\/jats:italic>\u2009=\u20090.44; experts <jats:italic>k<\/jats:italic>\u2009=\u20090.48). The highest and the lowest agreement was reported in HSIL and ASC\u2010H, respectively. In 2018 and 2021, a significant reduction of kappa was observed, likely attributable to team turnover. The laboratory agreement versus FD resulted in significantly higher scores in experts (wk\u2009=\u20090.73, 95% CI 0.73\u20130.74) compared to less experienced individuals (wk\u2009=\u20090.65, 95% CI 0.64\u20130.66), with a general reduction of wk recorded in 2021. The individual agreement versus FD (calculated for 16 cytologists) achieved a moderate\/substantial level of agreement (wK range: 0.57\u20130.80), with a shift toward higher wk in experts.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>The levels of agreement are influenced by cytologist experience and team turnover. We propose new potential (key) performance indicators to strictly monitor the occurrence of systematic differences in interpretation criteria among cytologists. The proposed reference values are based on preliminary data and should be validated prospectively over a longer monitoring period.<\/jats:p><\/jats:sec>","DOI":"10.1111\/cyt.70006","type":"journal-article","created":{"date-parts":[[2025,7,5]],"date-time":"2025-07-05T03:03:43Z","timestamp":1751684623000},"page":"558-567","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["From the Daily Peer Review of Abnormal Pap Test Slides to the Monitoring of Individual and Laboratory Performances: 5\u2009Years of Data Collection and New Potential (Key) Performance Indicators"],"prefix":"10.1111","volume":"36","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2155-7436","authenticated-orcid":false,"given":"Claudia","family":"Giachini","sequence":"first","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4365-427X","authenticated-orcid":false,"given":"Giampaolo","family":"Pompeo","sequence":"additional","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3820-4442","authenticated-orcid":false,"given":"Donella","family":"Puliti","sequence":"additional","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1413-5948","authenticated-orcid":false,"given":"Giuseppe","family":"Gorini","sequence":"additional","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6867-0244","authenticated-orcid":false,"given":"Irene","family":"Paganini","sequence":"additional","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ornella","family":"Cutaia","sequence":"additional","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marco","family":"Meoni","sequence":"additional","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefania","family":"Cannistr\u00e0","sequence":"additional","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marzia","family":"Matucci","sequence":"additional","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"},{"name":"Retired"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6980-8011","authenticated-orcid":false,"given":"Francesca","family":"Carozzi","sequence":"additional","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"},{"name":"Retired"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chiara","family":"Di Stefano","sequence":"additional","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8955-8913","authenticated-orcid":false,"given":"Cristina","family":"Sani","sequence":"additional","affiliation":[{"name":"Institute for Cancer Research Prevention and Clinical Network (ISPRO)  Florence Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"Ispro Cytology Working Group","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2025,7,5]]},"reference":[{"key":"e_1_2_9_2_1","doi-asserted-by":"publisher","DOI":"10.1177\/09691413211067922"},{"key":"e_1_2_9_3_1","first-page":"1","article-title":"Gruppo Italiano Screening del Cervicocarcinoma (GISCi): Recommendations for Quality Control of Cervico\u2010Vaginal Cytology","volume":"28","author":"Confortini M.","year":"2004","journal-title":"Epidemiologia e Prevenzione"},{"key":"e_1_2_9_4_1","doi-asserted-by":"publisher","DOI":"10.1159\/000448370"},{"issue":"3","key":"e_1_2_9_5_1","first-page":"203","article-title":"Quality Control in the Cytology Laboratory","volume":"20","author":"Melamed M. R.","year":"1976","journal-title":"Acta Cytologica"},{"issue":"5","key":"e_1_2_9_6_1","first-page":"535","article-title":"Quality Control in Cytopathology. A System for Simultaneous Monitoring of Accuracy and Education and for Proficiency Testing","volume":"28","author":"Carney C. N.","year":"1984","journal-title":"Acta Cytologica"},{"key":"e_1_2_9_7_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365\u20102303.1993.tb00069.x"},{"key":"e_1_2_9_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/cyt.12195"},{"key":"e_1_2_9_9_1","doi-asserted-by":"publisher","DOI":"10.5858\/2000\u2010124\u20100672\u2010QMIGCU"},{"key":"e_1_2_9_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/dc.1097"},{"key":"e_1_2_9_11_1","volume-title":"A Manual for Cervical Cancer Screening and Control: Principles, Practice and New Perspectives","author":"Branca M.","year":"2013"},{"key":"e_1_2_9_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/cyt.12637"},{"key":"e_1_2_9_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0026256"},{"key":"e_1_2_9_14_1","doi-asserted-by":"publisher","DOI":"10.1159\/000477556"},{"key":"e_1_2_9_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/001316446002000104"},{"key":"e_1_2_9_16_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"}],"container-title":["Cytopathology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cyt.70006","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T08:32:13Z","timestamp":1759825933000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/cyt.70006"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,5]]},"references-count":15,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,11]]}},"alternative-id":["10.1111\/cyt.70006"],"URL":"https:\/\/doi.org\/10.1111\/cyt.70006","archive":["Portico"],"relation":{},"ISSN":["0956-5507","1365-2303"],"issn-type":[{"value":"0956-5507","type":"print"},{"value":"1365-2303","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,5]]},"assertion":[{"value":"2025-04-24","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-06-16","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-05","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}