{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T15:25:16Z","timestamp":1782833116110,"version":"3.54.5"},"reference-count":19,"publisher":"Archives of Pathology and Laboratory Medicine","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,5,1]]},"abstract":"<jats:sec>\n                    <jats:title>Context<\/jats:title>\n                    <jats:p>Testing reproducibility is critical for the development of methodologies for morphologic assessment. Our previous study using the descriptor-based Nephrotic Syndrome Study Network Digital Pathology Scoring System (NDPSS) on glomerular images revealed variable reproducibility.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To test reproducibility and feasibility of alternative scoring strategies for digital morphologic assessment of glomeruli and explore use of alternative agreement statistics.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design<\/jats:title>\n                    <jats:p>The original NDPSS was modified (NDPSS1 and NDPSS2) to evaluate (1) independent scoring of each individual biopsy level, (2) use of continuous measures, (3) groupings of individual descriptors into classes and subclasses prior to scoring, and (4) indication of pathologists' confidence\/uncertainty for any given score. Three and 5 pathologists scored 157 and 79 glomeruli using the NDPSS1 and NDPSS2, respectively. Agreement was tested using conventional (Cohen \u03ba) and alternative (Gwet agreement coefficient 1 [AC1]) agreement statistics and compared with previously published data (original NDPSS).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Overall, pathologists' uncertainty was low, favoring application of the Gwet AC1. Greater agreement was achieved using the Gwet AC1 compared with the Cohen \u03ba across all scoring methodologies. Mean (standard deviation) differences in agreement estimates using the NDPSS1 and NDPSS2 compared with the single-level original NDPSS were \u22120.09 (0.17) and \u22120.17 (0.17), respectively. Using the Gwet AC1, 79% of the original NDPSS descriptors had good or excellent agreement. Pathologist feedback indicated the NDPSS1 and NDPSS2 were time-consuming.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The NDPSS1 and NDPSS2 increased pathologists' scoring burden without improving reproducibility. Use of alternative agreement statistics was strongly supported. We suggest using the original NDPSS on whole slide images for glomerular morphology assessment and for guiding future automated technologies.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.5858\/arpa.2017-0181-oa","type":"journal-article","created":{"date-parts":[[2018,2,19]],"date-time":"2018-02-19T10:02:16Z","timestamp":1519034536000},"page":"613-625","source":"Crossref","is-referenced-by-count":24,"title":["Reproducibility and Feasibility of Strategies for Morphologic Assessment of Renal Biopsies Using the Nephrotic Syndrome Study Network Digital Pathology Scoring System"],"prefix":"10.5858","volume":"142","author":[{"given":"Jarcy","family":"Zee","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeffrey B.","family":"Hodgin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura H.","family":"Mariani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph P.","family":"Gaut","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew B.","family":"Palmer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Serena M.","family":"Bagnasco","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Avi Z.","family":"Rosenberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen M.","family":"Hewitt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lawrence B.","family":"Holzman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brenda W.","family":"Gillespie","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Barisoni","sequence":"additional","affiliation":[{"name":"From Biostatistics, Arbor Research Collaborative for Health, Ann Arbor, Michigan (Dr Zee); the Departments of Pathology (Dr Hodgin), Internal Medicine (Dr Mariani), and Biostatistics (Dr Gillespie), University of Michigan, Ann Arbor; Arbor Research Collaborative for Health, Ann Arbor, Michigan (Dr Mariani); the Department of Pathology & Immunology, Washington University, St Louis, Missouri (Dr Ga"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"3906","published-online":{"date-parts":[[2018,2,19]]},"reference":[{"issue":"7","key":"2020081300163410900_i1543-2165-142-5-613-b01","doi-asserted-by":"crossref","first-page":"816","DOI":"10.5858\/arpa.2011-0350-OA","article-title":"Novel quantitative method to evaluate globotriaosylceramide inclusions in renal peritubular capillaries by virtual microscopy in patients with Fabry disease","volume":"136","author":"Barisoni","year":"2012","journal-title":"Arch Pathol Lab Med"},{"issue":"8","key":"2020081300163410900_i1543-2165-142-5-613-b02","doi-asserted-by":"crossref","first-page":"1449","DOI":"10.2215\/CJN.08370812","article-title":"Digital pathology evaluation in the multicenter Nephrotic Syndrome Study Network (NEPTUNE)","volume":"8","author":"Barisoni","year":"2013","journal-title":"Clin J Am Soc Nephrol"},{"issue":"7","key":"2020081300163410900_i1543-2165-142-5-613-b03","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1038\/modpathol.2016.58","article-title":"Reproducibility of the NEPTUNE descriptor-based scoring system on whole-slide images and histologic and ultrastructural digital images","volume":"29","author":"Barisoni","year":"2016","journal-title":"Mod Pathol"},{"issue":"5","key":"2020081300163410900_i1543-2165-142-5-613-b04","doi-asserted-by":"crossref","first-page":"58","DOI":"10.5858\/arpa.2013-0028-OA","article-title":"Classification of thymic epithelial neoplasms is still a challenge to thoracic pathologists: a reproducibility study using digital microscopy","volume":"138","author":"Wang","year":"2014","journal-title":"Arch Pathol Lab Med"},{"issue":"2","key":"2020081300163410900_i1543-2165-142-5-613-b05","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1111\/j.1399-0012.2011.01506.x","article-title":"Superiority of virtual microscopy versus light microscopy in transplantation pathology","volume":"26","author":"Ozluk","year":"2012","journal-title":"Clin Transplant"},{"issue":"5","key":"2020081300163410900_i1543-2165-142-5-613-b06","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1016\/j.humpath.2012.08.015","article-title":"Reliability of whole slide images as a diagnostic modality for renal allograft biopsies","volume":"44","author":"Jen","year":"2013","journal-title":"Hum Pathol"},{"issue":"1","key":"2020081300163410900_i1543-2165-142-5-613-b07","doi-asserted-by":"crossref","first-page":"5","DOI":"10.4103\/2153-3539.127814","article-title":"Intra-observer reproducibility of whole slide imaging for the primary diagnosis of breast needle biopsies","volume":"5","author":"Reyes","year":"2014","journal-title":"J Pathol Inform"},{"issue":"2","key":"2020081300163410900_i1543-2165-142-5-613-b08","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1111\/j.1365-2559.2006.02581.x","article-title":"A randomized controlled trial of the diagnostic accuracy of internet-based telepathology compared with conventional microscopy","volume":"50","author":"Furness","year":"2007","journal-title":"Histopathology"},{"issue":"6","key":"2020081300163410900_i1543-2165-142-5-613-b09","doi-asserted-by":"crossref","first-page":"e0156441","DOI":"10.1371\/journal.pone.0156441","article-title":"The application of digital pathology to improve accuracy in glomerular enumeration in renal biopsies","volume":"11","author":"Rosenberg","year":"2016","journal-title":"PLoS One"},{"issue":"4","key":"2020081300163410900_i1543-2165-142-5-613-b10","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1038\/ki.2012.428","article-title":"Design of the Nephrotic Syndrome Study Network (NEPTUNE) to evaluate primary glomerular nephropathy by a multidisciplinary approach","volume":"83","author":"Gadegbeku","year":"2013","journal-title":"Kidney Int"},{"issue":"3","key":"2020081300163410900_i1543-2165-142-5-613-b11","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.semnephrol.2015.04.006","article-title":"Morphology in the digital age: integrating high-resolution description of structural alterations with phenotypes and genotypes","volume":"35","author":"Nast","year":"2015","journal-title":"Semin Nephrol"},{"issue":"2","key":"2020081300163410900_i1543-2165-142-5-613-b12","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1093\/ckj\/sfw129","article-title":"Digital pathology imaging as a novel platform for standardization and globalization of quantitative nephropathology","volume":"10","author":"Barisoni","year":"2017","journal-title":"Clin Kidney J"},{"key":"2020081300163410900_i1543-2165-142-5-613-b13","first-page":"1","article-title":"Kappa statistic is not satisfactory for assessing the extent of agreement between raters","volume":"1","author":"Gwet","year":"2002","journal-title":"Stat Methods Interrater Reliability Assess"},{"issue":"1","key":"2020081300163410900_i1543-2165-142-5-613-b14","first-page":"419","article-title":"Assumptions behind intercoder reliability indices","volume":"36","author":"Zhao","year":"2013","journal-title":"Ann Int Commun Assoc"},{"issue":"pt 1","key":"2020081300163410900_i1543-2165-142-5-613-b15","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1348\/000711006X126600","article-title":"Computing inter-rater reliability and its variance in the presence of high agreement","volume":"61","author":"Gwet","year":"2008","journal-title":"Br J Math Stat Psychol"},{"issue":"3","key":"2020081300163410900_i1543-2165-142-5-613-b16","doi-asserted-by":"crossref","first-page":"648","DOI":"10.1038\/ki.2014.230","article-title":"Histologic classification of glomerular diseases: clinicopathologic correlations, limitations exposed by validation studies, and suggestions for modification","volume":"86","author":"Haas","year":"2014","journal-title":"Kidney Int"},{"issue":"5","key":"2020081300163410900_i1543-2165-142-5-613-b17","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1038\/ki.2009.168","article-title":"The Oxford classification of IgA nephropathy: pathology definitions, correlations, and reproducibility","volume":"76","author":"Roberts","year":"2009","journal-title":"Kidney Int"},{"issue":"6","key":"2020081300163410900_i1543-2165-142-5-613-b18","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1016\/0895-4356(90)90159-M","article-title":"High agreement but low kappa, II: resolving the paradoxes","volume":"43","author":"Cicchetti","year":"1990","journal-title":"J Clin Epidemiol"},{"issue":"6","key":"2020081300163410900_i1543-2165-142-5-613-b19","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1097\/WCO.0000000000000258","article-title":"Towards an integrated morphological and molecular WHO diagnosis of central nervous system tumors: a paradigm shift","volume":"28","author":"Rushing","year":"2015","journal-title":"Curr Opin Neurol"}],"container-title":["Archives of Pathology &amp; Laboratory Medicine"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/meridian.allenpress.com\/aplm\/article-pdf\/142\/5\/613\/1446526\/arpa_2017-0181-oa.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/meridian.allenpress.com\/aplm\/article-pdf\/142\/5\/613\/1446526\/arpa_2017-0181-oa.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,3]],"date-time":"2025-12-03T19:34:52Z","timestamp":1764790492000},"score":1,"resource":{"primary":{"URL":"https:\/\/aplm.kglmeridian.com\/view\/journals\/arpa\/142\/5\/article-p613.xml"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,2,19]]},"references-count":19,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2018,2,19]]},"published-print":{"date-parts":[[2018,5,1]]}},"URL":"https:\/\/doi.org\/10.5858\/arpa.2017-0181-oa","relation":{},"ISSN":["0003-9985","1543-2165"],"issn-type":[{"value":"0003-9985","type":"print"},{"value":"1543-2165","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,2,19]]}}}