{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T17:58:45Z","timestamp":1777399125837,"version":"3.51.4"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2011,12,23]],"date-time":"2011-12-23T00:00:00Z","timestamp":1324598400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Digit Imaging"],"published-print":{"date-parts":[[2012,6]]},"DOI":"10.1007\/s10278-011-9445-3","type":"journal-article","created":{"date-parts":[[2011,12,22]],"date-time":"2011-12-22T20:15:45Z","timestamp":1324584945000},"page":"423-436","source":"Crossref","is-referenced-by-count":7,"title":["Consensus Versus Disagreement in Imaging Research: a Case Study Using the LIDC Database"],"prefix":"10.1007","volume":"25","author":[{"given":"Dmitriy","family":"Zinovev","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yujie","family":"Duo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniela S.","family":"Raicu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jacob","family":"Furst","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Samuel G.","family":"Armato","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2011,12,23]]},"reference":[{"key":"9445_CR1","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1148\/radiol.10100252","volume":"257","author":"AA Bankier","year":"2010","unstructured":"Bankier AA, Levin D, Halpern EF, Kressel HY: Consensus interpretation in imaging research: is there a better way? Radiology 257:14\u201317, 2010","journal-title":"Radiology"},{"issue":"1","key":"9445_CR2","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/S0196-0644(99)70422-1","volume":"33","author":"WR Mower","year":"1999","unstructured":"Mower WR: Evaluating bias and variability in diagnostic test reports. Ann Emerg Med 33(1):85\u201391, 1999","journal-title":"Ann Emerg Med"},{"issue":"4","key":"9445_CR3","first-page":"435","volume":"19","author":"DA Turner","year":"1978","unstructured":"Turner DA: Observer variability: what to do until perfect diagnostic tests are invented. J Nucl Med 19(4):435\u2013437, 1978","journal-title":"J Nucl Med"},{"issue":"1","key":"9445_CR4","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1148\/radiol.2493081458","volume":"250","author":"JG Jarvik","year":"2009","unstructured":"Jarvik JG, Deyo RA: Moderate versus mediocre: the reliability of spine MR data interpretations. Radiology 250(1):15\u201317, 2009","journal-title":"Radiology"},{"issue":"1","key":"9445_CR5","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1148\/radiol.2493071999","volume":"250","author":"JA Carrino","year":"2009","unstructured":"Carrino JA, Lurie JD, Tosteson AN, et al: Lumbar spine: reliability of MR imaging findings. Radiology 250(1):161\u2013170, 2009","journal-title":"Radiology"},{"key":"9445_CR6","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1148\/radiology.213.3.r99dc27723","volume":"13","author":"H MacMahon","year":"1999","unstructured":"MacMahon H, Engelmann R, Behlen F, Hoffmann K, Ishida T, Roe C, Metz C, Doi K: Computer-aided diagnosis of pulmonary nodules: Results of a large-scale observer test. Radiology 13:723\u2013726, 1999","journal-title":"Radiology"},{"issue":"3","key":"9445_CR7","doi-asserted-by":"crossref","first-page":"657","DOI":"10.2214\/ajr.178.3.1780657","volume":"178","author":"Y Matsuki","year":"2002","unstructured":"Matsuki Y, Nakamura K, Watanabe H, Aoki T, Nakata H, Katsuragawa S, Doi K: Usefulness of an artificial neural network for differentiating benign from malignant pulmonary nodules on high-resolution CT: evaluation with receiver operating characteristic analysis. Am J Roentgenol 178(3):657\u2013663, 2002","journal-title":"Am J Roentgenol"},{"key":"9445_CR8","doi-asserted-by":"crossref","first-page":"1209","DOI":"10.2214\/ajr.183.5.1831209","volume":"183","author":"F Li","year":"2004","unstructured":"Li F, Aoyama M, Shiraishi J, et al: Radiologists\u2019 performance for differentiating benign from malignant lung nodules on high-resolution CT using computer estimated likelihood of malignancy. Am J Roentgenol 183:1209\u20131215, 2004","journal-title":"Am J Roentgenol"},{"key":"9445_CR9","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1007\/s00330-004-2544-5","volume":"15","author":"K Marten","year":"2005","unstructured":"Marten K, Grillh\u00f6sl A, Seyfarth T, Obenauer S, Rummeny EJ, Engelke C: Computer-assisted detection of pulmonary nodules: evaluation of diagnostic performance using an expert knowledge-based detection system with variable reconstruction slice thickness settings. Eur Radiol 15:203\u2013212, 2005","journal-title":"Eur Radiol"},{"key":"9445_CR10","doi-asserted-by":"crossref","first-page":"1517","DOI":"10.1378\/chest.128.3.1517","volume":"128","author":"K Peldschus","year":"2005","unstructured":"Peldschus K, Herzog P, Wood SA, Cheema JI, Costello P, Schoepf UJ: Computer-aided diagnosis as a second reader\u2014spectrum of findings in CT studies of the chest interpreted as normal. Chest Journal 128:1517\u20131523, 2005","journal-title":"Chest Journal"},{"key":"9445_CR11","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.2214\/ajr.181.4.1811083","volume":"181","author":"JA Baker","year":"2003","unstructured":"Baker JA, Rosen EL, Lo JY, Gimenez EI, Walsh R, Soo MS: Computer-aided detection (CAD) in screening mammography: sensitivity of commercial CAD systems for detecting architectural distortion. Am J Roentgenol 181:1083\u20131088, 2003","journal-title":"Am J Roentgenol"},{"key":"9445_CR12","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/S0720-048X(02)00011-6","volume":"45","author":"S Ciatto","year":"2003","unstructured":"Ciatto S, Turco MR, Risso G, et al: Comparison of standard reading and computer-aided detection (CAD) on a national proficiency test of screening mammography. Eur J Radiol 45:135\u2013138, 2003","journal-title":"Eur J Radiol"},{"key":"9445_CR13","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1148\/radiol.2271011962","volume":"227","author":"N Karssemeijer","year":"2003","unstructured":"Karssemeijer N, Risso G, Catarzi S, et al: Computer-aided detection versus independent double reading of masses on mammograms. Radiology 227:192\u2013200, 2003","journal-title":"Radiology"},{"key":"9445_CR14","doi-asserted-by":"crossref","first-page":"2295","DOI":"10.1118\/1.1944913","volume":"32","author":"C Muramatsu","year":"2005","unstructured":"Muramatsu C, Li Q, Suzuki K, et al: Investigation of psychophysical measure for evaluation of similar images for mammographic masses: Preliminary results. Medical Physics 32:2295\u20132304, 2005","journal-title":"Medical Physics"},{"key":"9445_CR15","doi-asserted-by":"crossref","first-page":"179","DOI":"10.2967\/jnumed.107.044990","volume":"49","author":"JW Fletcher","year":"2008","unstructured":"Fletcher JW, Kymes SM, Gould M, Alazraki N, Coleman RE, Lowe VJ, et al: A comparison of the diagnostic accuracy of 18FFDG PET and CT in the characterization of solitary pulmonary nodules. J Nucl Med 49:179\u2013185, 2008","journal-title":"J Nucl Med"},{"key":"9445_CR16","doi-asserted-by":"crossref","unstructured":"Tao Y, Lo S-C B, Freedman M T, Xuan J: Joint segmentation and spiculation detection for ill-defined and spiculated mammographic masses. Proc. SPIE, doi:10.1117\/12.844045, February 16, 2010","DOI":"10.1117\/12.844045"},{"key":"9445_CR17","doi-asserted-by":"crossref","unstructured":"Sahiner B, Hadjiiski L M, Chan H P, Paramagul C, Nees A, Helvie M, Shi J: Concordance of Computer-Extracted Image Features with BI-RADS Descriptors for Mammographic Mass Margin. Proc. SPIE, doi: 10.1117\/12.770752, March 17, 2008","DOI":"10.1117\/12.770752"},{"key":"9445_CR18","doi-asserted-by":"crossref","unstructured":"Ochs R, Kimb HJ, Angel E, Panknin C, McNitt-Gray M, Brown M: Forming a reference standard from LIDC data: impact of reader agreement on reported CAD performance. Proc. SPIE, DOI: 10.1117\/12.707916, March 30, 2007","DOI":"10.1117\/12.707916"},{"key":"9445_CR19","doi-asserted-by":"crossref","unstructured":"Opfer R, Wiemker RD: Performance Analysis For Computer-Aided Lung Nodule Detection On LIDC Data. Proc. SPIE, DOI: 10.1117\/12.708210, February 21, 2007","DOI":"10.1117\/12.708210"},{"key":"9445_CR20","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.acra.2008.05.022","volume":"16","author":"SG Armato III","year":"2009","unstructured":"Armato III, SG, Roberts RY, Kocherginsky M, Aberle DR, Kazerooni EA, MacMahon H, van Beek EJR, Yankelevitz DF, McLennan G, McNitt-Gray MF, Meyer CR, Reeves AP, Caligiuri P, Quint LE, Sundaram B, Croft BY, Clarke LP: Assessment of radiologist performance in the detection of lung nodules: dependence on the definition of \u201ctruth\u201d. Acad Radiol 16:28\u201338, 2009","journal-title":"Acad Radiol"},{"key":"9445_CR21","doi-asserted-by":"crossref","first-page":"739","DOI":"10.1148\/radiol.2323032035","volume":"232","author":"SG Armato III","year":"2004","unstructured":"Armato III, SG, et al: Lung Image Database Consortium: developing a resource for the medical imaging research community. Radiology 232:739\u2013748, 2004","journal-title":"Radiology"},{"issue":"Spec No A","key":"9445_CR22","doi-asserted-by":"crossref","first-page":"S97","DOI":"10.1102\/1470-7330.2005.0026","volume":"5","author":"BJ Hillman","year":"2005","unstructured":"Hillman BJ: ACRIN\u2014lessons learned in conducting multi-center trials of imaging and cancer. Cancer Imaging 5(Spec No A):S97\u2013S101, 2005","journal-title":"Cancer Imaging"},{"key":"9445_CR23","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/S0888-613X(01)00045-7","volume":"28","author":"Z Elouedi","year":"2001","unstructured":"Elouedi Z, Mellouli K, Smets P: Belief decision trees: theoretical foundations. International Journal of Approximate Reasoning 28:91\u2013124, 2001","journal-title":"International Journal of Approximate Reasoning"},{"issue":"August","key":"9445_CR24","first-page":"975","volume":"5","author":"TF Wu","year":"2004","unstructured":"Wu TF, Lin CJ, Weng RC: Probability estimates for multi-class classification by pairwise coupling. J Mach Learn Res 5(August):975\u20131005, 2004","journal-title":"J Mach Learn Res"},{"key":"9445_CR25","doi-asserted-by":"crossref","first-page":"1085","DOI":"10.1259\/bjr.70.839.9536897","volume":"70","author":"PJA Robinson","year":"1997","unstructured":"Robinson PJA: Radiology\u2019s Achilles\u2019 heel: error and variation in the interpretation of the Rontghen image. Br J Radiol 70:1085\u20131098, 1997","journal-title":"Br J Radiol"},{"key":"9445_CR26","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s10278-010-9279-4","volume":"23","author":"B Reiner","year":"2010","unstructured":"Reiner B: Uncovering and improving upon the inherent deficiencies of radiology reporting through data mining. J Digit Imaging 23:109\u2013118, 2010","journal-title":"J Digit Imaging"},{"key":"9445_CR27","doi-asserted-by":"crossref","first-page":"1473","DOI":"10.3390\/a2041473","volume":"2","author":"D Zinovev","year":"2009","unstructured":"Zinovev D, Raicu D, Furst J, Armato III, SG: Predicting radiological panel opinions using a panel of machine learning classifiers. Algorithms Journal 2:1473\u20131502, 2009","journal-title":"Algorithms Journal"},{"key":"9445_CR28","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1613\/jair.279","volume":"4","author":"JR Quinlan","year":"1996","unstructured":"Quinlan JR: Improved use of continuous attributes in C4.5. Journal of Artificial Intelligence Research 4:77\u201390, 1996","journal-title":"Journal of Artificial Intelligence Research"},{"key":"9445_CR29","doi-asserted-by":"crossref","unstructured":"Spackman KA: Signal detection theory: Valuable tools for evaluating inductive learning. Proc. 6th Int. Workshop on Machine Learning 160\u2013163, 1989","DOI":"10.1016\/B978-1-55860-036-2.50047-3"},{"key":"9445_CR30","doi-asserted-by":"crossref","unstructured":"Liu H, Song D, R\u00fcger S, Hu R, Uren V: Comparing dissimilarity measures for content-based image retrieval. Proc. 4th Asia Inf. Ret. Conf. on Information Retrieval Technology 44\u201350, 2008","DOI":"10.1007\/978-3-540-68636-1_5"}],"container-title":["Journal of Digital Imaging"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-011-9445-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10278-011-9445-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-011-9445-3","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,6,21]],"date-time":"2019-06-21T07:40:47Z","timestamp":1561102847000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10278-011-9445-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,12,23]]},"references-count":30,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2012,6]]}},"alternative-id":["9445"],"URL":"https:\/\/doi.org\/10.1007\/s10278-011-9445-3","relation":{},"ISSN":["0897-1889","1618-727X"],"issn-type":[{"value":"0897-1889","type":"print"},{"value":"1618-727X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,12,23]]}}}