{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T15:20:35Z","timestamp":1760368835245,"version":"3.37.0"},"reference-count":13,"publisher":"World Scientific Pub Co Pte Ltd","issue":"05","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Artif. Intell. Tools"],"published-print":{"date-parts":[[2009,10]]},"abstract":"<jats:p>We consider a variation of the problem of combining expert opinions for the situation in which there is no ground truth to use for training. Even though we do not have labeled data, the goal of this work is quite different from an unsupervised learning problem in which the goal is to cluster the data. Our work is motivated by the application of segmenting a lung nodule in a computed tomography (CT) scan of the human chest. The lack of a gold standard of truth is a critical problem in medical imaging. A variety of experts, both human and computer algorithms, are available that can mark which voxels are part of a nodule. The question is, how to combine these expert opinions to estimate the unknown ground truth. We present the Veritas algorithm that predicts the underlying label using the knowledge in the expert opinions even without the benefit of any labeled data for training. We evaluate Veritas using artificial data and real CT images to which synthetic nodules have been added, providing a known ground truth.<\/jats:p>","DOI":"10.1142\/s0218213009000330","type":"journal-article","created":{"date-parts":[[2009,10,30]],"date-time":"2009-10-30T09:01:16Z","timestamp":1256893276000},"page":"633-651","source":"Crossref","is-referenced-by-count":9,"title":["VERITAS: COMBINING EXPERT OPINIONS WITHOUT LABELED DATA"],"prefix":"10.1142","volume":"18","author":[{"given":"SHARATH R.","family":"CHOLLETI","sequence":"first","affiliation":[{"name":"Center for Comprehensive Informatics, Emory University, 1521 Dickey Drive, Suite 500, Atlanta, GA 30322, USA"}]},{"given":"SALLY A.","family":"GOLDMAN","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Washington University, One Brookings Drive, St. Louis, MO 63130, USA"}]},{"given":"AVRIM","family":"BLUM","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Carnegie Mellon University, Pittsburgh, PA, 15213, USA"}]},{"given":"DAVID G.","family":"POLITTE","sequence":"additional","affiliation":[{"name":"Electronic Radiology Laboratory, Mallinckrodt Institute of Radiology, Washington University School of Medicine, 510 S. Kingshighway, St. Louis, MO 63110, USA"}]},{"given":"STEVEN","family":"DON","sequence":"additional","affiliation":[{"name":"Electronic Radiology Laboratory, Mallinckrodt Institute of Radiology, Washington University School of Medicine, 510 S. Kingshighway, St. Louis, MO 63110, USA"}]},{"given":"KIRK","family":"SMITH","sequence":"additional","affiliation":[{"name":"Electronic Radiology Laboratory, Mallinckrodt Institute of Radiology, Washington University School of Medicine, 510 S. Kingshighway, St. Louis, MO 63110, USA"}]},{"given":"FRED","family":"PRIOR","sequence":"additional","affiliation":[{"name":"Electronic Radiology Laboratory, Mallinckrodt Institute of Radiology, Washington University School of Medicine, 510 S. Kingshighway, St. Louis, MO 63110, USA"}]}],"member":"219","published-online":{"date-parts":[[2011,11,21]]},"reference":[{"key":"rf2","doi-asserted-by":"publisher","DOI":"10.1016\/j.acra.2007.07.008"},{"key":"rf3","doi-asserted-by":"publisher","DOI":"10.1016\/j.acra.2007.08.006"},{"key":"rf4","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-007-9061-4"},{"key":"rf5","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2004.828354"},{"key":"rf6","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.1982.4307587"},{"key":"rf7","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511546921"},{"key":"rf8","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007614523901"},{"key":"rf9","first-page":"1","volume":"39","author":"Dempster A. P.","journal-title":"Journal of the Royal Statistical Society"},{"key":"rf10","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1111\/j.2517-6161.1989.tb01764.x","volume":"51","author":"Greig D.","journal-title":"Journal of the Royal Statistics Society, B"},{"key":"rf13","first-page":"343","volume":"2","author":"Angluin Dana","journal-title":"Machine Learning"},{"key":"rf14","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.1997.1504"},{"key":"rf15","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/3897.001.0001","volume-title":"An Introduction to Computational Learning Theory","author":"Kearns Michael J.","year":"1994"},{"key":"rf16","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007335615132"}],"container-title":["International Journal on Artificial Intelligence Tools"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218213009000330","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T00:35:29Z","timestamp":1739406929000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0218213009000330"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,10]]},"references-count":13,"journal-issue":{"issue":"05","published-online":{"date-parts":[[2011,11,21]]},"published-print":{"date-parts":[[2009,10]]}},"alternative-id":["10.1142\/S0218213009000330"],"URL":"https:\/\/doi.org\/10.1142\/s0218213009000330","relation":{},"ISSN":["0218-2130","1793-6349"],"issn-type":[{"type":"print","value":"0218-2130"},{"type":"electronic","value":"1793-6349"}],"subject":[],"published":{"date-parts":[[2009,10]]}}}