{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T18:49:48Z","timestamp":1776278988653,"version":"3.50.1"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,11,9]],"date-time":"2020-11-09T00:00:00Z","timestamp":1604880000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,11,9]],"date-time":"2020-11-09T00:00:00Z","timestamp":1604880000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003945","name":"Link\u00f6ping University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003945","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Digit Imaging"],"published-print":{"date-parts":[[2021,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Artificial intelligence (AI) holds much promise for enabling highly desired imaging diagnostics improvements. One of the most limiting bottlenecks for the development of useful clinical-grade AI models is the lack of training data. One aspect is the large amount of cases needed and another is the necessity of high-quality ground truth annotation. The aim of the project was to establish and describe the construction of a database with substantial amounts of detail-annotated oncology imaging data from pathology and radiology. A specific objective was to be proactive, that is, to support undefined subsequent AI training across a wide range of tasks, such as detection, quantification, segmentation, and classification, which puts particular focus on the quality and generality of the annotations. The main outcome of this project was the database as such, with a collection of labeled image data from breast, ovary, skin, colon, skeleton, and liver. In addition, this effort also served as an exploration of best practices for further scalability of high-quality image collections, and a main contribution of the study was generic lessons learned regarding how to successfully organize efforts to construct medical imaging databases for AI training, summarized as eight guiding principles covering team, process, and execution aspects.<\/jats:p>","DOI":"10.1007\/s10278-020-00384-4","type":"journal-article","created":{"date-parts":[[2020,11,9]],"date-time":"2020-11-09T19:03:44Z","timestamp":1604948624000},"page":"105-115","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Proactive Construction of an Annotated Imaging Database for Artificial Intelligence Training"],"prefix":"10.1007","volume":"34","author":[{"given":"Caroline Bivik","family":"Stadler","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Lindvall","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Claes","family":"Lundstr\u00f6m","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anna","family":"Bod\u00e9n","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karin","family":"Lindman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeronimo","family":"Rose","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Darren","family":"Treanor","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johan","family":"Blomma","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karin","family":"Stacke","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicolas","family":"Pinchaud","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Hedlund","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Filip","family":"Landgren","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mischa","family":"Woisetschl\u00e4ger","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Forsberg","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,11,9]]},"reference":[{"key":"384_CR1","unstructured":"The Cancer Imaging Archive (TCIA). Available at: https:\/\/www.cancerimagingarchive.net\/. Accessed 28 September 2020"},{"key":"384_CR2","doi-asserted-by":"publisher","unstructured":"re3data.org - Registry of Research Data Repositories. Available at: https:\/\/doi.org\/10.17616\/R3D. Accessed 28 September 2020","DOI":"10.17616\/R3D"},{"key":"384_CR3","unstructured":"Grand Challenges in Biomedical Image Analysis. Available at: https:\/\/grand-challenge.org. Accessed 28 September 2020"},{"key":"384_CR4","unstructured":"Chest-Xray8. Available at: https:\/\/nihcc.app.box.com\/v\/ChestXray-NIHCC. Accessed 28 September 2020"},{"issue":"1","key":"384_CR5","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1038\/s41597-019-0322-0","volume":"6","author":"AEW Johnson","year":"2019","unstructured":"Johnson AEW, Pollard TJ, Berkowitz SJ, Greenbaum NR, Lungren MP, Deng C-Y, et al: MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports. Sci Data 6(1):317,2019","journal-title":"Sci Data"},{"issue":"3","key":"384_CR6","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1007\/s10278-017-9947-8","volume":"30","author":"S Kostopoulos","year":"2017","unstructured":"Kostopoulos S, Ravazoula P, Asvestas P, Kalatzis I, Xenogiannopoulos G, Cavouras D, et al: Development of a Reference Image Collection Library for Histopathology Image Processing, Analysis and Decision Support Systems Research. J Digit Imaging 30(3):287\u201395,2017","journal-title":"J Digit Imaging"},{"key":"384_CR7","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","volume":"42","author":"G Litjens","year":"2017","unstructured":"Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, et al: A survey on deep learning in medical image analysis. Med Image Anal 42:60\u201388,2017","journal-title":"Med Image Anal"},{"key":"384_CR8","unstructured":"Oakden-Rayner L: Exploring the ChestXray14 dataset: problems. Available at: https:\/\/lukeoakdenrayner.wordpress.com\/2017\/12\/18\/the-chestxray14-dataset-problems\/. Accessed 28 September 2020"},{"key":"384_CR9","doi-asserted-by":"crossref","unstructured":"Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM: ChestX-ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases, 2017, pp 2097\u2013106","DOI":"10.1109\/CVPR.2017.369"},{"key":"384_CR10","doi-asserted-by":"crossref","unstructured":"Goldberger AL, Amaral LAN, Glass L, Hausdorff JM, Ivanov PC, Mark RG, et al: PhysioBank, PhysioToolkit, and PhysioNet, Components of a New Research Resource for Complex Physiologic Signals. Circulation 101(23):215\u2013220,2000","DOI":"10.1161\/01.CIR.101.23.e215"},{"key":"384_CR11","unstructured":"Lindvall M, Sanner A, Petr\u00e9 F, Lindman K, Treanor D, Lundstr\u00f6m C, et.al: TissueWand, a Rapid Histopathology Annotation Tool. J Pathol Inform 11:27,2020"},{"key":"384_CR12","unstructured":"Analytic Imaging Diagnostics Arena. Available at: https:\/\/medtech4health.se\/en\/aida-en-2\/. Accessed 28 September 2020"},{"key":"384_CR13","unstructured":"AIDA dataset register. Available at: https:\/\/datasets.aida.medtech4health.se\/. Accessed 28 September 2020"},{"key":"384_CR14","doi-asserted-by":"publisher","first-page":"22","DOI":"10.4103\/jpi.jpi_81_18","volume":"10","author":"K Lindman","year":"2019","unstructured":"Lindman K, Rose JF, Lindvall M, Lundstr\u00f6m C, Treanor D: Annotations, Ontologies, and Whole Slide Images - Development of an Annotated Ontology-Driven Whole Slide Image Library of Normal and Abnormal Human Tissue. J Pathol Inform 10:22,2019","journal-title":"J Pathol Inform"},{"key":"384_CR15","doi-asserted-by":"publisher","unstructured":"Lindman K, Rose JF, Lindvall M, Bivik Stadler C: Ovary data from the Visual Sweden project DROID, 2019. https:\/\/doi.org\/10.23698\/aida\/drov","DOI":"10.23698\/aida\/drov"},{"key":"384_CR16","doi-asserted-by":"publisher","unstructured":"Bod\u00e9n A, Rose JF, Lindvall M, Bivik Stadler C: Breast data from the Visual Sweden project DROID, 2019. https:\/\/doi.org\/10.23698\/aida\/drbr","DOI":"10.23698\/aida\/drbr"},{"key":"384_CR17","doi-asserted-by":"publisher","unstructured":"Lindman K, Rose JF, Lindvall M, Bivik Stadler C: Skin data from the Visual Sweden project DROID, 2019. https:\/\/doi.org\/10.23698\/aida\/drsk","DOI":"10.23698\/aida\/drsk"},{"key":"384_CR18","doi-asserted-by":"publisher","unstructured":"Lindman K, Lindvall M, Bivik Stadler C, Lundstr\u00f6m C, Treanor D: Colon data from the Visual Sweden project DROID, 2019. https:\/\/doi.org\/10.23698\/aida\/drco","DOI":"10.23698\/aida\/drco"},{"key":"384_CR19","doi-asserted-by":"publisher","unstructured":"Woisetschl\u00e4ger M, Blomma J, Dahlstr\u00f6m N, Bivik Stadler C, Forsberg D: Liver data from the Visual Sweden project DROID, 2019. https:\/\/doi.org\/10.23698\/aida\/drli","DOI":"10.23698\/aida\/drli"},{"issue":"3","key":"384_CR20","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1007\/s10278-015-9846-9","volume":"29","author":"KE Fenerty","year":"2016","unstructured":"Fenerty KE, Patronas NJ, Heery CR, Gulley JL, Folio LR. Resources Required for Semi-Automatic Volumetric Measurements in Metastatic Chordoma: Is Potentially Improved Tumor Burden Assessment Worth the Time Burden? J Digit Imaging 2016;29(3):357\u201364.","journal-title":"J Digit Imaging"},{"key":"384_CR21","doi-asserted-by":"publisher","unstructured":"Woisetschl\u00e4ger M, Landgren F, Bivik Stadler C, Forsberg D: Skeletal data from the Visual Sweden project DROID, 2019. https:\/\/doi.org\/10.23698\/aida\/drske","DOI":"10.23698\/aida\/drske"},{"key":"384_CR22","first-page":"3075","volume-title":"Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI \u201814","author":"T Kulesza","year":"2014","unstructured":"Kulesza T, Amershi S, Caruana R, Fisher D, Charles D, Kulesza T, et al: Structured labeling for facilitating concept evolution in machine learning. In: Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI \u201814. ACM Press, New York, USA, 2014. pp 3075\u201384"}],"container-title":["Journal of Digital Imaging"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-020-00384-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10278-020-00384-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-020-00384-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,19]],"date-time":"2021-02-19T10:40:48Z","timestamp":1613731248000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10278-020-00384-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,9]]},"references-count":22,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,2]]}},"alternative-id":["384"],"URL":"https:\/\/doi.org\/10.1007\/s10278-020-00384-4","relation":{},"ISSN":["0897-1889","1618-727X"],"issn-type":[{"value":"0897-1889","type":"print"},{"value":"1618-727X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,9]]},"assertion":[{"value":"9 November 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This study was approved by the regional institutional review board prior to study commencement (2017-276-31 and 2017-285-31).","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with Ethical Standards"}},{"value":"Martin Lindvall, Claes Lundstr\u00f6m, Karin Stacke, and Daniel Forsberg are employed by Sectra AB. Nicolas Pinchaud and Martin Hedlund are employed by ContextVision AB.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}}]}}