{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,5]],"date-time":"2026-08-05T11:17:03Z","timestamp":1785928623840,"version":"3.56.0"},"reference-count":22,"publisher":"Walter de Gruyter GmbH","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,11,25]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec id=\"j_cclm-2021-1194_abs_001\">\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>Computational algorithms for the interpretation of laboratory test results can support physicians and specialists in laboratory medicine. The aim of this study was to develop, implement and evaluate a machine learning algorithm that automatically assesses the risk of low body iron storage, reflected by low ferritin plasma levels, in anemic primary care patients using a minimal set of basic laboratory tests, namely complete blood count and C-reactive protein (CRP).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec id=\"j_cclm-2021-1194_abs_002\">\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>Laboratory measurements of anemic primary care patients were used to develop and validate a machine learning algorithm. The performance of the algorithm was compared to twelve specialists in laboratory medicine from three large teaching hospitals, who predicted if patients with anemia have low ferritin levels based on laboratory test reports (complete blood count and CRP). In a second round of assessments the algorithm outcome was provided to the specialists in laboratory medicine as a decision support tool.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec id=\"j_cclm-2021-1194_abs_003\">\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Two separate algorithms to predict low ferritin concentrations were developed based on two different chemistry analyzers, with an area under the curve of the ROC of 0.92 (Siemens) and 0.90 (Roche). The specialists in laboratory medicine were less accurate in predicting low ferritin concentrations compared to the algorithms, even when knowing the output of the algorithms as support tool. Implementation of the algorithm in the laboratory system resulted in one new iron deficiency diagnosis on average per day.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec id=\"j_cclm-2021-1194_abs_004\">\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>Low ferritin levels in anemic patients can be accurately predicted using a machine learning algorithm based on routine laboratory test results. Moreover, implementation of the algorithm in the laboratory system reduces the number of otherwise unrecognized iron deficiencies.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1515\/cclm-2021-1194","type":"journal-article","created":{"date-parts":[[2022,3,8]],"date-time":"2022-03-08T10:53:17Z","timestamp":1646736797000},"page":"1921-1928","source":"Crossref","is-referenced-by-count":33,"title":["Automated prediction of low ferritin concentrations using a machine learning algorithm"],"prefix":"10.1515","volume":"60","author":[{"given":"Steef","family":"Kurstjens","sequence":"first","affiliation":[{"name":"Laboratory of Clinical Chemistry and Hematology , Jeroen Bosch Hospital , \u2019s Hertogenbosch , the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas","family":"de Bel","sequence":"additional","affiliation":[{"name":"Diagnostic Image Analysis Group, Radboudumc , Nijmegen , the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Armando","family":"van der Horst","sequence":"additional","affiliation":[{"name":"Laboratory of Clinical Chemistry and Hematology , Jeroen Bosch Hospital , \u2019s Hertogenbosch , the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ron","family":"Kusters","sequence":"additional","affiliation":[{"name":"Laboratory of Clinical Chemistry and Hematology , Jeroen Bosch Hospital , \u2019s Hertogenbosch , the Netherlands"},{"name":"Department of Health Technology and Services Research , Technical Medical Centre, University of Twente , Enschede , the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Johannes","family":"Krabbe","sequence":"additional","affiliation":[{"name":"Laboratory of Clinical Chemistry and Laboratory Medicine , Medisch Spectrum Twente , Enschede , the Netherlands"},{"name":"Laboratory of Clinical Chemistry and Laboratory Medicine , Medlon BV , Enschede , the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jasmijn","family":"van Balveren","sequence":"additional","affiliation":[{"name":"Department of Health Technology and Services Research , Technical Medical Centre, University of Twente , Enschede , the Netherlands"},{"name":"Laboratory of Clinical Chemistry and Hematology , St Jansdal, Harderwijk , the Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"374","published-online":{"date-parts":[[2022,3,8]]},"reference":[{"key":"2023033111540090605_j_cclm-2021-1194_ref_001","doi-asserted-by":"crossref","unstructured":"Vos, T, Abajobir, AA, Abbafati, C, Abbas, KM, Abate, KH, Abd-Allah, F, et al.. Global, regional, and national incidence, prevalence, and years lived with disability for 328 diseases and injuries for 195 countries, 1990\u20132016: a systematic analysis for the Global Burden of disease study 2016. Lancet 2017;390:1211\u201359. https:\/\/doi.org\/10.1016\/S0140-6736(17)32154-2.","DOI":"10.1016\/S0140-6736(17)32154-2"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_002","doi-asserted-by":"crossref","unstructured":"Thachil, J. Iron deficiency: still under-diagnosed? Br J Hosp Med 2015;76:528\u201332. https:\/\/doi.org\/10.12968\/hmed.2015.76.9.528.","DOI":"10.12968\/hmed.2015.76.9.528"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_003","doi-asserted-by":"crossref","unstructured":"Pasricha, SR, Tye-Din, J, Muckenthaler, MU, Swinkels, DW. Iron deficiency. Lancet 2021;397:233\u201348. https:\/\/doi.org\/10.1016\/s0140-6736(20)32594-0.","DOI":"10.1016\/S0140-6736(20)32594-0"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_004","doi-asserted-by":"crossref","unstructured":"Peyrin-Biroulet, L, Williet, N, Cacoub, P. Guidelines on the diagnosis and treatment of iron deficiency across indications: a systematic review. Am J Clin Nutr 2015;102:1585\u201394. https:\/\/doi.org\/10.3945\/ajcn.114.103366.","DOI":"10.3945\/ajcn.114.103366"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_005","doi-asserted-by":"crossref","unstructured":"Daru, J, Colman, K, Stanworth, SJ, De La Salle, B, Wood, EM, Pasricha, SR. Serum ferritin as an indicator of iron status: what do we need to know? Am J Clin Nutr 2017;106:1634S. https:\/\/doi.org\/10.3945\/ajcn.117.155960.","DOI":"10.3945\/ajcn.117.155960"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_006","doi-asserted-by":"crossref","unstructured":"Hoofnagle, AN. Harmonization of blood-based indicators of iron status: making the hard work matter. Am J Clin Nutr 2017;106:1615S\u20131619S. https:\/\/doi.org\/10.3945\/ajcn.117.155895.","DOI":"10.3945\/ajcn.117.155895"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_007","doi-asserted-by":"crossref","unstructured":"Oosterhuis, WP, van de Venne, WPV, van Deursen, CT, Stoffers, HEJH, van Acker, BA, Bossuyt, PMM. Reflective testing\u00a0\u2013 a randomized controlled trial in primary care patients. Ann Clin Biochem 2021;58:78\u201385. https:\/\/doi.org\/10.1177\/0004563220968373.","DOI":"10.1177\/0004563220968373"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_008","doi-asserted-by":"crossref","unstructured":"Bulten, W, Pinckaers, H, van Boven, H, Vink, R, de Bel, T, van Ginneken, B, et al.. Automated deep-learning system for Gleason grading of prostate cancer using biopsies: a diagnostic study. Lancet Oncol 2020;21:233\u201341. https:\/\/doi.org\/10.1016\/s1470-2045(19)30739-9.","DOI":"10.1016\/S1470-2045(19)30739-9"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_009","doi-asserted-by":"crossref","unstructured":"Lessmann, N, S\u00e1nchez, CI, Beenen, L, Boulogne, LH, Brink, M, Calli, E, et al.. Automated assessment of COVID-19 reporting and data system and chest CT severity scores in patients suspected of having COVID-19 using artificial intelligence. Radiology 2021;298:E18\u201328. https:\/\/doi.org\/10.1148\/radiol.2020202439.","DOI":"10.1148\/radiol.2020202439"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_010","doi-asserted-by":"crossref","unstructured":"Kurstjens, S, van der Horst, A, Herpers, R, Geerits, MWL, Kluiters-De Hingh, YCM, G\u00f6ttgens, EL, et al.. Rapid identification of SARS-CoV-2-infected patients at the emergency department using routine testing. Clin Chem Lab Med 2020;58:1587\u201393. https:\/\/doi.org\/10.1515\/cclm-2020-0593.","DOI":"10.1515\/cclm-2020-0593"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_011","doi-asserted-by":"crossref","unstructured":"Yang, HS, Hou, Y, Vasovic, LV, Steel, PAD, Chadburn, A, Racine-Brzostek, SE, et al.. Routine laboratory blood tests predict SARS-CoV-2 infection using machine learning. Clin Chem 2020;66:1396\u2013404. https:\/\/doi.org\/10.1093\/clinchem\/hvaa200.","DOI":"10.1093\/clinchem\/hvaa200"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_012","doi-asserted-by":"crossref","unstructured":"\u00c7all\u0131, E, Murphy, K, Kurstjens, S, Samson, T, Herpers, R, Smits, H, et al.. Deep learning with robustness to missing data: a novel approach to the detection of COVID-19. PLoS One 2021;16. https:\/\/doi.org\/10.1371\/journal.pone.0255301.","DOI":"10.1371\/journal.pone.0255301"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_013","doi-asserted-by":"crossref","unstructured":"He, J, Baxter, SL, Xu, J, Xu, J, Zhou, X, Zhang, K. The practical implementation of artificial intelligence technologies in medicine. Nat Med 2019;25:30\u20136. https:\/\/doi.org\/10.1038\/s41591-018-0307-0.","DOI":"10.1038\/s41591-018-0307-0"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_014","doi-asserted-by":"crossref","unstructured":"McPhail, SM. Multimorbidity in chronic disease: impact on health care resources and costs. Risk Manag Healthc Pol 2016;9:143\u201356. https:\/\/doi.org\/10.2147\/rmhp.s97248.","DOI":"10.2147\/RMHP.S97248"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_015","doi-asserted-by":"crossref","unstructured":"Rudolf, JW, Dighe, AS. Decision support tools within the electronic health record. Clin Lab Med 2019;39:197\u2013213. https:\/\/doi.org\/10.1016\/j.cll.2019.01.001.","DOI":"10.1016\/j.cll.2019.01.001"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_016","doi-asserted-by":"crossref","unstructured":"Simpson, WG, Twomey, PJ. Reflective testing. J Clin Pathol 2004;57:239\u201340. https:\/\/doi.org\/10.1136\/jcp.2003.011668.","DOI":"10.1136\/jcp.2003.011668"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_017","doi-asserted-by":"crossref","unstructured":"Murphy, MJ. Reflex and reflective testing: progress, but much still to be done. Ann Clin Biochem 2021;58:75. https:\/\/doi.org\/10.1177\/0004563221993153.","DOI":"10.1177\/0004563221993153"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_018","doi-asserted-by":"crossref","unstructured":"Luo, Y, Szolovits, P, Dighe, AS, Baron, JM. Using machine learning to predict laboratory test results. Am J Clin Pathol 2016;145:778\u201388. https:\/\/doi.org\/10.1093\/ajcp\/aqw064.","DOI":"10.1093\/ajcp\/aqw064"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_019","doi-asserted-by":"crossref","unstructured":"Park, DJ, Park, MW, Lee, H, Kim, YJ, Kim, Y, Park, YH. Development of machine learning model for diagnostic disease prediction based on laboratory tests. Sci Rep 2021;11:7567. https:\/\/doi.org\/10.1038\/s41598-021-87171-5.","DOI":"10.1038\/s41598-021-87171-5"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_020","doi-asserted-by":"crossref","unstructured":"Boerman, AW, Schinkel, M, Meijerink, L, van den Ende, ES, Pladet, LC, Scholtemeijer, MG, et al.. Using machine learning to predict blood culture outcomes in the emergency department: a\u00a0single-centre, retrospective, observational study. BMJ Open 2022;12:e053332. https:\/\/doi.org\/10.1136\/bmjopen-2021-053332.","DOI":"10.1136\/bmjopen-2021-053332"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_021","doi-asserted-by":"crossref","unstructured":"Sutton, RT, Pincock, D, Baumgart, DC, Sadowski, DC, Fedorak, RN, Kroeker, KI. An overview of clinical decision support systems: benefits, risks, and strategies for success. NPJ Digit Med 2020;3:17. https:\/\/doi.org\/10.1038\/s41746-020-0221-y.","DOI":"10.1038\/s41746-020-0221-y"},{"key":"2023033111540090605_j_cclm-2021-1194_ref_022","doi-asserted-by":"crossref","unstructured":"Van Balveren, JA, Verboeket-Van De Venne, WPHG, Erdem-Eraslan, L, De Graaf, AJ, Loot, AE, Musson, REA, et al.. Impact of interactions between drugs and laboratory test results on diagnostic test interpretation\u00a0\u2013 a systematic review. Clin Chem Lab Med 2018;56:2004\u20139. https:\/\/doi.org\/10.1515\/cclm-2018-0900.","DOI":"10.1515\/cclm-2018-0900"}],"container-title":["Clinical Chemistry and Laboratory Medicine (CCLM)"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/cclm-2021-1194\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/cclm-2021-1194\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T16:08:25Z","timestamp":1680278905000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/cclm-2021-1194\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,8]]},"references-count":22,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,11,4]]},"published-print":{"date-parts":[[2022,11,25]]}},"alternative-id":["10.1515\/cclm-2021-1194"],"URL":"https:\/\/doi.org\/10.1515\/cclm-2021-1194","relation":{},"ISSN":["1434-6621","1437-4331"],"issn-type":[{"value":"1434-6621","type":"print"},{"value":"1437-4331","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,8]]}}}