{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T04:20:09Z","timestamp":1772166009131,"version":"3.50.1"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T00:00:00Z","timestamp":1683676800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T00:00:00Z","timestamp":1683676800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"KL2 Mentored Career Development Award"},{"DOI":"10.13039\/100004917","name":"Cancer Prevention and Research Institute of Texas","doi-asserted-by":"publisher","award":["RP170668"],"award-info":[{"award-number":["RP170668"]}],"id":[{"id":"10.13039\/100004917","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004917","name":"Cancer Prevention and Research Institute of Texas","doi-asserted-by":"publisher","award":["RR180012"],"award-info":[{"award-number":["RR180012"]}],"id":[{"id":"10.13039\/100004917","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006108","name":"National Center for Advancing Translational Sciences","doi-asserted-by":"publisher","award":["UL1TR000371"],"award-info":[{"award-number":["UL1TR000371"]}],"id":[{"id":"10.13039\/100006108","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Reynolds and Reynolds Professorship in Clinical Informatics"},{"name":"Christopher Sarofim Family Professorship"},{"name":"UT Stars award"},{"name":"UTHealth startup"},{"name":"National Institute of Health","award":["R01AG066749; U01TR002062"],"award-info":[{"award-number":["R01AG066749; U01TR002062"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>We propose a new deep learning model to identify unnecessary hemoglobin (Hgb) tests for patients admitted to the hospital, which can help reduce health risks and healthcare costs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We collected internal patient data from a teaching hospital in Houston and external patient data from the MIMIC III database. The study used a conservative definition of unnecessary laboratory tests, which was defined as stable (i.e., stability) and below the lower normal bound (i.e., normality). Considering that machine learning models may yield less reliable results when trained on noisy inputs containing low-quality information, we estimated prediction confidence to assess the reliability of predicted outcomes. We adopted a \u201cselect and predict\u201d design philosophy to maximize prediction performance by selectively considering samples with high prediction confidence for recommendations. Our model accommodated irregularly sampled observational data to make full use of variable correlations (i.e., with other laboratory test values) and temporal dependencies (i.e., previous laboratory tests performed within the same encounter) in selecting candidates for training and prediction.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The proposed model demonstrated remarkable Hgb prediction performance, achieving a normality AUC of 95.89% and a Hgb stability AUC of 95.94%, while recommending a reduction of 9.91% of Hgb tests that were deemed unnecessary. Additionally, the model could generalize well to external patients admitted to another hospital.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>This study introduces a novel deep learning model with the potential to significantly reduce healthcare costs and improve patient outcomes by identifying unnecessary laboratory tests for hospitalized patients.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12911-023-02187-3","type":"journal-article","created":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T09:07:55Z","timestamp":1683709675000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Confidence-based laboratory test reduction recommendation algorithm"],"prefix":"10.1186","volume":"23","author":[{"given":"Tongtong","family":"Huang","sequence":"first","affiliation":[]},{"given":"Linda T.","family":"Li","sequence":"additional","affiliation":[]},{"given":"Elmer V.","family":"Bernstam","sequence":"additional","affiliation":[]},{"given":"Xiaoqian","family":"Jiang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,5,10]]},"reference":[{"key":"2187_CR1","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1016\/S0140-6736(16)32585-5","volume":"390","author":"S Brownlee","year":"2017","unstructured":"Brownlee S, Chalkidou K, Doust J, Elshaug AG, Glasziou P, Heath I, et al. Evidence for overuse of medical services around the world. Lancet. 2017;390:156\u201368.","journal-title":"Lancet"},{"key":"2187_CR2","doi-asserted-by":"publisher","first-page":"1000","DOI":"10.1001\/jama.280.11.1000","volume":"280","author":"MR Chassin","year":"1998","unstructured":"Chassin MR, Galvin RW. The urgent need to improve health care quality. Institute of Medicine National Roundtable on Health Care Quality. JAMA. 1998;280:1000\u20135.","journal-title":"JAMA."},{"key":"2187_CR3","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1016\/j.tmrv.2020.03.003","volume":"34","author":"A Shander","year":"2020","unstructured":"Shander A, Corwin HL. A narrative review on hospital-acquired anemia: keeping blood where it belongs. Transfus Med Rev. 2020;34:195\u20139.","journal-title":"Transfus Med Rev"},{"key":"2187_CR4","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1016\/S0025-7125(16)30838-0","volume":"71","author":"BE Statland","year":"1987","unstructured":"Statland BE, Winkel P. Utilization review and management of laboratory testing in the ambulatory setting. Med Clin North Am. 1987;71:719\u201332.","journal-title":"Med Clin North Am"},{"key":"2187_CR5","first-page":"217","volume":"2017","author":"SK Roy","year":"2018","unstructured":"Roy SK, Hom J, Mackey L, Shah N, Chen JH. Predicting low information laboratory diagnostic tests. AMIA Jt Summits Transl Sci Proc. 2018;2017:217\u201326.","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"key":"2187_CR6","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1186\/1471-2288-13-62","volume":"13","author":"K Nasserinejad","year":"2013","unstructured":"Nasserinejad K, de Kort W, Baart M, Kom\u00e1rek A, van Rosmalen J, Lesaffre E. Predicting hemoglobin levels in whole blood donors using transition models and mixed effects models. BMC Med Res Methodol. 2013;13:62.","journal-title":"BMC Med Res Methodol"},{"key":"2187_CR7","doi-asserted-by":"publisher","first-page":"101823","DOI":"10.1016\/j.artmed.2020.101823","volume":"104","author":"B Lobo","year":"2020","unstructured":"Lobo B, Abdel-Rahman E, Brown D, Dunn L, Bowman B. A recurrent neural network approach to predicting hemoglobin trajectories in patients with End-Stage Renal Disease. Artif Intell Med. 2020;104:101823.","journal-title":"Artif Intell Med"},{"key":"2187_CR8","doi-asserted-by":"publisher","first-page":"101898","DOI":"10.1016\/j.artmed.2020.101898","volume":"107","author":"OJ Pellicer-Valero","year":"2020","unstructured":"Pellicer-Valero OJ, Cattinelli I, Neri L, Mari F, Mart\u00edn-Guerrero JD, Barbieri C. Enhanced prediction of hemoglobin concentration in a very large cohort of hemodialysis patients by means of deep recurrent neural networks. Artif Intell Med. 2020;107:101898.","journal-title":"Artif Intell Med"},{"key":"2187_CR9","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1016\/j.ijmedinf.2012.11.017","volume":"82","author":"F Cismondi","year":"2013","unstructured":"Cismondi F, Celi LA, Fialho AS, Vieira SM, Reti SR, Sousa JMC, et al. Reducing unnecessary lab testing in the ICU with artificial intelligence. Int J Med Inform. 2013;82:345\u201358.","journal-title":"Int J Med Inform"},{"key":"2187_CR10","first-page":"515","volume":"2019","author":"RC Aikens","year":"2019","unstructured":"Aikens RC, Balasubramanian S, Chen JH. A Machine Learning Approach to Predicting the Stability of Inpatient Lab Test Results. AMIA Jt Summits Transl Sci Proc. 2019;2019:515\u201323.","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"key":"2187_CR11","doi-asserted-by":"publisher","first-page":"103394","DOI":"10.1016\/j.jbi.2020.103394","volume":"104","author":"L Yu","year":"2020","unstructured":"Yu L, Zhang Q, Bernstam EV, Jiang X. Predict or draw blood: An integrated method to reduce lab tests. J Biomed Inform. 2020;104:103394.","journal-title":"J Biomed Inform"},{"key":"2187_CR12","doi-asserted-by":"publisher","first-page":"104282","DOI":"10.1016\/j.ijmedinf.2020.104282","volume":"144","author":"L Yu","year":"2020","unstructured":"Yu L, Li L, Bernstam E, Jiang X. A deep learning solution to recommend laboratory reduction strategies in ICU. Int J Med Inform. 2020;144:104282.","journal-title":"Int J Med Inform"},{"key":"2187_CR13","doi-asserted-by":"publisher","first-page":"845","DOI":"10.1038\/ki.2014.114","volume":"86","author":"T Kuragano","year":"2014","unstructured":"Kuragano T, Matsumura O, Matsuda A, Hara T, Kiyomoto H, Murata T, et al. Association between hemoglobin variability, serum ferritin levels, and adverse events\/mortality in maintenance hemodialysis patients. Kidney Int. 2014;86:845\u201354.","journal-title":"Kidney Int"},{"key":"2187_CR14","doi-asserted-by":"publisher","first-page":"2042","DOI":"10.1161\/01.CIR.0000162477.70955.5F","volume":"111","author":"MS Sabatine","year":"2005","unstructured":"Sabatine MS, Morrow DA, Giugliano RP, Burton PBJ, Murphy SA, McCabe CH, et al. Association of hemoglobin levels with clinical outcomes in acute coronary syndromes. Circulation. 2005;111:2042\u20139.","journal-title":"Circulation"},{"key":"2187_CR15","unstructured":"Gal Y, Ghahramani Z. Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. arXiv [stat.ML]. 2015."},{"key":"2187_CR16","unstructured":"Neal RM. Bayesian Learning for Neural Networks. Springer Science & Business Media; 2012."},{"key":"2187_CR17","unstructured":"Geifman Y, El-Yaniv R. SelectiveNet: A deep neural network with an integrated reject option. arXiv [cs.LG]. 09--15 Jun 2019;:2151\u20139."},{"key":"2187_CR18","unstructured":"Lipton ZC, Kale DC, Wetzel R. Modeling missing data in clinical time series with RNNs. arXiv [cs.LG]. 2016."},{"key":"2187_CR19","unstructured":"Raffel C, Ellis DPW. Feed-Forward Networks with Attention Can Solve Some Long-Term Memory Problems. arXiv [cs.LG]. 2015."},{"key":"2187_CR20","unstructured":"Liu P, Qiu X, Huang X. Recurrent Neural Network for Text Classification with Multi-Task Learning. arXiv [cs.CL]. 2016."},{"key":"2187_CR21","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1016\/S0377-0427(00)00433-7","volume":"124","author":"FA Potra","year":"2000","unstructured":"Potra FA, Wright SJ. Interior-point methods. J Comput Appl Math. 2000;124:281\u2013302.","journal-title":"J Comput Appl Math"},{"key":"2187_CR22","first-page":"85","volume":"48","author":"JS Cramer","year":"1999","unstructured":"Cramer JS. Predictive performance of the binary logit model in unbalanced samples. J Royal Statistical Soc D. 1999;48:85\u201394.","journal-title":"J Royal Statistical Soc D"},{"key":"2187_CR23","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1111\/cts.12614","volume":"12","author":"SC Guerrero","year":"2019","unstructured":"Guerrero SC, Sridhar S, Edmonds C, Solis CF, Zhang J, McPherson DD, et al. Access to routinely collected clinical data for research: a process implemented at an Academic Medical Center. Clin Transl Sci. 2019;12:231\u20135.","journal-title":"Clin Transl Sci"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02187-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-023-02187-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02187-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T09:09:08Z","timestamp":1683709748000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-023-02187-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,10]]},"references-count":23,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2187"],"URL":"https:\/\/doi.org\/10.1186\/s12911-023-02187-3","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.06.20.22276546","asserted-by":"object"}]},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,10]]},"assertion":[{"value":"13 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 April 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 May 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Our research study was approved by the Committee for the Protection of Human Subjects (the UTHSC-H IRB) using the protocol HSC-MS-21\u20130452 [\n                      \n                      ]. There was a waiver of informed consent. All methods were carried out in accordance with relevant guidelines and regulations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"93"}}