{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T04:02:23Z","timestamp":1791518543015,"version":"4.3.4"},"reference-count":19,"publisher":"Walter de Gruyter GmbH","issue":"12","license":[{"start":{"date-parts":[[2021,12,29]],"date-time":"2021-12-29T00:00:00Z","timestamp":1640736000000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,11,25]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec id=\"j_cclm-2021-1171_abs_001\">\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>Delta check (DC) is widely used for detecting sample mix-up. Owing to the inadequate error detection and high false-positive rate, the implementation of DC in real-world settings is labor-intensive and rarely capable of absolute detection of sample mix-ups. The aim of the study was to develop a highly accurate DC method based on designed deep learning to detect sample mix-up.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec id=\"j_cclm-2021-1171_abs_002\">\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>A total of 22 routine hematology test items were adopted for the study. The hematology test results, collected from two hospital laboratories, were independently divided into training, validation, and test sets. By selecting six mainstream algorithms, the Deep Belief Network (DBN) was able to learn error-free and artificially (intentionally) mixed sample results. The model\u2019s analytical performance was evaluated using training and test sets. The model\u2019s clinical validity was evaluated by comparing it with three well-recognized statistical methods.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec id=\"j_cclm-2021-1171_abs_003\">\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>When the accuracy of our model in the training set reached 0.931 at the 22nd epoch, the corresponding accuracy in the validation set was equal to 0.922. The loss values for the training and validation sets showed a similar (change) trend over time. The accuracy in the test set was 0.931 and the area under the receiver operating characteristic curve was 0.977. DBN demonstrated better performance than the three comparator statistical methods. The accuracy of DBN and revised weighted delta check (RwCDI) was 0.931 and 0.909, respectively. DBN performed significantly better than RCV and EDC. Of all test items, the absolute difference of DC yielded higher accuracy than the relative difference for all methods.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec id=\"j_cclm-2021-1171_abs_004\">\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>The findings indicate that input of a group of hematology test items provides more comprehensive information for the accurate detection of sample mix-up by machine learning (ML) when compared with a single test item input method. The DC method based on DBN demonstrated highly effective sample mix-up identification performance in real-world clinical settings.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1515\/cclm-2021-1171","type":"journal-article","created":{"date-parts":[[2021,12,28]],"date-time":"2021-12-28T20:34:26Z","timestamp":1640723666000},"page":"1984-1992","source":"Crossref","is-referenced-by-count":24,"title":["A highly accurate delta check method using deep learning for detection of sample mix-up in the clinical laboratory"],"prefix":"10.1515","volume":"60","author":[{"given":"Rui","family":"Zhou","sequence":"first","affiliation":[{"name":"Department of Laboratory Medicine , Beijing Chao-yang Hospital, Capital Medical University , Beijing , P.R. China"},{"name":"Beijing Center for Clinical Laboratories , Beijing , P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu-fang","family":"Liang","sequence":"additional","affiliation":[{"name":"Department of Laboratory Medicine , Beijing Chao-yang Hospital, Capital Medical University , Beijing , P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hua-Li","family":"Cheng","sequence":"additional","affiliation":[{"name":"Department of Laboratory Medicine , Beijing Chao-yang Hospital, Capital Medical University , Beijing , P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Blood Transfusion , Beijing Ditan Hospital, Capital Medical University , Beijing , P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Da-wei","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Laboratory Medicine , Beijing Longfu Hospital , Beijing , P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhe","family":"Wang","sequence":"additional","affiliation":[{"name":"Inner Mongolia Wesure Date Technology Co., Ltd , Inner Mongolia , P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiang","family":"Feng","sequence":"additional","affiliation":[{"name":"Inner Mongolia Wesure Date Technology Co., Ltd , Inner Mongolia , P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ze-wen","family":"Han","sequence":"additional","affiliation":[{"name":"Inner Mongolia Wesure Date Technology Co., Ltd , Inner Mongolia , P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Biao","family":"Song","sequence":"additional","affiliation":[{"name":"Inner Mongolia Wesure Date Technology Co., Ltd , Inner Mongolia , P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1284-7885","authenticated-orcid":false,"given":"Andrea","family":"Padoan","sequence":"additional","affiliation":[{"name":"Department of Laboratory Medicine , University Hospital of Padova , Padova , Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0270-1711","authenticated-orcid":false,"given":"Mario","family":"Plebani","sequence":"additional","affiliation":[{"name":"Department of Laboratory Medicine , University Hospital of Padova , Padova , Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qing-tao","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Laboratory Medicine , Beijing Chao-yang Hospital, Capital Medical University , Beijing , P.R. China"},{"name":"Beijing Center for Clinical Laboratories , Beijing , P.R. China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"374","published-online":{"date-parts":[[2021,12,29]]},"reference":[{"key":"2023033111540077314_j_cclm-2021-1171_ref_001","doi-asserted-by":"crossref","unstructured":"Da Rin, G. Pre-analytical workstations: a tool for reducing laboratory errors. Clin Chim Acta 2009;404:68\u201374. https:\/\/doi.org\/10.1016\/j.cca.2009.03.024.","DOI":"10.1016\/j.cca.2009.03.024"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_002","doi-asserted-by":"crossref","unstructured":"Lundberg, GD. Acting on significant laboratory results. JAMA 1981;245:1762\u20133. https:\/\/doi.org\/10.1001\/jama.1981.03310420052033.","DOI":"10.1001\/jama.1981.03310420052033"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_003","doi-asserted-by":"crossref","unstructured":"Plebani, M. The detection and prevention of errors in laboratory medicine. Ann Clin Biochem 2010;47(2 Pt):101\u201310. https:\/\/doi.org\/10.1258\/acb.2009.009222.","DOI":"10.1258\/acb.2009.009222"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_004","doi-asserted-by":"crossref","unstructured":"Lippi, G, Guidi, GC, Mattiuzzi, C, Plebani, M. Preanalytical variability: the dark side of the moon in laboratory testing. Clin Chem Lab Med 2006;44:358\u201365. https:\/\/doi.org\/10.1515\/CCLM.2006.073.","DOI":"10.1515\/CCLM.2006.073"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_005","doi-asserted-by":"crossref","unstructured":"Lippi, G, Bowen, R, Adcock, DM. Re-engineering laboratory diagnostics for preventing preanalytical errors. Clin Biochem 2016;49:1313\u20134. https:\/\/doi.org\/10.1016\/j.clinbiochem.2016.10.010.","DOI":"10.1016\/j.clinbiochem.2016.10.010"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_006","doi-asserted-by":"crossref","unstructured":"Nosanchuk, JS, Gottmann, AW. CUMS and delta checks. A systematic approach to quality control. Am J Clin Pathol 1974;62:707\u201312. https:\/\/doi.org\/10.1093\/ajcp\/62.5.707.","DOI":"10.1093\/ajcp\/62.5.707"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_007","doi-asserted-by":"crossref","unstructured":"Ladenson, JH. Patients as their own controls: use of the computer to identify \u201claboratory error\u201d. Clin Chem 1975;21:1648\u201353. https:\/\/doi.org\/10.1093\/clinchem\/21.11.1648.","DOI":"10.1093\/clinchem\/21.11.1648"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_008","doi-asserted-by":"crossref","unstructured":"Randell, EW, Yenice, S. Delta checks in the clinical laboratory. Crit Rev Clin Lab Sci 2019;56:75\u201397. https:\/\/doi.org\/10.1080\/10408363.2018.1540536.","DOI":"10.1080\/10408363.2018.1540536"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_009","doi-asserted-by":"crossref","unstructured":"Tan, RZ, Markus, C, Choy, KW, Doery, JCG, Loh, TP. Optimized delta check rules for detecting misidentified specimens in children. Am J Clin Pathol 2020;153:605\u201312. https:\/\/doi.org\/10.1093\/ajcp\/aqz201.","DOI":"10.1093\/ajcp\/aqz201"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_010","doi-asserted-by":"crossref","unstructured":"Tan, RZ, Markus, C, Loh, TP. An approach to optimize delta checks in test panels\u00a0\u2013 the effect of the number of rules included. Ann Clin Biochem 2020;57:215\u201322. https:\/\/doi.org\/10.1177\/0004563220904749.","DOI":"10.1177\/0004563220904749"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_011","unstructured":"Mitchell, TM. Does machine learning really work? AI Mag 1997;18:11\u201320."},{"key":"2023033111540077314_j_cclm-2021-1171_ref_012","doi-asserted-by":"crossref","unstructured":"Zhao, BW, You, ZH, Hu, L, Guo, ZH, Wang, L, Chen, ZH, et al.. A novel method to predict drug-target interactions based on large-scale graph representation learning. Cancers (Basel) 2021;13:2111. https:\/\/doi.org\/10.3390\/cancers13092111.","DOI":"10.3390\/cancers13092111"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_013","doi-asserted-by":"crossref","unstructured":"Tan, RZ, Markus, C, Loh, TP. Relationship between biological variation and delta check rules performance. Clin Biochem 2020;80:42\u20137. https:\/\/doi.org\/10.1016\/j.clinbiochem.2020.03.017.","DOI":"10.1016\/j.clinbiochem.2020.03.017"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_014","doi-asserted-by":"crossref","unstructured":"Ric\u00f3s, C, Alvarez, V, Cava, F, Garc\u00eda-Lario, JV, Hern\u00e1ndez, A, Jim\u00e9nez, CV, et al.. Current databases on biological variation: pros, cons and progress. Scand J Clin Lab Invest 1999;59:491\u2013500.","DOI":"10.1080\/00365519950185229"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_015","doi-asserted-by":"crossref","unstructured":"Ichihara, K, Kawai, T. Determination of reference intervals for 13 plasma proteins based on IFCC international reference preparation (CRM470) and NCCLS proposed guideline (C28-P, 1992): a strategy for partitioning reference individuals with validation based on multivariate analysis. J Clin Lab Anal 1997;11:117\u201324. https:\/\/doi.org\/10.1002\/(sici)1098-2825(1997)11:2<117::aid-jcla8>3.0.co;2-8.","DOI":"10.1002\/(SICI)1098-2825(1997)11:2<117::AID-JCLA8>3.0.CO;2-8"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_016","doi-asserted-by":"crossref","unstructured":"Yamashita, T, Ichihara, K, Miyamoto, A. A novel weighted cumulative delta-check method for highly sensitive detection of specimen mix-up in the clinical laboratory. Clin Chem Lab Med 2013;51:781\u20139. https:\/\/doi.org\/10.1515\/cclm-2012-0752.","DOI":"10.1515\/cclm-2012-0752"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_017","doi-asserted-by":"crossref","unstructured":"Lippi, G, Blanckaert, N, Bonini, P, Green, S, Kitchen, S, Palicka, V, et al.. Causes, consequences, detection, and prevention of identification errors in laboratory diagnostics. Clin Chem Lab Med 2009;47:143\u201353. https:\/\/doi.org\/10.1515\/CCLM.2009.045.","DOI":"10.1515\/CCLM.2009.045"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_018","doi-asserted-by":"crossref","unstructured":"Hong, J, Cho, EJ, Kim, HK, Lee, W, Chun, S, Min, WK. Application and\u00a0optimization of reference change values for delta checks in clinical laboratory. J Clin Lab Anal 2020;34:e23550. https:\/\/doi.org\/10.1002\/jcla.23550.","DOI":"10.1002\/jcla.23550"},{"key":"2023033111540077314_j_cclm-2021-1171_ref_019","unstructured":"Clinical and Laboratory Standards Institute (CLSI). Use of Delta Checks in the Medical Laboratory, CLSI guideline EP33. 1st ed. Clinical and Laboratory Standards Institute, 950 West Valley Road, Suite 2500, Wayne, Pennsylvania 19087 USA, 2016."}],"container-title":["Clinical Chemistry and Laboratory Medicine (CCLM)"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/cclm-2021-1171\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/cclm-2021-1171\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,31]],"date-time":"2023-03-31T16:01:12Z","timestamp":1680278472000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/cclm-2021-1171\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,29]]},"references-count":19,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,11,4]]},"published-print":{"date-parts":[[2022,11,25]]}},"alternative-id":["10.1515\/cclm-2021-1171"],"URL":"https:\/\/doi.org\/10.1515\/cclm-2021-1171","relation":{},"ISSN":["1434-6621","1437-4331"],"issn-type":[{"value":"1434-6621","type":"print"},{"value":"1437-4331","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,29]]}}}