{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,28]],"date-time":"2025-09-28T15:09:12Z","timestamp":1759072152660},"reference-count":16,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,6,2]],"date-time":"2021-06-02T00:00:00Z","timestamp":1622592000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,6,2]],"date-time":"2021-06-02T00:00:00Z","timestamp":1622592000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Validation of the autoverification function is one of the critical steps to confirm its effectiveness before use. It is crucial to verify whether the programmed algorithm follows the expected logic and produces the expected results. This process has always relied on the assessment of human\u2013machine consistency and is mostly a manually recorded and time-consuming activity with inherent subjectivity and arbitrariness that cannot guarantee a comprehensive, timely and continuous effectiveness evaluation of the autoverification function. To overcome these inherent limitations, we independently developed and implemented a laboratory information system (LIS)-based validation system for autoverification.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We developed a correctness verification and integrity validation method (hereinafter referred to as the \"new method\") in the form of a human\u2013machine dialog. The system records personnel review steps and determines whether the human\u2013machine review results are consistent. Laboratory personnel then analyze the reasons for any inconsistency according to system prompts, add to or modify rules, reverify, and finally improve the accuracy of autoverification.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The validation system was successfully established and implemented. For a dataset consisting of 833 rules for 30 assays, 782 rules (93.87%) were successfully verified in the correctness verification phase, and 51 rules were deleted due to execution errors. In the integrity validation phase, 24 projects were easily verified, while the other 6 projects still required the additional rules or changes to the rule settings. Taking the Hepatitis B virus test as an example, from the setting of 65 rules to the automated releasing of 3000 reports, the validation time was reduced from 452 (manual verification) to 275\u00a0h (new method), a reduction in validation time of 177\u00a0h. Furthermore, 94.6% (168\/182) of laboratory users believed the new method greatly reduced the workload, effectively controlled the report risk and felt satisfied. Since 2019, over 3.5 million reports have been automatically reviewed and issued without a single clinical complaint.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>To the best of our knowledge, this is the first report to realize autoverification validation as a human\u2013machine interaction. The new method effectively controls the risks of autoverification, shortens time consumption, and improves the efficiency of laboratory verification.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12911-021-01545-3","type":"journal-article","created":{"date-parts":[[2021,6,2]],"date-time":"2021-06-02T04:07:03Z","timestamp":1622606823000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Development and implementation of an LIS-based validation system for autoverification toward zero defects in the automated reporting of laboratory test results"],"prefix":"10.1186","volume":"21","author":[{"given":"Di","family":"Jin","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qing","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dezhi","family":"Peng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiajia","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bijuan","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yating","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nanxun","family":"Mo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoyan","family":"Deng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ran","family":"Tao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,6,2]]},"reference":[{"issue":"2","key":"1545_CR1","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1177\/0004563217712291","volume":"55","author":"J Li","year":"2018","unstructured":"Li J, Cheng B, Ouyang H, Xiao T, Hu J, Cai Y. Designing and evaluating autoverification rules for thyroid function profiles and sex hormone tests. Ann Clin Biochem. 2018;55(2):254\u201363.","journal-title":"Ann Clin Biochem"},{"issue":"1","key":"1545_CR2","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1186\/s12911-019-0848-2","volume":"19","author":"Z Wang","year":"2019","unstructured":"Wang Z, Peng C, Kang H, Fan X, Mu R, Zhou L, He M, Qu B. Design and evaluation of a LIS-based autoverification system for coagulation assays in a core clinical laboratory. BMC Med Inform Decis Mak. 2019;19(1):123.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"6","key":"1545_CR3","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1177\/2472630318775311","volume":"23","author":"J Wu","year":"2018","unstructured":"Wu J, Pan M, Ouyang H, Yang Z, Zhang Q, Cai Y. Establishing and evaluating autoverification rules with intelligent guidelines for arterial blood gas analysis in a clinical laboratory. SLAS Technol. 2018;23(6):631\u201340.","journal-title":"SLAS Technol"},{"key":"1545_CR4","doi-asserted-by":"publisher","first-page":"1740","DOI":"10.1016\/j.dib.2018.04.080","volume":"18","author":"EW Randell","year":"2018","unstructured":"Randell EW, Short G, Lee N, Beresford A, Spencer M, Kennell M, Moores Z, Parry D. Strategy for 90% autoverification of clinical chemistry and immunoassay test results using six sigma process improvement. Data Brief. 2018;18:1740\u20139.","journal-title":"Data Brief"},{"key":"1545_CR5","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.clinbiochem.2018.03.002","volume":"55","author":"EW Randell","year":"2018","unstructured":"Randell EW, Short G, Lee N, Beresford A, Spencer M, Kennell M, Moores Z, Parry D. Autoverification process improvement by Six Sigma approach: clinical chemistry & immunoassay. Clin Biochem. 2018;55:42\u20138.","journal-title":"Clin Biochem"},{"key":"1545_CR6","unstructured":"College of American Pathologists. Laboratory general checklist. Commission on Laboratory Accreditation. Laboratory Accreditation Program; 2013."},{"key":"1545_CR7","unstructured":"Medical laboratories\u2014requirements for quality and competence (ISO 15189:2012, corrected version 2014-08-15); German version EN ISO 15189:2012; 2014."},{"key":"1545_CR8","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1016\/j.cca.2018.07.001","volume":"485","author":"R Palmieri","year":"2018","unstructured":"Palmieri R, Falbo R, Cappellini F, Soldi C, Limonta G, Brambilla P. The development of autoverification rules applied to urinalysis performed on the AutionMAX-SediMAX platform. Clin Chim Acta. 2018;485:275\u201381.","journal-title":"Clin Chim Acta"},{"issue":"5","key":"1545_CR9","doi-asserted-by":"publisher","first-page":"427","DOI":"10.5144\/0256-4947.2014.427","volume":"34","author":"AM Sediq","year":"2014","unstructured":"Sediq AM, Abdel-Azeez AG. Designing an autoverification system in Zagazig University Hospitals Laboratories: preliminary evaluation on thyroid function profile. Ann Saudi Med. 2014;34(5):427\u201332.","journal-title":"Ann Saudi Med"},{"key":"1545_CR10","unstructured":"Autoverification of Clinical Laboratory Quantitative Test Results. In: National Health Commission of the People's Republic of China; 2018."},{"key":"1545_CR11","unstructured":"CLSI: Autoverification of Clinical Laboratory Test Results; Approved Guideline, AUTO10AE; 2006."},{"key":"1545_CR12","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1016\/j.cca.2020.05.026","volume":"508","author":"HH van Rossum","year":"2020","unstructured":"van Rossum HH. An approach to selecting auto-verification limits and validating their error detection performance independently for pre-analytical and analytical errors. Clin Chim Acta. 2020;508:130\u20136.","journal-title":"Clin Chim Acta"},{"issue":"1","key":"1545_CR13","doi-asserted-by":"publisher","first-page":"13","DOI":"10.4103\/2153-3539.129450","volume":"5","author":"MD Krasowski","year":"2014","unstructured":"Krasowski MD, Davis SR, Drees D, Morris C, Kulhavy J, Crone C, Bebber T, Clark I, Nelson DL, Teul S, et al. Autoverification in a core clinical chemistry laboratory at an academic medical center. J Pathol Inform. 2014;5(1):13.","journal-title":"J Pathol Inform"},{"issue":"1","key":"1545_CR14","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/j.cll.2012.11.004","volume":"33","author":"JB Jones","year":"2013","unstructured":"Jones JB. A strategic informatics approach to autoverification. Clin Lab Med. 2013;33(1):161\u201381.","journal-title":"Clin Lab Med"},{"issue":"4","key":"1545_CR15","first-page":"549","volume":"66","author":"Q Fu","year":"2020","unstructured":"Fu Q, Ye C, Han B, Zhan X, Chen K, Huang F, Miao L, Yang S, Wang W. Designing and validating autoverification rules for hematology analysis in Sysmex XN-9000 hematology system. Clin Lab. 2020;66(4):549\u201356.","journal-title":"Clin Lab."},{"issue":"11","key":"1545_CR16","doi-asserted-by":"publisher","first-page":"1355","DOI":"10.1515\/CCLM.2009.316","volume":"47","author":"GC Guidi","year":"2009","unstructured":"Guidi GC, Poli G, Bassi A, Giobelli L, Benetollo PP, Lippi G. Development and implementation of an automatic system for verification, validation and delivery of laboratory test results. Clin Chem Lab Med. 2009;47(11):1355\u201360.","journal-title":"Clin Chem Lab Med"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01545-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-021-01545-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01545-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,29]],"date-time":"2022-12-29T10:41:22Z","timestamp":1672310482000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-021-01545-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,2]]},"references-count":16,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1545"],"URL":"https:\/\/doi.org\/10.1186\/s12911-021-01545-3","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,2]]},"assertion":[{"value":"23 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 May 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 June 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study was approved by the ethics review board of KingMed Diagnostics. The study adhered to relevant guidelines and regulations. The patient consent was waived by the approving ethics review board, as utilization of anonymized history data does not require patient consent.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"174"}}