{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,19]],"date-time":"2026-11-19T13:11:38Z","timestamp":1795093898498,"version":"4.10.2"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,5,2]],"date-time":"2023-05-02T00:00:00Z","timestamp":1682985600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,2]],"date-time":"2023-05-02T00:00:00Z","timestamp":1682985600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Capital\u2019s Funds for Health Improvement and Research","award":["CFH-2020-1-4014"],"award-info":[{"award-number":["CFH-2020-1-4014"]}]},{"name":"Beijing Key Clinical Specialty for Laboratory Medicine - Excellent Project","award":["No. ZK201000"],"award-info":[{"award-number":["No. ZK201000"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Despite the extensive research on data mining algorithms, there is still a lack of a standard protocol to evaluate the performance of the existing algorithms. Therefore, the study aims to provide a novel procedure that combines data mining algorithms and simplified preprocessing to establish reference intervals (RIs), with the performance of five algorithms assessed objectively as well.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Two data sets were derived from the population undergoing a physical examination. Hoffmann, Bhattacharya, Expectation Maximum (EM), kosmic, and refineR algorithms combined with two-step data preprocessing respectively were implemented in the Test data set to establish RIs for thyroid-related hormones. Algorithm-calculated RIs were compared with the standard RIs calculated from the Reference data set in which reference individuals were selected following strict inclusion and exclusion criteria. Objective assessment of the methods is implemented by the bias ratio (BR) matrix.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>RIs of thyroid-related hormones are established. There is a high consistency between TSH RIs established by the EM algorithm and the standard TSH RIs (BR\u2009=\u20090.063), although EM algorithms seems to perform poor on other hormones. RIs calculated by Hoffmann, Bhattacharya, and refineR methods for free and total triiodo-thyronine, free and total thyroxine respectively are close and match the standard RIs.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>An effective approach for objectively evaluating the performance of the algorithm based on the BR matrix is established. EM algorithm combined with simplified preprocessing can handle data with significant skewness, but its performance is limited in other scenarios. The other four algorithms perform well for data with Gaussian or near-Gaussian distribution. Using the appropriate algorithm based on the data distribution characteristics is recommended.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12874-023-01898-5","type":"journal-article","created":{"date-parts":[[2023,5,2]],"date-time":"2023-05-02T10:02:23Z","timestamp":1683021743000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Utilization of five data mining algorithms combined with simplified preprocessing to establish reference intervals of thyroid-related hormones for non-elderly adults"],"prefix":"10.1186","volume":"23","author":[{"given":"Jian","family":"Zhong","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chaochao","family":"Ma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li\u2019an","family":"Hou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yicong","family":"Yin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fang","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yingying","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ailing","family":"Song","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danchen","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinqi","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ling","family":"Qiu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,5,2]]},"reference":[{"issue":"5","key":"1898_CR1","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1038\/nrendo.2018.18","volume":"14","author":"PN Taylor","year":"2018","unstructured":"Taylor PN, Albrecht D, Scholz A, Gutierrez-Buey G, Lazarus JH, Dayan CM, Okosieme OE. Global epidemiology of hyperthyroidism and hypothyroidism. Nat Rev Endocrinol. 2018;14(5):301\u201316.","journal-title":"Nat Rev Endocrinol"},{"issue":"10047","key":"1898_CR2","doi-asserted-by":"publisher","first-page":"906","DOI":"10.1016\/S0140-6736(16)00278-6","volume":"388","author":"S De Leo","year":"2016","unstructured":"De Leo S, Lee SY, Braverman LE. Hyperthyroidism. Lancet. 2016;388(10047):906\u201318.","journal-title":"Lancet"},{"issue":"10101","key":"1898_CR3","doi-asserted-by":"publisher","first-page":"1550","DOI":"10.1016\/S0140-6736(17)30703-1","volume":"390","author":"L Chaker","year":"2017","unstructured":"Chaker L, Bianco AC, Jonklaas J, Peeters RP. Hypothyroidism Lancet. 2017;390(10101):1550\u201362.","journal-title":"Hypothyroidism Lancet"},{"issue":"10","key":"1898_CR4","doi-asserted-by":"publisher","first-page":"1082","DOI":"10.1016\/j.amjmed.2016.06.013","volume":"129","author":"A Carle","year":"2016","unstructured":"Carle A, Pedersen IB, Knudsen N, Perrild H, Ovesen L, Andersen S, Laurberg P. Hypothyroid symptoms fail to predict thyroid insufficiency in old people: a population-based case-control study. Am J Med. 2016;129(10):1082\u201392.","journal-title":"Am J Med"},{"issue":"2","key":"1898_CR5","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1001\/jama.2019.9052","volume":"322","author":"B Biondi","year":"2019","unstructured":"Biondi B, Cappola AR, Cooper DS. Subclinical Hypothyroidism: A Review. JAMA. 2019;322(2):153\u201360.","journal-title":"JAMA"},{"issue":"1","key":"1898_CR6","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1515\/cclm-2018-0073","volume":"57","author":"GRD Jones","year":"2018","unstructured":"Jones GRD, Haeckel R, Loh TP, Sikaris K, Streichert T, Katayev A, Barth JH, Ozarda Y. Intervals ICoR, Decision L Indirect methods for reference interval determination - review and recommendations. Clin Chem Lab Med. 2018;57(1):20\u20139.","journal-title":"Clin Chem Lab Med"},{"issue":"9","key":"1898_CR7","doi-asserted-by":"publisher","first-page":"1175","DOI":"10.1093\/clinchem\/hvab137","volume":"67","author":"AE Obstfeld","year":"2021","unstructured":"Obstfeld AE, Patel K, Boyd JC, Drees J, Holmes DT, Ioannidis JPA, Manrai AK. Data mining approaches to reference interval studies. Clin Chem. 2021;67(9):1175\u201381.","journal-title":"Clin Chem"},{"key":"1898_CR8","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.clinbiochem.2020.06.014","volume":"84","author":"C Ma","year":"2020","unstructured":"Ma C, Wang X, Wu J, Cheng X, Xia L, Xue F, Qiu L. Real-world big-data studies in laboratory medicine: current status, application, and future considerations. Clin Biochem. 2020;84:21\u201330.","journal-title":"Clin Biochem"},{"issue":"3","key":"1898_CR9","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1515\/cclm-2016-1112","volume":"55","author":"R Haeckel","year":"2017","unstructured":"Haeckel R, Wosniok W, Arzideh F, Zierk J, Gurr E, Streichert T. Critical comments to a recent EFLM recommendation for the review of reference intervals. Clin Chem Lab Med. 2017;55(3):341\u20137.","journal-title":"Clin Chem Lab Med"},{"issue":"1","key":"1898_CR10","doi-asserted-by":"publisher","first-page":"16023","DOI":"10.1038\/s41598-021-95301-2","volume":"11","author":"T Ammer","year":"2021","unstructured":"Ammer T, Sch\u00fctzenmeister A, Prokosch HU, Rauh M, Rank CM, Zierk J. refineR: a novel algorithm for reference interval estimation from real-world data. Sci Rep. 2021;11(1):16023.","journal-title":"Sci Rep"},{"key":"1898_CR11","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1016\/j.cca.2021.05.030","volume":"520","author":"Y Ozarda","year":"2021","unstructured":"Ozarda Y, Ichihara K, Jones G, Streichert T, Ahmadian R. Intervals ICoR, Decision L: comparison of reference intervals derived by direct and indirect methods based on compatible datasets obtained in Turkey. Clin Chim Acta. 2021;520:186\u201395.","journal-title":"Clin Chim Acta"},{"issue":"2","key":"1898_CR12","first-page":"99","volume":"40","author":"CL Farrell","year":"2019","unstructured":"Farrell CL, Nguyen L. Indirect reference intervals: harnessing the power of stored laboratory data. Clin Biochem Rev. 2019;40(2):99\u2013111.","journal-title":"Clin Biochem Rev"},{"key":"1898_CR13","doi-asserted-by":"publisher","first-page":"864","DOI":"10.1001\/jama.1963.03060110068020","volume":"185","author":"RG Hoffmann","year":"1963","unstructured":"Hoffmann RG. Statistics in the practice of medicine. JAMA. 1963;185:864\u201373.","journal-title":"JAMA"},{"issue":"1","key":"1898_CR14","doi-asserted-by":"publisher","first-page":"115","DOI":"10.2307\/2528285","volume":"23","author":"CG Bhattacharya","year":"1967","unstructured":"Bhattacharya CG. A simple method of resolution of a distribution into gaussian components. Biometrics. 1967;23(1):115\u201335.","journal-title":"Biometrics"},{"issue":"1\u20132","key":"1898_CR15","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.cca.2009.03.057","volume":"405","author":"D Concordet","year":"2009","unstructured":"Concordet D, Geffr\u00e9 A, Braun JP, Trumel C. A new approach for the determination of reference intervals from hospital-based data. Clin Chim Acta. 2009;405(1\u20132):43\u20138.","journal-title":"Clin Chim Acta"},{"issue":"1","key":"1898_CR16","doi-asserted-by":"publisher","first-page":"1704","DOI":"10.1038\/s41598-020-58749-2","volume":"10","author":"J Zierk","year":"2020","unstructured":"Zierk J, Arzideh F, Kapsner LA, Prokosch HU, Metzler M, Rauh M. Reference interval estimation from mixed distributions using truncation points and the Kolmogorov-Smirnov Distance (kosmic). Sci Rep. 2020;10(1):1704.","journal-title":"Sci Rep"},{"key":"1898_CR17","unstructured":"Zhang S, Mo Y, Cheng F, Jia T, Zhao Y, Wang M, Yue Y, Zhang R, Xu J, Zhao Y et al. Establishment of reference intervals for thyroid stimulating hormone measurement by big data and indirect method in adults. Chin J Lab Med. 2021;44(7):627\u201332."},{"key":"1898_CR18","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/j.clinbiochem.2020.03.012","volume":"80","author":"C Ma","year":"2020","unstructured":"Ma C, Cheng X, Xue F, Li X, Yin Y, Wu J, Xia L, Guo X, Hu Y, Qiu L, et al. Validation of an approach using only patient big data from clinical laboratories to establish reference intervals for thyroid hormones based on data mining. Clin Biochem. 2020;80:25\u201330.","journal-title":"Clin Biochem"},{"issue":"1\u20132","key":"1898_CR19","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1016\/j.cca.2008.06.017","volume":"396","author":"H Pottel","year":"2008","unstructured":"Pottel H, Vrydags N, Mahieu B, Vandewynckele E, Croes K, Martens F. Establishing age\/sex related serum creatinine reference intervals from hospital laboratory data based on different statistical methods. Clin Chim Acta. 2008;396(1\u20132):49\u201355.","journal-title":"Clin Chim Acta"},{"key":"1898_CR20","doi-asserted-by":"crossref","unstructured":"Ammer T, Sch\u00fctzenmeister A, Prokosch HU, Zierk J, Rank CM, Rauh M. RIbench. A proposed benchmark for the standardized evaluation of indirect methods for reference interval estimation. Clin Chem. 2022;68(11):1410\u201324.","DOI":"10.1093\/clinchem\/hvac142"},{"issue":"3","key":"1898_CR21","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1093\/ajcp\/aqy149","volume":"151","author":"DT Holmes","year":"2019","unstructured":"Holmes DT, Buhr KA. Widespread Incorrect Implementation of the Hoffmann method, the correct approach, and modern alternatives. Am J Clin Pathol. 2019;151(3):328\u201336.","journal-title":"Am J Clin Pathol"},{"issue":"3","key":"1898_CR22","first-page":"384","volume":"39","author":"D Wang","year":"2020","unstructured":"Wang D, Ma C, Zou Y, Yu S, Li H, Cheng X, Qiu L, Xu T. Gender and age-specific reference intervals of common biochemical analytes in Chinese population: derivation using real laboratory data. J Med Biochem. 2020;39(3):384\u201391.","journal-title":"J Med Biochem"},{"key":"1898_CR23","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1016\/j.cca.2020.03.012","volume":"506","author":"D Wang","year":"2020","unstructured":"Wang D, Yu S, Zou Y, Li H, Cheng X, Qiu L, Xu T. Data mining: Seasonal fluctuations and associations between thyroid stimulating hormone and lipid profiles. Clin Chim Acta. 2020;506:122\u20138.","journal-title":"Clin Chim Acta"},{"issue":"11","key":"1898_CR24","doi-asserted-by":"publisher","first-page":"1537","DOI":"10.1515\/CCLM.2010.319","volume":"48","author":"K Ichihara","year":"2010","unstructured":"Ichihara K, Boyd JC. An appraisal of statistical procedures used in derivation of reference intervals. Clin Chem Lab Med. 2010;48(11):1537\u201351.","journal-title":"Clin Chem Lab Med"},{"key":"1898_CR25","volume-title":"CLSI Defining, Establishing, and Verifying Reference Intervals in the Clinical Laboratory; Approved Guideline. CLSI document EP28-A3c","author":"PA Wayne","year":"2008","unstructured":"Wayne PA. CLSI defining, establishing, and verifying reference intervals in the clinical laboratory; approved guideline. CLSI document EP28-A3c. 3rd ed. 2008.","edition":"3"},{"issue":"1","key":"1898_CR26","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1186\/s12874-022-01751-1","volume":"22","author":"C Ma","year":"2022","unstructured":"Ma C, Hou L, Zou Y, Ma X, Wang D, Hu Y, Song A, Cheng X, Qiu L. An innovative approach based on real-world big data mining for calculating the sample size of the reference interval established using transformed parametric and non-parametric methods. BMC Med Res Methodol. 2022;22(1):275.","journal-title":"BMC Med Res Methodol"},{"key":"1898_CR27","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1016\/j.clinbiochem.2021.03.006","volume":"92","author":"C Ma","year":"2021","unstructured":"Ma C, Wang X, Xia L, Cheng X, Qiu L. Effect of sample size and the traditional parametric, nonparametric, and robust methods on the establishment of reference intervals: evidence from real world data. Clin Biochem. 2021;92:67\u201370.","journal-title":"Clin Biochem"},{"issue":"12","key":"1898_CR28","doi-asserted-by":"publisher","first-page":"1571","DOI":"10.1089\/thy.2017.0715","volume":"28","author":"X Zhai","year":"2018","unstructured":"Zhai X, Zhang L, Chen L, Lian X, Liu C, Shi B, Shi L, Tong N, Wang S, Weng J, et al. An age-specific serum thyrotropin reference range for the diagnosis of thyroid diseases in older adults: a cross-sectional survey in China. Thyroid. 2018;28(12):1571\u20139.","journal-title":"Thyroid"},{"issue":"20","key":"1898_CR29","doi-asserted-by":"publisher","first-page":"1961","DOI":"10.1001\/jama.2019.14728","volume":"322","author":"AR Cappola","year":"2019","unstructured":"Cappola AR. The Thyrotropin Reference Range Should Be Changed in Older Patients. JAMA. 2019;322(20):1961\u20132.","journal-title":"JAMA"},{"key":"1898_CR30","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.cca.2019.06.011","volume":"496","author":"D Wang","year":"2019","unstructured":"Wang D, Yu S, Cheng X, Cao L, Zhang H, Liu L, Tang Y, Cai Q, Li P, Ma C, et al. Nationwide Chinese study for establishing reference intervals for thyroid hormones and related tests. Clin Chim Acta. 2019;496:62\u20137.","journal-title":"Clin Chim Acta"},{"key":"1898_CR31","doi-asserted-by":"crossref","unstructured":"Haeckel R, Wosniok W. The importance of correct stratifications when comparing directly and indirectly estimated reference intervals. Clin Chem Lab Med. 2021;59(10):1628\u201333.","DOI":"10.1515\/cclm-2021-0353"},{"key":"1898_CR32","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1016\/j.clinbiochem.2022.05.008","volume":"107","author":"C Ma","year":"2022","unstructured":"Ma C, Zou Y, Hou L, Yin Y, Zhao F, Hu Y, Wang D, Li L, Cheng X, Qiu L. Validation and comparison of five data mining algorithms using big data from clinical laboratories to establish reference intervals of thyroid hormones for older adults. Clin Biochem. 2022;107:40\u20139.","journal-title":"Clin Biochem"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-023-01898-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12874-023-01898-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-023-01898-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,2]],"date-time":"2023-05-02T10:06:40Z","timestamp":1683022000000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-023-01898-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,2]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["1898"],"URL":"https:\/\/doi.org\/10.1186\/s12874-023-01898-5","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,2]]},"assertion":[{"value":"14 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 May 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study is part of the Real-World Study of Big Data Mining in Laboratory Medicine (CFH-2020\u20134014) and has been conducted in accordance with the Declaration of Helsinki. This retrospective study was approved by the Ethics Committee of Peking Union Medical College & Chinese Academy of Medical Sciences, Peking Union Medical College Hospital (approval number: S-K1192). Informed consent for subjects was waived by the Ethics Committee of Peking Union Medical College & Chinese Academy of Medical Sciences, Peking Union Medical College Hospital. All methods were performed in accordance with relevant guidelines and regulations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"108"}}