{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T01:46:59Z","timestamp":1778291219482,"version":"3.51.4"},"reference-count":27,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2023,4,26]],"date-time":"2023-04-26T00:00:00Z","timestamp":1682467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006578","name":"Chi Mei Medical Center","doi-asserted-by":"publisher","award":["CMFHR11132"],"award-info":[{"award-number":["CMFHR11132"]}],"id":[{"id":"10.13039\/501100006578","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Precocious puberty in girls is defined as the onset of pubertal changes before 8 years of age, and gonadotropin-releasing hormone (GnRH) agonist treatment is available for central precocious puberty (CPP). The gold standard for diagnosing CPP is the GnRH stimulation test. However, the GnRH stimulation test is time-consuming, costly, and requires repeated blood sampling. We aimed to develop an artificial intelligence (AI) prediction model to assist pediatric endocrinologists in decision making regarding the optimal timing to perform the GnRH stimulation test. We reviewed the medical charts of 161 girls who received the GnRH stimulation test from 1 August 2010 to 31 August 2021, and we selected 15 clinically relevant features for machine learning modeling. We chose the models with the highest area under the receiver operating characteristic curve (AUC) to integrate into our computerized physician order entry (CPOE) system. The AUC values for the CPP diagnosis prediction model (LH \u2265 5 IU\/L) were 0.884 with logistic regression, 0.912 with random forest, 0.942 with LightGBM, and 0.942 with XGBoost. For the Taiwan National Health Insurance treatment coverage prediction model (LH \u2265 10 IU\/L), the AUC values were 0.909, 0.941, 0.934, and 0.881, respectively. In conclusion, our AI predictive system can assist pediatric endocrinologists when they are deciding whether a girl with suspected CPP should receive a GnRH stimulation test. With proper use, this prediction model may possibly avoid unnecessary invasive blood sampling for GnRH stimulation tests.<\/jats:p>","DOI":"10.3390\/diagnostics13091550","type":"journal-article","created":{"date-parts":[[2023,4,26]],"date-time":"2023-04-26T04:42:54Z","timestamp":1682484174000},"page":"1550","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Machine Learning Approach for Prediction of the Test Results of Gonadotropin-Releasing Hormone Stimulation: Model Building and Implementation"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3284-354X","authenticated-orcid":false,"given":"Yu-Shao","family":"Chen","sequence":"first","affiliation":[{"name":"Department of Pediatrics, Chi Mei Medical Center, No. 901 Zhonghua Rd., Yongkang District, Tainan City 710402, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6698-0273","authenticated-orcid":false,"given":"Chung-Feng","family":"Liu","sequence":"additional","affiliation":[{"name":"Medical Research Department, Chi Mei Medical Center, No. 901 Zhonghua Rd., Yongkang District, Tainan City 710402, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mei-I","family":"Sung","sequence":"additional","affiliation":[{"name":"Medical Research Department, Chi Mei Medical Center, No. 901 Zhonghua Rd., Yongkang District, Tainan City 710402, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shio-Jean","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Chi Mei Medical Center, No. 901 Zhonghua Rd., Yongkang District, Tainan City 710402, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wen-Hui","family":"Tsai","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Chi Mei Medical Center, No. 901 Zhonghua Rd., Yongkang District, Tainan City 710402, Taiwan"},{"name":"Graduate Institute of Medical Sciences, College of Health Sciences, Chang Jung Christian University, No. 1 Changda Rd., Gueiren District, Tainan City 711301, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,26]]},"reference":[{"key":"ref_1","unstructured":"Kota, A.S., and Ejaz, S. (2022, March 19). Precocious Puberty, StatPearls [Internet], Available online: https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK544313\/."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1218","DOI":"10.1176\/appi.ajp.2010.09081190","article-title":"Outcomes of early pubertal timing in young women: A prospective population-based study","volume":"167","author":"Copeland","year":"2010","journal-title":"Am. J. Psychiatry"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.pedneo.2021.02.004","article-title":"Central precocious puberty in girls: Increasing with time","volume":"62","author":"Tung","year":"2021","journal-title":"Pediatr. Neonatol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e269","DOI":"10.1542\/peds.2008-2638","article-title":"Onset of breast and pubic hair development and menses in urban chinese girls","volume":"124","author":"Ma","year":"2009","journal-title":"Pediatrics"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Dattani, M.T., and Brook, C.G.D. (2020). Brook\u2019s Clinical Pediatric Endocrinology, John Wiley & Sons. [7th ed.].","DOI":"10.1002\/9781119152712"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/S0022-3476(95)70254-7","article-title":"Normal ranges for immunochemiluminometric gonadotropin assays","volume":"127","author":"Neely","year":"1995","journal-title":"J. Pediatr."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/S2213-8587(15)00380-0","article-title":"Causes, diagnosis, and treatment of central precocious puberty","volume":"4","author":"Latronico","year":"2016","journal-title":"Lancet Diabetes Endocrinol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/S1875-9572(10)60014-9","article-title":"New growth charts for Taiwanese children and adolescents based on World Health Organization standards and health-related physical fitness","volume":"51","author":"Chen","year":"2010","journal-title":"Pediatr. Neonatol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Greulich, W.W., and Pyle, S.I. (1959). Radiographic Atlas of Skeletal Development of the Hand and Wrist, Stanford University Press.","DOI":"10.1097\/00000441-195909000-00030"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic Minority Over-sampling Technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.pedneo.2020.12.001","article-title":"Diagnostic evaluation of central precocious puberty in girls","volume":"62","author":"Yeh","year":"2021","journal-title":"Pediatr. Neonatol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e1059","DOI":"10.1542\/peds.2008-1180","article-title":"Adequacy of a single unstimulated luteinizing hormone level to diagnose central precocious puberty in girls","volume":"123","author":"Houk","year":"2009","journal-title":"Pediatrics"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"196","DOI":"10.6065\/apem.2013.18.4.196","article-title":"Basal luteinizing hormone and follicular stimulating hormone: Is it sufficient for the diagnosis of precocious puberty in girls?","volume":"18","author":"Lee","year":"2013","journal-title":"Ann. Pediatr. Endocrinol. Metab."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1055\/s-0032-1321905","article-title":"Utility of Basal luteinizing hormone levels for detecting central precocious puberty in girls","volume":"44","author":"Lee","year":"2012","journal-title":"Horm. Metab. Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/S0022-3476(95)70255-5","article-title":"Spontaneous serum gonadotropin concentrations in the evaluation of precocious puberty","volume":"127","author":"Neely","year":"1995","journal-title":"J. Pediatr."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1530\/EJE-11-0720","article-title":"The utility of basal serum LH in prediction of central precocious puberty in girls","volume":"166","author":"Pasternak","year":"2012","journal-title":"Eur. J. Endocrinol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1111\/j.1365-2265.1995.tb02692.x","article-title":"A simplified gonadotrophin-releasing hormone test for precocious puberty","volume":"42","author":"Cavallo","year":"1995","journal-title":"Clin. Endocrinol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"12","DOI":"10.4274\/jcrpe.v3i1.03","article-title":"GnRH stimulation test in precocious puberty: Single sample is adequate for diagnosis and dose adjustment","volume":"3","author":"Kandemir","year":"2011","journal-title":"J. Clin. Res. Pediatr. Endocrinol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1542\/peds.97.4.517","article-title":"A single-sample, subcutaneous gonadotropin-releasing hormone test for central precocious puberty","volume":"97","author":"Eckert","year":"1996","journal-title":"Pediatrics"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"You, J., Cheng, X., Li, X., Li, M., Yao, L., Luo, F., Cheng, R., Xi, L., and Ye, J. (2021). Clinical risk score for central precocious puberty among girls with precocious pubertal development: A cross sectional study. BMC Endocr. Disord., 21.","DOI":"10.1186\/s12902-021-00740-7"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"e11728","DOI":"10.2196\/11728","article-title":"Development of Prediction Models Using Machine Learning Algorithms for Girls with Suspected Central Precocious Puberty: Retrospective Study","volume":"7","author":"Pan","year":"2019","journal-title":"JMIR Med. Inf."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"152","DOI":"10.6065\/apem.2040004.002","article-title":"Gonadotropin-releasing hormone stimulation test and diagnostic cutoff in precocious puberty: A mini review","volume":"25","author":"Omar","year":"2020","journal-title":"Ann. Pediatr. Endocrinol. Metab."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1136\/adc.44.235.291","article-title":"Variations in pattern of pubertal changes in girls","volume":"44","author":"Marshall","year":"1969","journal-title":"Arch. Dis. Child."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1210\/er.2002-0019","article-title":"The timing of normal puberty and the age limits of sexual precocity: Variations around the world, secular trends, and changes after migration","volume":"24","author":"Parent","year":"2003","journal-title":"Endocr. Rev."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1136\/archdischild-2011-300011","article-title":"Premature adrenarche","volume":"97","author":"Williams","year":"2012","journal-title":"Arch. Dis. Child."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"194","DOI":"10.3346\/jkms.2012.27.2.194","article-title":"Factors to predict positive results of gonadotropin releasing hormone stimulation test in girls with suspected precocious puberty","volume":"27","author":"Nam","year":"2012","journal-title":"J. Korean Med. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"580314","DOI":"10.3389\/fped.2021.580314","article-title":"Evaluation of Bone Age in Children: A Mini-Review","volume":"9","author":"Cavallo","year":"2021","journal-title":"Front. Pediatr."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/13\/9\/1550\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:23:46Z","timestamp":1760124226000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/13\/9\/1550"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,26]]},"references-count":27,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["diagnostics13091550"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics13091550","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,26]]}}}