{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T12:23:45Z","timestamp":1784291025499,"version":"3.55.0"},"reference-count":40,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2022,1,10]],"date-time":"2022-01-10T00:00:00Z","timestamp":1641772800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Andrology"],"published-print":{"date-parts":[[2022,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Due to the highly variable clinical phenotype, Klinefelter Syndrome is underdiagnosed.<\/jats:p><\/jats:sec><jats:sec><jats:title>Objective<\/jats:title><jats:p>Assessment of supervised machine learning based prediction models for identification of Klinefelter Syndrome among azoospermic patients, and comparison to expert clinical evaluation.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and methods<\/jats:title><jats:p>Retrospective patient data (karyotype, age, height, weight, testis volume, follicle\u2010stimulating hormone, luteinizing hormone, testosterone, estradiol, prolactin, semen pH and semen volume) collected between January 2005 and June 2019 were retrieved from a patient data bank of a University Centre. Models were trained, validated and benchmarked based on different supervised machine learning algorithms. Models were then tested on an independent, prospectively acquired set of patient data (between July 2019 and July 2020). Benchmarking against physicians was performed in addition.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Based on average performance, support vector machines and CatBoost were particularly well\u2010suited models, with 100% sensitivity and &gt;93% specificity on the test dataset. Compared to a group of 18 expert clinicians, the machine learning models had significantly better median sensitivity (100% vs. 87.5%, <jats:italic>p<\/jats:italic>\u00a0=\u00a00.0455) and fared comparably with regards to specificity (90% vs. 89.9%, <jats:italic>p<\/jats:italic>\u00a0=\u00a00.4795), thereby possibly improving diagnosis rate. A Klinefelter Syndrome Score Calculator based on the prediction models is available on <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"http:\/\/klinefelter-score-calculator.uni-muenster.de\">http:\/\/klinefelter\u2010score\u2010calculator.uni\u2010muenster.de<\/jats:ext-link>.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Differentiating Klinefelter Syndrome patients from azoospermic patients with normal karyotype (46,XY) is a problem that can be solved with supervised machine learning techniques, improving patient care.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Machine learning could improve the diagnostic rate of Klinefelter Syndrome among azoospermic patients, even more for less\u2010experienced physicians.<\/jats:p><\/jats:sec>","DOI":"10.1111\/andr.13141","type":"journal-article","created":{"date-parts":[[2021,12,16]],"date-time":"2021-12-16T10:58:44Z","timestamp":1639652324000},"page":"534-544","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Machine learning based prediction models in male reproductive health: Development of a proof\u2010of\u2010concept model for Klinefelter Syndrome in azoospermic patients"],"prefix":"10.1111","volume":"10","author":[{"given":"Henrike","family":"Krenz","sequence":"first","affiliation":[{"name":"Institute of Medical Informatics University of M\u00fcnster  M\u00fcnster Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1210-2843","authenticated-orcid":false,"given":"Andrea","family":"Sansone","sequence":"additional","affiliation":[{"name":"Centre of Reproductive Medicine and Andrology University Hospital M\u00fcnster  M\u00fcnster Germany"},{"name":"Chair of Endocrinology and Sexual Medicine (ENDOSEX) Department of Systems Medicine University of Rome Tor Vergata  Rome Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Fujarski","sequence":"additional","affiliation":[{"name":"Institute of Medical Informatics University of M\u00fcnster  M\u00fcnster Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claudia","family":"Krallmann","sequence":"additional","affiliation":[{"name":"Centre of Reproductive Medicine and Andrology University Hospital M\u00fcnster  M\u00fcnster Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3629-7160","authenticated-orcid":false,"given":"Michael","family":"Zitzmann","sequence":"additional","affiliation":[{"name":"Centre of Reproductive Medicine and Andrology University Hospital M\u00fcnster  M\u00fcnster Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin","family":"Dugas","sequence":"additional","affiliation":[{"name":"Institute of Medical Informatics Heidelberg University Hospital  Heidelberg Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sabine","family":"Kliesch","sequence":"additional","affiliation":[{"name":"Centre of Reproductive Medicine and Andrology University Hospital M\u00fcnster  M\u00fcnster Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julian","family":"Varghese","sequence":"additional","affiliation":[{"name":"Institute of Medical Informatics University of M\u00fcnster  M\u00fcnster Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2745-9965","authenticated-orcid":false,"given":"Frank","family":"T\u00fcttelmann","sequence":"additional","affiliation":[{"name":"Institute of Reproductive Genetics University of M\u00fcnster  M\u00fcnster Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J\u00f6rg","family":"Gromoll","sequence":"additional","affiliation":[{"name":"Centre of Reproductive Medicine and Andrology University Hospital M\u00fcnster  M\u00fcnster Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2022,1,10]]},"reference":[{"key":"e_1_2_11_2_1","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCULATIONAHA.115.001593"},{"key":"e_1_2_11_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10815-019-01408-x"},{"key":"e_1_2_11_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11934-019-0914-4"},{"key":"e_1_2_11_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-44441-3_36"},{"key":"e_1_2_11_6_1","doi-asserted-by":"publisher","DOI":"10.3233\/THC-140816"},{"key":"e_1_2_11_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2017.03.004"},{"key":"e_1_2_11_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2019.103342"},{"key":"e_1_2_11_9_1","doi-asserted-by":"publisher","DOI":"10.1111\/andr.12826"},{"key":"e_1_2_11_10_1","doi-asserted-by":"publisher","DOI":"10.1093\/humrep\/deaa109"},{"issue":"3","key":"e_1_2_11_11_1","first-page":"122","article-title":"Artificial neural network for the prediction of chromosomal abnormalities in azoospermic males","volume":"15","author":"Akinsal EC","year":"2018","journal-title":"Urol J"},{"key":"e_1_2_11_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.urology.2010.10.001"},{"key":"e_1_2_11_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S2213-8587(16)30043-2"},{"issue":"1","key":"e_1_2_11_14_1","first-page":"12","article-title":"Disorders of spermatogenesis: perspectives for novel genetic diagnostics after 20 years of unchanged routine","volume":"30","author":"Tuttelmann F","year":"2018","journal-title":"Med Genet"},{"key":"e_1_2_11_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.metabol.2017.09.017"},{"key":"e_1_2_11_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/andr.12909"},{"key":"e_1_2_11_17_1","doi-asserted-by":"publisher","DOI":"10.1002\/ajmg.c.31786"},{"key":"e_1_2_11_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40618-016-0541-6"},{"key":"e_1_2_11_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(04)16678-6"},{"key":"e_1_2_11_20_1","doi-asserted-by":"publisher","DOI":"10.2337\/dc06-0145"},{"key":"e_1_2_11_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40618-017-0619-9"},{"key":"e_1_2_11_22_1","doi-asserted-by":"publisher","DOI":"10.5694\/j.1326-5377.2011.tb04141.x"},{"key":"e_1_2_11_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/andr.12067"},{"key":"e_1_2_11_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12020-019-01850-y"},{"key":"e_1_2_11_25_1","doi-asserted-by":"publisher","DOI":"10.1210\/jcem-2-11-615"},{"key":"e_1_2_11_26_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-7262.2006.00131.x"},{"key":"e_1_2_11_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eursup.2014.08.002"},{"key":"e_1_2_11_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"e_1_2_11_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/molehr\/8.7.606"},{"key":"e_1_2_11_30_1","first-page":"2825","article-title":"Scikit\u2010learn: machine learning in Python","volume":"12","author":"Pedregosa F","year":"2011","journal-title":"J Mach Learn Res"},{"key":"e_1_2_11_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-41136-6_5"},{"key":"e_1_2_11_32_1","first-page":"63","article-title":"Gaussian processes in machine learning","author":"Rasmussen CE","year":"2004","journal-title":"Advanced Lectures on Machine Learning"},{"key":"e_1_2_11_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018"},{"key":"e_1_2_11_34_1","unstructured":"ProkhorenkovaL GusevG VorobevA DorogushAV&GulinA.CatBoost: unbiased boosting with categorical features. In: NIPS'18: Proceedings of the 32nd International Conference on Neural Information Processing Systems. ACM; 2018:6639\u20106649. arXiv preprint arXiv:170609516."},{"key":"e_1_2_11_35_1","unstructured":"AbadiM BarhamP ChenJ et\u00a0al. Tensorflow: a system for large\u2010scale machine learning. In: Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) Savannah GA USA. USENIX Association; 2016:265\u2010283."},{"issue":"2","key":"e_1_2_11_36_1","first-page":"627","article-title":"Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation","volume":"4","author":"Hajian\u2010Tilaki K","year":"2013","journal-title":"Caspian J Intern Med"},{"key":"e_1_2_11_37_1","unstructured":"LundbergSM LeeS\u2010I.A unified approach to interpreting model predictions. In:Proceedings of the 31st International Conference on Neural Information Processing Systems. ACM; 2017:4768\u20104777."},{"key":"e_1_2_11_38_1","unstructured":"McInnesL HealyJ Melville J. UMAP:uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:180203426.2018."},{"key":"e_1_2_11_39_1","doi-asserted-by":"publisher","DOI":"10.1210\/jc.2002-021491"},{"key":"e_1_2_11_40_1","doi-asserted-by":"publisher","DOI":"10.1210\/jc.2018-02249"},{"key":"e_1_2_11_41_1","doi-asserted-by":"publisher","DOI":"10.1093\/humupd\/dmz028"}],"container-title":["Andrology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/andr.13141","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/andr.13141","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/andr.13141","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T00:40:33Z","timestamp":1692837633000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/andr.13141"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,10]]},"references-count":40,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,3]]}},"alternative-id":["10.1111\/andr.13141"],"URL":"https:\/\/doi.org\/10.1111\/andr.13141","archive":["Portico"],"relation":{},"ISSN":["2047-2919","2047-2927"],"issn-type":[{"value":"2047-2919","type":"print"},{"value":"2047-2927","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,10]]},"assertion":[{"value":"2021-11-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-10","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}