{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,1]],"date-time":"2026-11-01T00:49:07Z","timestamp":1793494147029,"version":"4.5.0"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T00:00:00Z","timestamp":1573689600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T00:00:00Z","timestamp":1573689600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Methods for automatic analysis of clinical data are usually targeted towards a specific modality and do not make use of all relevant data available. In the field of male human reproduction, clinical and biological data are not used to its fullest potential. Manual evaluation of a semen sample using a microscope is time-consuming and requires extensive training. Furthermore, the validity of manual semen analysis has been questioned due to limited reproducibility, and often high inter-personnel variation. The existing computer-aided sperm analyzer systems are not recommended for routine clinical use due to methodological challenges caused by the consistency of the semen sample. Thus, there is a need for an improved methodology. We use modern and classical machine learning techniques together with a dataset consisting of 85 videos of human semen samples and related participant data to automatically predict sperm motility. Used techniques include simple linear regression and more sophisticated methods using convolutional neural networks. Our results indicate that sperm motility prediction based on deep learning using sperm motility videos is rapid to perform and consistent. Adding participant data did not improve the algorithms performance. In conclusion, machine learning-based automatic analysis may become a valuable tool in male infertility investigation and research.<\/jats:p>","DOI":"10.1038\/s41598-019-53217-y","type":"journal-article","created":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T11:03:11Z","timestamp":1573729391000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":95,"title":["Machine Learning-Based Analysis of Sperm Videos and Participant Data for Male Fertility Prediction"],"prefix":"10.1038","volume":"9","author":[{"given":"Steven A.","family":"Hicks","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jorunn M.","family":"Andersen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oliwia","family":"Witczak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6026-0929","authenticated-orcid":false,"given":"Vajira","family":"Thambawita","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"P\u00e5l","family":"Halvorsen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hugo L.","family":"Hammer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Trine B.","family":"Haugen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael A.","family":"Riegler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,11,14]]},"reference":[{"key":"53217_CR1","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","volume":"25","author":"EJ Topol","year":"2019","unstructured":"Topol, E. J. High-performance medicine: the convergence of human and artificial intelligence. Nat. medicine 25, 44 (2019).","journal-title":"Nat. medicine"},{"key":"53217_CR2","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1109\/MMUL.2018.011921235","volume":"25","author":"S Boll","year":"2018","unstructured":"Boll, S., Meyer, J. & O\u2019Connor, N. E. Health media: From multimedia signals to personal health insights. IEEE MultiMedia 25, 51\u201360 (2018).","journal-title":"IEEE MultiMedia"},{"key":"53217_CR3","doi-asserted-by":"publisher","unstructured":"Riegler, M. et al. Multimedia and medicine: Teammates for better disease detection and survival. In Proceedings of the ACM International Conference on Multimedia (ACM MM), 968\u2013977, https:\/\/doi.org\/10.1145\/2964284.2976760 (ACM, 2016).","DOI":"10.1145\/2964284.2976760"},{"key":"53217_CR4","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1038\/s41591-018-0268-3","volume":"25","author":"AY Hannun","year":"2019","unstructured":"Hannun, A. Y. et al. Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network. Nat. Medicine 25, 65\u201369, https:\/\/doi.org\/10.1038\/s41591-018-0268-3 (2019).","journal-title":"Nat. Medicine"},{"key":"53217_CR5","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nat. 542, 115\u2013118, https:\/\/doi.org\/10.1038\/nature21056 (2017).","journal-title":"Nat."},{"key":"53217_CR6","doi-asserted-by":"publisher","first-page":"22493","DOI":"10.1007\/s11042-017-4989-y","volume":"76","author":"K Pogorelov","year":"2017","unstructured":"Pogorelov, K. et al. Efficient disease detection in gastrointestinal videos \u2013 global features versus neural networks. Multimed. Tools Appl. 76, 22493\u201322525, https:\/\/doi.org\/10.1007\/s11042-017-4989-y (2017).","journal-title":"Multimed. Tools Appl."},{"key":"53217_CR7","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1136\/bmj.305.6854.609","volume":"305","author":"E Carlsen","year":"1992","unstructured":"Carlsen, E., Giwercman, A., Keiding, N. & Skakkeb\u00e6k, N. E. Evidence for decreasing quality of semen during past 50 years. Br. Med. J. 305, 609\u2013613 (1992).","journal-title":"Br. Med. J."},{"key":"53217_CR8","doi-asserted-by":"publisher","first-page":"646","DOI":"10.1093\/humupd\/dmx022","volume":"23","author":"H Levine","year":"2017","unstructured":"Levine, H. et al. Temporal trends in sperm count: a systematic review and meta-regression analysis. Hum. Reproduction Updat. 23, 646\u2013659 (2017).","journal-title":"Hum. Reproduction Updat."},{"key":"53217_CR9","doi-asserted-by":"publisher","first-page":"2199","DOI":"10.1093\/humrep\/17.8.2199","volume":"17","author":"N J\u00f8rgensen","year":"2002","unstructured":"J\u00f8rgensen, N. et al. East\u2013west gradient in semen quality in the nordic\u2013baltic area: a study of men from the general population in denmark, norway, estonia and finland. Hum. Reproduction 17, 2199\u20132208 (2002).","journal-title":"Hum. Reproduction"},{"key":"53217_CR10","doi-asserted-by":"publisher","first-page":"763","DOI":"10.1111\/andr.12209","volume":"4","author":"M Tomlinson","year":"2016","unstructured":"Tomlinson, M. Uncertainty of measurement and clinical value of semen analysis: has standardisation through professional guidelines helped or hindered progress? Androl. 4, 763\u2013770 (2016).","journal-title":"Androl."},{"key":"53217_CR11","unstructured":"World Health Organization, Department of Reproductive Health and Research. WHO laboratory manual for the examination and processing of human semen (Geneva: World Health Organization, 2010)."},{"key":"53217_CR12","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1093\/humupd\/dmp048","volume":"16","author":"TG Cooper","year":"2010","unstructured":"Cooper, T. G. et al. World health organization reference values for human semen characteristics. Hum. Reproduction Updat. 16, 231\u2013245, https:\/\/doi.org\/10.1093\/humupd\/dmp048 (2010).","journal-title":"Hum. Reproduction Updat."},{"key":"53217_CR13","doi-asserted-by":"publisher","first-page":"545","DOI":"10.4103\/1008-682X.154312","volume":"17","author":"ST Mortimer","year":"2015","unstructured":"Mortimer, S. T., van der Horst, G. & Mortimer, D. The future of computer-aided sperm analysis. Asian journal andrology 17, 545 (2015).","journal-title":"Asian journal andrology"},{"key":"53217_CR14","doi-asserted-by":"publisher","first-page":"37","DOI":"10.3109\/14647273.2013.865843","volume":"17","author":"CG Dearing","year":"2014","unstructured":"Dearing, C. G., Kilburn, S. & Lindsay, K. S. Validation of the sperm class analyser casa system for sperm counting in a busy diagnostic semen analysis laboratory. Hum. Fertility 17, 37\u201344 (2014).","journal-title":"Hum. Fertility"},{"key":"53217_CR15","doi-asserted-by":"crossref","unstructured":"Dearing, C., Jayasena, C. & Lindsay, K. Can the sperm class analyser (sca) casa-mot system for human sperm motility analysis reduce imprecision and operator subjectivity and improve semen analysis? Hum. Fertility 1\u201311 (2019).","DOI":"10.1080\/14647273.2019.1610581"},{"key":"53217_CR16","doi-asserted-by":"publisher","first-page":"792","DOI":"10.1109\/TMI.2016.2630720","volume":"36","author":"LF Urbano","year":"2017","unstructured":"Urbano, L. F., Masson, P., VerMilyea, M. & Kam, M. Automatic tracking and motility analysis of human sperm in time-lapse images. IEEE Transactions on Med. Imaging 36, 792\u2013801, https:\/\/doi.org\/10.1109\/TMI.2016.2630720 (2017).","journal-title":"IEEE Transactions on Med. Imaging"},{"key":"53217_CR17","doi-asserted-by":"crossref","unstructured":"Dewan, K., Rai Dastidar, T. & Ahmad, M. Estimation of sperm concentration and total motility from microscopic videos of human semen samples. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops (2018).","DOI":"10.1109\/CVPRW.2018.00307"},{"key":"53217_CR18","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1016\/j.cmpb.2015.08.013","volume":"122","author":"F Ghasemian","year":"2015","unstructured":"Ghasemian, F., Mirroshandel, S. A., Monji-Azad, S., Azarnia, M. & Zahiri, Z. An efficient method for automatic morphological abnormality detection from human sperm images. Comput. methods programs biomedicine 122, 409\u2013420 (2015).","journal-title":"Comput. methods programs biomedicine"},{"key":"53217_CR19","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/j.compbiomed.2017.10.009","volume":"91","author":"F Shaker","year":"2017","unstructured":"Shaker, F., Monadjemi, S. A., Alirezaie, J. & Naghsh-Nilchi, A. R. A dictionary learning approach for human sperm heads classification. Comput. biology medicine 91, 181\u2013190 (2017).","journal-title":"Comput. biology medicine"},{"key":"53217_CR20","doi-asserted-by":"publisher","unstructured":"Haugen, T. et al. Visem: A multimodal video dataset of human spermatozoa. In Proceedings of the ACM Multimedia Systems Conference (MMSYS), https:\/\/doi.org\/10.1145\/3304109.3325814 (ACM, 2019).","DOI":"10.1145\/3304109.3325814"},{"key":"53217_CR21","doi-asserted-by":"publisher","first-page":"e0130210","DOI":"10.1371\/journal.pone.0130210","volume":"10","author":"JM Andersen","year":"2015","unstructured":"Andersen, J. M. et al. Body mass index is associated with impaired semen characteristics and reduced levels of anti m\u00fcllerian hormone across a wide weight range. PloS one 10, e0130210 (2015).","journal-title":"PloS one"},{"key":"53217_CR22","unstructured":"Nadeau, C. & Bengio, Y. Inference for the generalization error. In Proceeding of the Advances in neural information processing systems (NIPS), 307\u2013313 (2000)."},{"key":"53217_CR23","unstructured":"Lux, M., Riegler, M., Halvorsen, P., Pogorelov, K. & Anagnostopoulos, N. Lire: open source visual information retrieval. In Proceedings of the ACM Multimedia Systems Conference (MMSYS), 30 (2016)."},{"key":"53217_CR24","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1145\/1656274.1656278","volume":"11","author":"M Hall","year":"2009","unstructured":"Hall, M. et al. The WEKA data mining software: an update. SIGKDD Explor. 11, 10\u201318 (2009).","journal-title":"SIGKDD Explor."},{"key":"53217_CR25","unstructured":"Dozat, T. Incorporating nesterov momentum into adam. (2015)."},{"key":"53217_CR26","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., van der Maaten, L. & Weinberger, K. Q. Densely connected convolutional networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2017).","DOI":"10.1109\/CVPR.2017.243"},{"key":"53217_CR27","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. 770\u2013778 (2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"53217_CR28","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the inception architecture for computer vision. arXiv preprint arXiv:1512.00567 (2015).","DOI":"10.1109\/CVPR.2016.308"},{"key":"53217_CR29","doi-asserted-by":"crossref","unstructured":"Deng, J. et al. ImageNet: A Large-Scale Hierarchical Image Database. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"53217_CR30","unstructured":"Chollet, F. et al. Keras: Deep learning library for theano and tensorflow. https:\/\/keras.io (2015)."},{"key":"53217_CR31","unstructured":"Abadi, M. et al. Tensorflow: A system for large-scale machine learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), 265\u2013283 (2016)."},{"key":"53217_CR32","unstructured":"Lucas, B. D. & Kanade, T. An iterative image registration technique with an application to stereo vision. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI) - Volume 2, 674\u2013679 (Morgan Kaufmann Publishers Inc., 1981)."},{"key":"53217_CR33","doi-asserted-by":"crossref","unstructured":"Harris, C. & Stephens, M. A combined corner and edge detector. In Proceedings of the Alvey Vision Conference, 147\u2013151 (1988).","DOI":"10.5244\/C.2.23"},{"key":"53217_CR34","unstructured":"Bradski, G. The OpenCV Library. Dr. Dobb\u2019s J. Softw. Tools (2000)."},{"key":"53217_CR35","doi-asserted-by":"crossref","unstructured":"Farneb\u00e4ck, G. Two-frame motion estimation based on polynomial expansion. In Bigun, J. & Gustavsson, T. (eds) Image Analysis, 363\u2013370 (Springer Berlin Heidelberg, Berlin, Heidelberg, 2003).","DOI":"10.1007\/3-540-45103-X_50"},{"key":"53217_CR36","unstructured":"Simonyan, K. & Zisserman, A. Two-stream convolutional networks for action recognition in videos. In Proceedings of Advances in Neural Information Processing Systems (NIPS), 568\u2013576 (2014)."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-019-53217-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-019-53217-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-019-53217-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,17]],"date-time":"2022-12-17T15:55:07Z","timestamp":1671292507000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-019-53217-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,14]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["53217"],"URL":"https:\/\/doi.org\/10.1038\/s41598-019-53217-y","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,14]]},"assertion":[{"value":"6 June 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 October 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 November 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"16770"}}