{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T10:22:00Z","timestamp":1774261320889,"version":"3.50.1"},"reference-count":45,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2022,10,1]],"date-time":"2022-10-01T00:00:00Z","timestamp":1664582400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"},{"start":{"date-parts":[[2022,6,24]],"date-time":"2022-06-24T00:00:00Z","timestamp":1656028800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"funder":[{"DOI":"10.13039\/501100002367","name":"Chinese Academy of Sciences","doi-asserted-by":"publisher","award":["292019000056"],"award-info":[{"award-number":["292019000056"]}],"id":[{"id":"10.13039\/501100002367","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011332","name":"University of Chinese Academy of Sciences","doi-asserted-by":"publisher","award":["115200M001"],"award-info":[{"award-number":["115200M001"]}],"id":[{"id":"10.13039\/501100011332","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100009592","name":"Beijing Municipal Science and Technology Commission","doi-asserted-by":"publisher","award":["Z181100001918016"],"award-info":[{"award-number":["Z181100001918016"]}],"id":[{"id":"10.13039\/501100009592","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["91954201, 31971289"],"award-info":[{"award-number":["91954201, 31971289"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The selection of high-quality sperms is critical to intracytoplasmic sperm injection, which accounts for 70\u201380% of in vitro fertilization (IVF) treatments. So far, sperm screening is usually performed manually by clinicians. However, the performance of manual screening is limited in its objectivity, consistency, and efficiency. To overcome these limitations, we have developed a fast and noninvasive three-stage method to characterize morphology of freely swimming human sperms in bright-field microscopy images using deep learning models. Specifically, we use an object detection model to identify sperm heads, a classification model to select in-focus images, and a segmentation model to extract geometry of sperm heads and vacuoles. The models achieve an F1-score of 0.951 in sperm head detection, a z-position estimation error within \u00b11.5 \u03bcm in in-focus image selection, and a Dice score of 0.948 in sperm head segmentation, respectively. Customized lightweight architectures are used for the models to achieve real-time analysis of 200 frames per second. Comprehensive morphological parameters are calculated from sperm head geometry extracted by image segmentation. Overall, our method provides a reliable and efficient tool to assist clinicians in selecting high-quality sperms for successful IVF. It also demonstrates the effectiveness of deep learning in real-time analysis of live bright-field microscopy images.<\/jats:p>","DOI":"10.1017\/s1431927622012132","type":"journal-article","created":{"date-parts":[[2022,6,24]],"date-time":"2022-06-24T10:21:48Z","timestamp":1656066108000},"page":"1767-1779","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":12,"title":["Fast Noninvasive Morphometric Characterization of Free Human Sperms Using Deep Learning"],"prefix":"10.1093","volume":"28","author":[{"given":"Guole","family":"Liu","sequence":"first","affiliation":[{"name":"University of Chinese Academy of Sciences School of Artificial Intelligence, , Beijing 100049, China"},{"name":"Institute of Automation, Chinese Academy of Sciences National Laboratory of Pattern Recognition, , Beijing 100190, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hao","family":"Shi","sequence":"additional","affiliation":[{"name":"Sperm Capturer (Beijing) Biotechnology Co. Ltd. , Beijing 100070, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huan","family":"Zhang","sequence":"additional","affiliation":[{"name":"The First Affiliated Hospital of Wenzhou Medical University Reproductive Medicine Center, , Zhejiang 325000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yating","family":"Zhou","sequence":"additional","affiliation":[{"name":"University of Chinese Academy of Sciences School of Artificial Intelligence, , Beijing 100049, China"},{"name":"Institute of Automation, Chinese Academy of Sciences National Laboratory of Pattern Recognition, , Beijing 100190, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yujiao","family":"Sun","sequence":"additional","affiliation":[{"name":"Institute of Genetics and Developmental Biology, Chinese Academy of Sciences State Key Laboratory of Molecular Developmental Biology, , Beijing 100101, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Li","sequence":"additional","affiliation":[{"name":"Capital Medical University Beijing Children's Hospital, , Beijing 100045, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuefeng","family":"Huang","sequence":"additional","affiliation":[{"name":"The First Affiliated Hospital of Wenzhou Medical University Reproductive Medicine Center, , Zhejiang 325000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuqiang","family":"Jiang","sequence":"additional","affiliation":[{"name":"Institute of Genetics and Developmental Biology, Chinese Academy of Sciences State Key Laboratory of Molecular Developmental Biology, , Beijing 100101, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaliang","family":"Fang","sequence":"additional","affiliation":[{"name":"Sperm Capturer (Beijing) Biotechnology Co. Ltd. , Beijing 100070, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6176-3130","authenticated-orcid":false,"given":"Ge","family":"Yang","sequence":"additional","affiliation":[{"name":"University of Chinese Academy of Sciences School of Artificial Intelligence, , Beijing 100049, China"},{"name":"Institute of Automation, Chinese Academy of Sciences National Laboratory of Pattern Recognition, , Beijing 100190, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2022,10,1]]},"reference":[{"issue":"1","key":"2023012306334314900_ref1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12958-015-0032-1","article-title":"A unique view on male infertility around the globe","volume":"13","author":"Agarwal","year":"2015","journal-title":"Reprod Biol Endocrinol"},{"key":"2023012306334314900_ref2","author":"Bijar","year":"2012"},{"issue":"1","key":"2023012306334314900_ref3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/2051-4190-23-3","article-title":"The nature of human sperm head vacuoles: A systematic literature review","volume":"23","author":"Boitrelle","year":"2013","journal-title":"Basic Clin Androl"},{"issue":"1","key":"2023012306334314900_ref4","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1177\/24.1.1254907","article-title":"An automated microscope for cytologic research a preliminary evaluation","volume":"24","author":"Brenner","year":"1976","journal-title":"J Histochem Cytochem"},{"key":"2023012306334314900_ref5","author":"Carrillo","year":"2007"},{"key":"2023012306334314900_ref6","author":"Chen","year":"2017"},{"issue":"12","key":"2023012306334314900_ref7","doi-asserted-by":"crossref","first-page":"881","DOI":"10.2471\/BLT.10.011210","article-title":"Mother or nothing: The agony of infertility","volume":"88","author":"Cui","year":"2010","journal-title":"Bull World Health Organ"},{"issue":"10","key":"2023012306334314900_ref8","doi-asserted-by":"crossref","first-page":"2257","DOI":"10.1109\/TMI.2018.2840827","article-title":"Automated non-invasive measurement of single sperm's motility and morphology","volume":"37","author":"Dai","year":"2018","journal-title":"IEEE Trans Med Imaging"},{"key":"2023012306334314900_ref9","author":"Dai","year":"2016"},{"issue":"15","key":"2023012306334314900_ref10","doi-asserted-by":"crossref","first-page":"eaay7619","DOI":"10.1126\/sciadv.aay7619","article-title":"High-resolution 4-D acquisition of freely swimming human sperm cells without staining","volume":"6","author":"Dardikman-Yoffe","year":"2020","journal-title":"Sci Adv"},{"key":"2023012306334314900_ref11","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.proeng.2013.09.086","article-title":"Image sharpness measure for blurred images in frequency domain","volume":"64","author":"De","year":"2013","journal-title":"Procedia Eng"},{"issue":"2","key":"2023012306334314900_ref12","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1016\/S0015-0282(98)00146-0","article-title":"In vitro fertilization and pregnancy rates: The influence of sperm motility and morphology on IVF outcome","volume":"70","author":"Donnelly","year":"1998","journal-title":"Fertil Steril"},{"issue":"6","key":"2023012306334314900_ref13","doi-asserted-by":"crossref","first-page":"854","DOI":"10.1093\/oxfordjournals.humrep.a137440","article-title":"Evaluation of human sperm morphology using strict criteria after Diff-Quik staining: Correlation of morphology with fertilization in vitro","volume":"6","author":"Enginsu","year":"1991","journal-title":"Hum Reprod"},{"key":"2023012306334314900_ref14","author":"Farhadi","year":"2018"},{"issue":"4","key":"2023012306334314900_ref15","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1007\/BF01934268","article-title":"Least-squares fitting of circles and ellipses","volume":"34","author":"Gander","year":"1994","journal-title":"BIT Numer Math"},{"issue":"3","key":"2023012306334314900_ref16","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1016\/j.cmpb.2015.08.013","article-title":"An efficient method for automatic morphological abnormality detection from human sperm images","volume":"122","author":"Ghasemian","year":"2015","journal-title":"Comput Methods Programs Biomed"},{"key":"2023012306334314900_ref17","author":"Graves","year":"2013"},{"issue":"19","key":"2023012306334314900_ref18","doi-asserted-by":"crossref","first-page":"1388","DOI":"10.1056\/NEJMoa003005","article-title":"Sperm morphology, motility, and concentration in fertile and infertile men","volume":"345","author":"Guzick","year":"2001","journal-title":"N Engl J Med"},{"key":"2023012306334314900_ref19","author":"He","year":"2016"},{"issue":"5","key":"2023012306334314900_ref20","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1049\/el.2018.7219","article-title":"Automatic directional masking technique for better sperm morphology segmentation and classification analysis","volume":"55","author":"Ilhan","year":"2019","journal-title":"Electron Lett"},{"key":"2023012306334314900_ref21","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.compbiomed.2019.04.030","article-title":"A novel deep learning method for automatic assessment of human sperm images","volume":"109","author":"Javadi","year":"2019","journal-title":"Comput Biol Med"},{"key":"2023012306334314900_ref22","author":"Kingma","year":"2014"},{"key":"2023012306334314900_ref23","author":"Krizhevsky","year":"2012"},{"key":"2023012306334314900_ref24","author":"Lin","year":"2017"},{"key":"2023012306334314900_ref25","author":"Liu","year":"2016"},{"key":"2023012306334314900_ref26","author":"Long","year":"2015"},{"key":"2023012306334314900_ref27","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/978-3-319-70497-5_8","volume-title":"Intracytoplasmic Sperm Injection: Indications, Techniques and Applications","author":"Mirroshandel","year":"2018"},{"key":"2023012306334314900_ref28","author":"Movahed","year":"2018"},{"key":"2023012306334314900_ref29","author":"Papageorgiou","year":"1998"},{"issue":"5","key":"2023012306334314900_ref30","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1016\/j.patcog.2012.11.011","article-title":"Analysis of focus measure operators for shape-from-focus","volume":"46","author":"Pertuz","year":"2013","journal-title":"Pattern Recognit"},{"key":"2023012306334314900_ref31","author":"Redmon","year":"2016"},{"key":"2023012306334314900_ref32","author":"Ren","year":"2015"},{"key":"2023012306334314900_ref33","author":"Ronneberger","year":"2015"},{"issue":"2","key":"2023012306334314900_ref34","first-page":"194","article-title":"The ICSI procedure from past to future: A systematic review of the more controversial aspects","volume":"22","author":"Rubino","year":"2015","journal-title":"Hum Reprod Update"},{"key":"2023012306334314900_ref35","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.neunet.2014.09.003","article-title":"Deep learning in neural networks: An overview","volume":"61","author":"Schmidhuber","year":"2015","journal-title":"Neural Netw"},{"issue":"4","key":"2023012306334314900_ref36","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1016\/j.rbmo.2010.05.017","article-title":"Intracytoplasmic sperm injection outcome versus intracytoplasmic morphologically selected sperm injection outcome: A meta-analysis","volume":"21","author":"Setti","year":"2010","journal-title":"Reprod Biomed Online"},{"key":"2023012306334314900_ref37","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.cmpb.2016.04.026","article-title":"Automatic detection and segmentation of sperm head, acrosome and nucleus in microscopic images of human semen smears","volume":"132","author":"Shaker","year":"2016","journal-title":"Comput Methods Programs Biomed"},{"key":"2023012306334314900_ref38","first-page":"1","volume-title":"Machine Intelligence and Pattern Recognition","author":"Shapiro","year":"1996"},{"issue":"8","key":"2023012306334314900_ref39","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1109\/34.868688","article-title":"Normalized cuts and image segmentation","volume":"22","author":"Shi","year":"2000","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"2023012306334314900_ref40","author":"Simonyan","year":"2015"},{"key":"2023012306334314900_ref41","author":"Snell","year":"2017"},{"key":"2023012306334314900_ref42","author":"Szegedy","year":"2015"},{"issue":"5","key":"2023012306334314900_ref43","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1016\/S1472-6483(10)60308-2","article-title":"Blastocyst development after sperm selection at high magnification is associated with size and number of nuclear vacuoles","volume":"17","author":"Vanderzwalmen","year":"2008","journal-title":"Reprod Biomed Online"},{"issue":"4","key":"2023012306334314900_ref44","first-page":"34","article-title":"Robust real-time object detection","volume":"4","author":"Viola","year":"2001","journal-title":"Int J Comput Vis"},{"key":"2023012306334314900_ref45","author":"Zhou","year":"2018"}],"container-title":["Microscopy and Microanalysis"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/mam\/article-pdf\/28\/5\/1767\/48816097\/mam1767.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/mam\/article-pdf\/28\/5\/1767\/48816097\/mam1767.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,23]],"date-time":"2023-01-23T06:37:02Z","timestamp":1674455822000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/mam\/article\/28\/5\/1767\/6995548"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,1]]},"references-count":45,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,10,1]]},"published-print":{"date-parts":[[2022,10,1]]}},"URL":"https:\/\/doi.org\/10.1017\/s1431927622012132","relation":{},"ISSN":["1435-8115","1431-9276"],"issn-type":[{"value":"1435-8115","type":"electronic"},{"value":"1431-9276","type":"print"}],"subject":[],"published-other":{"date-parts":[[2022,10,1]]},"published":{"date-parts":[[2022,10,1]]},"assertion":[{"value":"Copyright \u00a9 The Author(s), 2022. Published by Cambridge University Press on behalf of the Microscopy Society of America","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}}]}}