{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T23:35:24Z","timestamp":1787787324477,"version":"build-2784847793"},"reference-count":35,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T00:00:00Z","timestamp":1768435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Bioengineering"],"abstract":"<jats:p>Non-obstructive azoospermia (NOA) is a severe male infertility condition characterized by extremely low or absent sperm production. In microdissection testicular sperm extraction (Micro-TESE) procedures for NOA, embryologists must manually search through testicular tissue under a microscope for rare sperm, a process that can take 1.8\u20137.5 h and impose significant fatigue and burden. This paper presents an augmented reality (AR) microscope system with AI-based image analysis to accelerate sperm retrieval in Micro-TESE. The proposed system integrates a deep learning model (YOLOv5) for real-time sperm detection in microscope images, a multi-object tracker (DeepSORT) for continuous sperm tracking, and a velocity calculation module for sperm motility analysis. Detected sperm positions and motility metrics are overlaid in the microscope\u2019s eyepiece view via a microdisplay, providing immediate visual guidance to the embryologist. In experiments on seminiferous tubule sample images, the YOLOv5 model achieved a precision of 0.81 and recall of 0.52, outperforming previous classical methods in accuracy and speed. The AR interface allowed an operator to find sperm faster, roughly doubling the sperm detection rate (66.9% vs. 30.8%). These results demonstrate that the AR microscope system can significantly aid embryologists by highlighting sperm in real time and potentially shorten Micro-TESE procedure times. This application of AR and AI in sperm retrieval shows promise for improving outcomes in assisted reproductive technology.<\/jats:p>","DOI":"10.3390\/bioengineering13010102","type":"journal-article","created":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T11:13:21Z","timestamp":1768475601000},"page":"102","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["AI-Based Augmented Reality Microscope for Real-Time Sperm Detection and Tracking in Micro-TESE"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8390-0711","authenticated-orcid":false,"given":"Mahmoud","family":"Mohamed","sequence":"first","affiliation":[{"name":"Laboratory for Biomaterials and Bioengineering, Institute of Science Tokyo, Tokyo 152-8550, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ezaki","family":"Yuriko","sequence":"additional","affiliation":[{"name":"Graduate School of Information Science and Technology, The University of Tokyo, Tokyo 113-8654, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuta","family":"Kawagoe","sequence":"additional","affiliation":[{"name":"Laboratory for Biomaterials and Bioengineering, Institute of Science Tokyo, Tokyo 152-8550, Japan"},{"name":"Departments of Obstetrics and Gynecology, Juntendo University Faculty of Medicine, Tokyo 113-8421, Japan"},{"name":"Departments of Obstetrics and Gynecology, International University Health and Welfare School of Medicine, Chiba 286-8686, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5572-9171","authenticated-orcid":false,"given":"Kazuhiro","family":"Kawamura","sequence":"additional","affiliation":[{"name":"Departments of Obstetrics and Gynecology, Juntendo University Faculty of Medicine, Tokyo 113-8421, Japan"},{"name":"Departments of Obstetrics and Gynecology, International University Health and Welfare School of Medicine, Chiba 286-8686, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-6778-4522","authenticated-orcid":false,"given":"Masashi","family":"Ikeuchi","sequence":"additional","affiliation":[{"name":"Laboratory for Biomaterials and Bioengineering, Institute of Science Tokyo, Tokyo 152-8550, Japan"},{"name":"Graduate School of Information Science and Technology, The University of Tokyo, Tokyo 113-8654, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,1,15]]},"reference":[{"key":"ref_1","unstructured":"Ministry of Health, Labour and Welfare (Japan) (2025, November 10). Outline of Vital Statistics Annual (Provisional), 2020, Available online: https:\/\/www.mhlw.go.jp\/toukei\/saikin\/hw\/jinkou\/geppo\/nengai20\/index.html."},{"key":"ref_2","unstructured":"Japan Association of Obstetricians and Gynecologists (2025, November 12). Assisted Reproductive Technology (ART). Available online: https:\/\/www.jaog.or.jp\/lecture\/11-%E7%94%9F%E6%AE%96%E8%A3%9C%E5%8A%A9%E5%8C%BB%E7%99%82%EF%BC%88art%EF%BC%89\/."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e12620","DOI":"10.1002\/rmb2.12620","article-title":"Assisted reproductive technology in Japan: A summary report for 2022 by the Ethics Committee of the Japan Society of Obstetrics and Gynecology","volume":"23","author":"Katagiri","year":"2024","journal-title":"Reprod. Med. Biol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1093\/humrep\/14.1.131","article-title":"Testicular sperm extraction: Microdissection improves sperm yield with minimal tissue excision","volume":"14","author":"Schlegel","year":"1999","journal-title":"Hum. Reprod."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1453","DOI":"10.1038\/s41591-019-0539-7","article-title":"An augmented reality microscope with real-time artificial intelligence integration for cancer diagnosis","volume":"25","author":"Chen","year":"2019","journal-title":"Nat. Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1530\/jrf.0.0550161","article-title":"The estimation of sperm motility in semen, on a membrane slide, by measuring the area change frequency with an image analysing computer","volume":"55","author":"Dott","year":"1979","journal-title":"J. Reprod. Fertil."},{"key":"ref_7","first-page":"400","article-title":"Sperm identification using elliptic model and tail detection","volume":"1","author":"Nafisi","year":"2005","journal-title":"Int. J. Med. Health Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Alcantarilla, P., Nuevo, J., and Bartoli, A. (2013, January 9\u201313). Fast explicit diffusion for accelerated features in nonlinear scale spaces. Proceedings of the British Machine Vision Conference, Bristol, UK.","DOI":"10.5244\/C.27.13"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lee, S.-W., and Li, S.Z. (2007). Face detection based on multi-block lbp representation. Advances in Biometrics, Springer.","DOI":"10.1007\/978-3-540-74549-5"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Vitanyi, P. (1995). A desicion-theoretic generalization of on-line learning and an application to boosting. Computational Learning Theory, Springer.","DOI":"10.1007\/3-540-59119-2"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Sasaki, H., Nakata, M., Yamamoto, M., Takeshima, T., Yumura, Y., and Hamagami, T. (2018, January 7\u201310). Investigation about control of false positive rate for automatic sperm detection in assisted reproductive technology. Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan.","DOI":"10.1109\/SMC.2018.00339"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Mohamed, M., Kachi, K., Motoya, K., and Ikeuchi, M. (2025). Fast and Accurate Sperm Detection Algorithm for Micro-TESE in NOA Patients. Bioengineering, 12.","DOI":"10.3390\/bioengineering12060601"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"91110","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Leonardis, A., Bischof, H., and Pinz, A. (2006). Surf: Speeded up robust features. Computer Vision\u2014ECCV 2006, Springer.","DOI":"10.1007\/11744047"},{"key":"ref_15","unstructured":"Viola, P., and Jones, M. (2001, January 8\u201314). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, Kauai, HI, USA."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_17","unstructured":"The PASCAL VOC Project (2025, November 12). The Pascal Visual Object Classes Homepage. Available online: http:\/\/host.robots.ox.ac.uk\/pascal\/VOC\/."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_19","unstructured":"Cortes, C., Lawrence, N., Lee, D., Sugiyama, M., and Garnett, R. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016). Ssd: Single shot multibox detector. Computer Vision\u2014ECCV 2016, Springer International Publishing.","DOI":"10.1007\/978-3-319-46466-4"},{"key":"ref_22","unstructured":"Ultralytics (2025, November 12). Yolov5 in Pytorch. Available online: https:\/\/github.com\/ultralytics\/yolov5."},{"key":"ref_23","unstructured":"DITECT Co., Ltd. (2025, November 12). SMAS\u2014Sperm Motility Analysis System. Available online: https:\/\/www.ditect.co.jp\/smas\/."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1002\/j.1939-4640.1991.tb00258.x","article-title":"Relationship between sperm motility assessed with the Hamilton-Thorn motility analyzer and fertilization rates in vitro","volume":"12","author":"Liu","year":"1991","journal-title":"J. Androl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1016\/S0015-0282(16)56171-8","article-title":"Prognostic significance of computerized motility analysis for in vivo fertility","volume":"60","author":"Barratt","year":"1993","journal-title":"Fertil. Steril."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2324","DOI":"10.1093\/oxfordjournals.humrep.a138446","article-title":"A prospective clinical study of the relationship between the computer-assisted assessment of human semen quality and the achievement of pregnancy in vivo","volume":"9","author":"Irvine","year":"1994","journal-title":"Hum. Reprod."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1306","DOI":"10.1016\/S0015-0282(16)57616-X","article-title":"A new fully automated system for the morphometric analysis of human sperm heads","volume":"63","author":"Garrett","year":"1995","journal-title":"Fertil. Steril."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.1439-0272.1997.tb03141.x","article-title":"Effects of different staining and washing procedures on the results of human sperm morphology evaluation by manual and computerised methods","volume":"29","author":"Menkveld","year":"1997","journal-title":"Andrologia"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25\u201328). Simple online and realtime tracking. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_30","unstructured":"World Health Organization (2010). Who Laboratory Manual for the Examination and Processing of Human Semen, WHO."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wojke, N., Bewley, A., and Paulus, D. (2017, January 17\u201320). Simple online and realtime tracking with a deep association metric. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"868","DOI":"10.1007\/978-3-319-46466-4_52","article-title":"Mars: A video benchmark for large-scale person re-identification","volume":"Volume 9910","author":"Zheng","year":"2016","journal-title":"Computer Vision\u2014ECCV 2016"},{"key":"ref_33","unstructured":"Ikeuchi, M., Oishi, K., Noguchi, H., Hayashi, S., and Ikuta, K. (2010, January 3\u20137). Soft tapered stencil mask for combinatorial 3d cluster formation of stem cells. Proceedings of the 14th International Conference on Miniaturized Systems for Chemistry and Life Sciences, Groningen, The Netherlands."},{"key":"ref_34","first-page":"7896","article-title":"An elastic expandable fault diagnosis method of three-phase motors using continual learning for class-added sample accumulations","volume":"70","author":"Ding","year":"2023","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1145\/3530910","article-title":"Resource-efficient continual learning for sensor-based human activity recognition","volume":"21","author":"Leite","year":"2022","journal-title":"ACM Trans. Embed. Comput. Syst."}],"container-title":["Bioengineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5354\/13\/1\/102\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T13:06:14Z","timestamp":1768482374000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5354\/13\/1\/102"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,15]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["bioengineering13010102"],"URL":"https:\/\/doi.org\/10.3390\/bioengineering13010102","relation":{},"ISSN":["2306-5354"],"issn-type":[{"value":"2306-5354","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,15]]}}}