{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,20]],"date-time":"2026-10-20T21:11:46Z","timestamp":1792530706259,"version":"4.5.0"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,7,24]],"date-time":"2023-07-24T00:00:00Z","timestamp":1690156800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,7,24]],"date-time":"2023-07-24T00:00:00Z","timestamp":1690156800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["21A0101L0"],"award-info":[{"award-number":["21A0101L0"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2022R1A2C2091160"],"award-info":[{"award-number":["2022R1A2C2091160"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Benign paroxysmal positional vertigo (BPPV), the most common vestibular disorder, is diagnosed by an examiner changing the posture of the examinee and inducing nystagmus. Among the diagnostic methods used to observe nystagmus, video-nystagmography has been widely used recently because it is non-invasive. A specialist with professional knowledge and training in vertigo diagnosis is needed to diagnose BPPV accurately, but the ratio of vertigo patients to specialists is too high, thus necessitating the need for automated diagnosis of BPPV. In this paper, a convolutional neural network-based nystagmus extraction system, ANyEye, optimized for video-nystagmography data is proposed. A pupil was segmented to track the exact pupil trajectory from real-world data obtained during field inspection. A deep convolutional neural network model was trained with the new video-nystagmography dataset for the pupil segmentation task, and a compensation algorithm was designed to correct pupil position. In addition, a slippage detection algorithm based on moving averages was designed to eliminate the motion artifacts induced by goggle slippage. ANyEye outperformed other eye-tracking methods including learning and non-learning-based algorithms with five-pixel error detection rate of 91.26%.<\/jats:p>","DOI":"10.1038\/s41598-023-39104-7","type":"journal-article","created":{"date-parts":[[2023,7,24]],"date-time":"2023-07-24T16:31:53Z","timestamp":1690216313000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["A nystagmus extraction system using artificial intelligence for video-nystagmography"],"prefix":"10.1038","volume":"13","author":[{"given":"Yerin","family":"Lee","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sena","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junghun","family":"Han","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Young Joon","family":"Seo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sejung","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,7,24]]},"reference":[{"key":"39104_CR1","first-page":"1131","volume":"48","author":"L Yardley","year":"1998","unstructured":"Yardley, L., Owen, N., Nazareth, I. & Luxon, L. Prevalence and presentation of dizziness in a general practice community sample of working age people. Br. J. Gen. Pract. 48, 1131 (1998).","journal-title":"Br. J. Gen. Pract."},{"key":"39104_CR2","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1093\/fampra\/cmi004","volume":"22","author":"PC Hannaford","year":"2005","unstructured":"Hannaford, P. C. et al. The prevalence of ear, nose and throat problems in the community: Results from a national cross-sectional postal survey in Scotland. Fam. Pract. 22, 227\u2013233 (2005).","journal-title":"Fam. Pract."},{"key":"39104_CR3","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1177\/019459988509300501","volume":"93","author":"BW Pearson","year":"1985","unstructured":"Pearson, B. W. & Brackmann, D. E. Committee on hearing and equilibrium guidelines for reporting treatment results in meniere\u2019s disease. Otolaryngol. Head Neck Surg. 93, 579\u2013581 (1985).","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"39104_CR4","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1097\/WCO.0b013e328013f432","volume":"20","author":"HK Neuhauser","year":"2007","unstructured":"Neuhauser, H. K. Epidemiology of vertigo. Curr. Opin. Neurol. 20, 40\u201346 (2007).","journal-title":"Curr. Opin. Neurol."},{"key":"39104_CR5","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1177\/0194599816689660","volume":"156","author":"N Bhattacharyya","year":"2017","unstructured":"Bhattacharyya, N. et al. Clinical practice guideline: Benign paroxysmal positional vertigo (update) executive summary. Otolaryngol. Head Neck Surg. 156, 403\u2013416 (2017).","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"39104_CR6","doi-asserted-by":"publisher","first-page":"1590","DOI":"10.1056\/NEJM199911183412107","volume":"341","author":"JM Furman","year":"1999","unstructured":"Furman, J. M. & Cass, S. P. Benign paroxysmal positional vertigo. N. Engl. J. Med. 341, 1590\u20131596 (1999).","journal-title":"N. Engl. J. Med."},{"key":"39104_CR7","first-page":"151","volume":"8","author":"S Hall","year":"1979","unstructured":"Hall, S., Ruby, R. & McClure, J. The mechanics of benign paroxysmal vertigo. J. Otolaryngol. 8, 151\u2013158 (1979).","journal-title":"J. Otolaryngol."},{"key":"39104_CR8","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1001\/archotol.1969.00770030767020","volume":"90","author":"HF Schuknecht","year":"1969","unstructured":"Schuknecht, H. F. Cupulolithiasis. Arch. Otolaryngol. 90, 765\u2013778 (1969).","journal-title":"Arch. Otolaryngol."},{"key":"39104_CR9","first-page":"681","volume":"169","author":"LS Parnes","year":"2003","unstructured":"Parnes, L. S., Agrawal, S. K. & Atlas, J. Diagnosis and management of benign paroxysmal positional vertigo (BPPV). CMAJ 169, 681\u2013693 (2003).","journal-title":"CMAJ"},{"issue":"3","key":"39104_CR10","doi-asserted-by":"publisher","first-page":"153","DOI":"10.7874\/jao.2021.00297","volume":"26","author":"A Castellucci","year":"2022","unstructured":"Castellucci, A. et al. Spontaneous upbeat nystagmus and selective anterior semicircular canal hypofunction on video head impulse test: a new variant of canalith jam? J. Audiol. Otol. 26(3), 153\u2013159 (2022).","journal-title":"J. Audiol. Otol."},{"key":"39104_CR11","first-page":"30","volume":"14","author":"J McClure","year":"1985","unstructured":"McClure, J. Horizontal canal BPV. J. Otolaryngol. 14, 30\u201335 (1985).","journal-title":"J. Otolaryngol."},{"key":"39104_CR12","doi-asserted-by":"publisher","first-page":"48","DOI":"10.3368\/aoj.60.1.48","volume":"60","author":"RW Hertle","year":"2010","unstructured":"Hertle, R. W. Nystagmus in infancy and childhood: Characteristics and evidence for treatment. Am. Orthopt. J. 60, 48\u201358 (2010).","journal-title":"Am. Orthopt. J."},{"key":"39104_CR13","doi-asserted-by":"publisher","first-page":"1897","DOI":"10.1212\/01.WNL.0000163545.57134.3D","volume":"64","author":"S Aw","year":"2005","unstructured":"Aw, S., Todd, M., Aw, G., McGarvie, L. & Halmagyi, G. Benign positional nystagmus: A study of its three-dimensional spatio-temporal characteristics. Neurology 64, 1897\u20131905 (2005).","journal-title":"Neurology"},{"key":"39104_CR14","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1016\/j.clinph.2004.08.009","volume":"116","author":"T Brandt","year":"2005","unstructured":"Brandt, T. & Strupp, M. General vestibular testing. Clin. Neurophysiol. 116, 406\u2013426 (2005).","journal-title":"Clin. Neurophysiol."},{"key":"39104_CR15","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1590\/S1808-86942010000300021","volume":"76","author":"MM Ganan\u00e7a","year":"2010","unstructured":"Ganan\u00e7a, M. M., Caovilla, H. H. & Ganan\u00e7a, F. F. Eletronistagmografia versus videonistagmografia. Braz. J. Otorhinolaryngol. 76, 399\u2013403 (2010).","journal-title":"Braz. J. Otorhinolaryngol."},{"key":"39104_CR16","unstructured":"Aydemir, A. & Uneri, A. in 2006 IEEE 14th Signal Processing and Communications Applications (2006)."},{"key":"39104_CR17","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1097\/MAO.0000000000001233","volume":"38","author":"M-W Suh","year":"2017","unstructured":"Suh, M.-W. et al. Effect of goggle slippage on the video head impulse test outcome and its mechanisms. Otol. Neurotol. 38, 102\u2013109 (2017).","journal-title":"Otol. Neurotol."},{"key":"39104_CR18","doi-asserted-by":"publisher","first-page":"633","DOI":"10.3390\/jcm8050633","volume":"8","author":"E-C Lim","year":"2019","unstructured":"Lim, E.-C. et al. Developing a diagnostic decision support system for benign paroxysmal positional vertigo using a deep-learning model. J. Clin. Med. 8, 633 (2019).","journal-title":"J. Clin. Med."},{"key":"39104_CR19","doi-asserted-by":"publisher","DOI":"10.35841\/biomedicalresearch.30-19-216","author":"A Ben Slama","year":"2019","unstructured":"Ben Slama, A. et al. Machine learning based approach for vestibular disorder diagnostic in videonystagmography. Biomed. Res. https:\/\/doi.org\/10.35841\/biomedicalresearch.30-19-216 (2019).","journal-title":"Biomed. Res."},{"issue":"1","key":"39104_CR20","doi-asserted-by":"publisher","first-page":"20200043","DOI":"10.1515\/cdbme-2020-0043","volume":"6","author":"S Reinhardt","year":"2020","unstructured":"Reinhardt, S., Schmidt, J., Leuschel, M., Sch\u00fcle, C. & Schipper, J. VertiGo\u2013a pilot project in nystagmus detection via webcam. Curr. Dir. Biomed. Eng. 6(1), 20200043 (2020).","journal-title":"Curr. Dir. Biomed. Eng."},{"key":"39104_CR21","doi-asserted-by":"publisher","first-page":"102616","DOI":"10.1016\/j.bspc.2021.102616","volume":"68","author":"W Zhang","year":"2021","unstructured":"Zhang, W. et al. Deep learning based torsional nystagmus detection for dizziness and vertigo diagnosis. Biomed. Signal Process Control 68, 102616 (2021).","journal-title":"Biomed. Signal Process Control"},{"key":"39104_CR22","unstructured":"Keil, A., Albuquerque, G., Berger, K. & Magnor, M. A. Real-time gaze tracking with a consumer-grade video camera. In Proceedings of the 18th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision in co-operation with EUROGRAPHICS, 129\u2013134 (2010)."},{"key":"39104_CR23","doi-asserted-by":"crossref","unstructured":"Goni, S., Echeto, J., Villanueva, A. & Cabeza, R. in Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICP. 941\u2013944 (IEEE, 2004).","DOI":"10.1109\/ICPR.2004.1333928"},{"key":"39104_CR24","unstructured":"Li, D., Winfield, D. & Parkhurst, D. J. in 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05)-Workshops. 79\u201379 (IEEE)."},{"key":"39104_CR25","unstructured":"Fuhl, W., K\u00fcbler, T., Sippel, K., Rosenstiel, W. & Kasneci, E. in International Conference on Computer Analysis of Images and Patterns. 39\u201351 (Springer)."},{"key":"39104_CR26","unstructured":"Fuhl, W., Santini, T. C., K\u00fcbler, T. & Kasneci, E. in Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications. 123\u2013130."},{"key":"39104_CR27","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1016\/j.cviu.2018.02.002","volume":"170","author":"T Santini","year":"2018","unstructured":"Santini, T., Fuhl, W. & Kasneci, E. PuRe: Robust pupil detection for real-time pervasive eye tracking. Comput. Vis. Image Underst. 170, 40\u201350 (2018).","journal-title":"Comput. Vis. Image Underst."},{"key":"39104_CR28","unstructured":"Fuhl, W., Santini, T., Kasneci, G. & Kasneci, E. Pupilnet: Convolutional neural networks for robust pupil detection. arXiv preprint arXiv:1601.04902 (2016)."},{"key":"39104_CR29","doi-asserted-by":"publisher","first-page":"85","DOI":"10.3233\/ICA-180584","volume":"26","author":"FJ Vera-Olmos","year":"2019","unstructured":"Vera-Olmos, F. J., Pardo, E., Melero, H. & Malpica, N. DeepEye: Deep convolutional network for pupil detection in real environments. Integr. Comput. Aided Eng. 26, 85\u201395 (2019).","journal-title":"Integr. Comput. Aided Eng."},{"key":"39104_CR30","doi-asserted-by":"publisher","first-page":"108307","DOI":"10.1016\/j.jneumeth.2019.05.016","volume":"324","author":"Y-H Yiu","year":"2019","unstructured":"Yiu, Y.-H. et al. DeepVOG: Open-source pupil segmentation and gaze estimation in neuroscience using deep learning. J. Neurosci. Methods 324, 108307 (2019).","journal-title":"J. Neurosci. Methods"},{"key":"39104_CR31","doi-asserted-by":"publisher","first-page":"2757","DOI":"10.1109\/TVCG.2021.3067765","volume":"27","author":"RS Kothari","year":"2021","unstructured":"Kothari, R. S., Chaudhary, A. K., Bailey, R. J., Pelz, J. B. & Diaz, G. J. Ellseg: An ellipse segmentation framework for robust gaze tracking. IEEE Trans. Visual Comput. Graph. 27, 2757\u20132767 (2021).","journal-title":"IEEE Trans. Visual Comput. Graph."},{"key":"39104_CR32","doi-asserted-by":"publisher","first-page":"e61488","DOI":"10.1371\/journal.pone.0061488","volume":"8","author":"HG MacDougall","year":"2013","unstructured":"MacDougall, H. G., McGarvie, L. A., Halmagyi, G. M., Curthoys, I. S. & Weber, K. P. The video head impulse test (vHIT) detects vertical semicircular canal dysfunction. PLoS ONE 8, e61488 (2013).","journal-title":"PLoS ONE"},{"key":"39104_CR33","doi-asserted-by":"publisher","first-page":"1683","DOI":"10.1007\/s00415-002-0905-z","volume":"249","author":"Y Hayashi","year":"2002","unstructured":"Hayashi, Y. et al. Three-dimensional analysis of nystagmus in benign paroxysmal positional vertigo. J. Neurol. 249, 1683\u20131688 (2002).","journal-title":"J. Neurol."},{"key":"39104_CR34","doi-asserted-by":"publisher","first-page":"3595","DOI":"10.1007\/s00405-016-3979-4","volume":"273","author":"YJ Seo","year":"2016","unstructured":"Seo, Y. J., Park, Y. A., Kong, T. H., Bae, M. R. & Kim, S. H. Head position and increased head velocity to optimize video head impulse test sensitivity. Eur. Arch Otorhinolaryngol. 273, 3595\u20133602 (2016).","journal-title":"Eur. Arch Otorhinolaryngol."},{"key":"39104_CR35","doi-asserted-by":"publisher","first-page":"91","DOI":"10.21790\/rvs.2019.18.4.91","volume":"18","author":"KJ Roh","year":"2019","unstructured":"Roh, K. J., Kim, J. Y. & Son, E. J. Comparison of suppression head impulse and conventional head impulse test protocols. Res. Vestib. Sci. 18, 91\u201397 (2019).","journal-title":"Res. Vestib. Sci."},{"key":"39104_CR36","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/B978-0-323-55136-6.00002-2","volume-title":"Dizziness and Vertigo Across the Lifespan","author":"TP Chang","year":"2019","unstructured":"Chang, T. P., Zee, D. S. & Kheradmand, A. Technological advances in testing the dizzy patient: the bedside examination is still the key to successful diagnosis. In Dizziness and Vertigo Across the Lifespan 9\u201330 (Elsevier, 2019)."},{"key":"39104_CR37","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1145\/358669.358692","volume":"24","author":"MA Fischler","year":"1981","unstructured":"Fischler, M. A. & Bolles, R. C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381\u2013395 (1981).","journal-title":"Commun. ACM"},{"key":"39104_CR38","unstructured":"Kingma, D. P. & Ba, J. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"39104_CR39","first-page":"8026","volume":"32","author":"A Paszke","year":"2019","unstructured":"Paszke, A. et al. Pytorch: An imperative style, high-performance deep learning library. Adv. Neural. Inf. Process. Syst. 32, 8026\u20138037 (2019).","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"39104_CR40","unstructured":"Fitzgibbon, A. W. & Fisher, R. B. in British Machine Vision Conference, 513\u2013522 (Birmingham, 1995)."},{"key":"39104_CR41","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1016\/j.otohns.2005.03.080","volume":"133","author":"JA White","year":"2005","unstructured":"White, J. A., Coale, K. D., Catalano, P. J. & Oas, J. G. Diagnosis and management of lateral semicircular canal benign paroxysmal positional vertigo. Otolaryngol. Head Neck Surg. 133, 278\u2013284 (2005).","journal-title":"Otolaryngol. Head Neck Surg."}],"updated-by":[{"DOI":"10.1038\/s41598-023-41913-9","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2023,9,5]],"date-time":"2023-09-05T00:00:00Z","timestamp":1693872000000}}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-39104-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-39104-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-39104-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T18:17:50Z","timestamp":1729793870000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-39104-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,24]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["39104"],"URL":"https:\/\/doi.org\/10.1038\/s41598-023-39104-7","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2694696\/v1","asserted-by":"object"}]},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,24]]},"assertion":[{"value":"15 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 July 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 July 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 September 2023","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1038\/s41598-023-41913-9","URL":"https:\/\/doi.org\/10.1038\/s41598-023-41913-9","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"11975"}}