{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T07:08:02Z","timestamp":1788246482473,"version":"build-2803163510"},"reference-count":21,"publisher":"Institution of Engineering and Technology (IET)","issue":"2-3","license":[{"start":{"date-parts":[[2024,2,17]],"date-time":"2024-02-17T00:00:00Z","timestamp":1708128000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["ietresearch.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Healthcare Tech Letters"],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>An important part of surgical training in ophthalmology is understanding how to proficiently perform cataract surgery. Operating skill in cataract surgery is typically assessed by real\u2010time or video\u2010based expert review using a rating scale. This is time\u2010consuming, subjective and labour\u2010intensive. A typical trainee graduates with over 100 complete surgeries, each of which requires review by the surgical educators. Due to the consistently repetitive nature of this task, it lends itself well to machine learning\u2010based evaluation. Recent studies utilize deep learning models trained on tool motion trajectories obtained using additional equipment or robotic systems. However, the process of tool recognition by extracting frames from the videos to perform phase recognition followed by skill assessment is exhaustive. This project proposes a deep learning model for skill evaluation using raw surgery videos that is cost\u2010effective and end\u2010to\u2010end trainable. An advanced ensemble of convolutional neural network models is leveraged to model technical skills in cataract surgeries and is evaluated using a large dataset comprising almost 200 surgical trials. The highest accuracy of 0.8494 is observed on the phacoemulsification step data. Our model yielded an average accuracy of 0.8200 and an average AUC score of 0.8800 for all four phase datasets of cataract surgery proving its robustness against different data. The proposed ensemble model with 2D and 3D convolutional neural networks demonstrated a promising result without using tool motion trajectories to evaluate surgery expertise.<\/jats:p>","DOI":"10.1049\/htl2.12078","type":"journal-article","created":{"date-parts":[[2024,2,17]],"date-time":"2024-02-17T05:36:11Z","timestamp":1708148171000},"page":"189-195","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Performance evaluation in cataract surgery with an ensemble of 2D\u20133D convolutional neural networks"],"prefix":"10.1049","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-8834-2412","authenticated-orcid":false,"given":"Ummey","family":"Tanin","sequence":"first","affiliation":[{"name":"School of Computer Science Carleton University  Ottawa Ontario Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adrienne","family":"Duimering","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, School of Medicine Queen's University  Kingston Ontario Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christine","family":"Law","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, School of Medicine Queen's University  Kingston Ontario Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica","family":"Ruzicki","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, School of Medicine Queen's University  Kingston Ontario Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabriela","family":"Luna","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology, School of Medicine Queen's University  Kingston Ontario Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6031-7208","authenticated-orcid":false,"given":"Matthew","family":"Holden","sequence":"additional","affiliation":[{"name":"School of Computer Science Carleton University  Ottawa Ontario Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"265","published-online":{"date-parts":[[2024,2,17]]},"reference":[{"issue":"1","key":"e_1_2_10_2_1","first-page":"58","article-title":"The evolution of cataract surgery","volume":"113","author":"Davis G.","year":"2016","journal-title":"Mo. Med."},{"key":"e_1_2_10_3_1","unstructured":"Surgical assessment tool: ICO\u2010OSCAR.https:\/\/icoph.org\/?s=ICO\u2010OSCAR"},{"key":"e_1_2_10_4_1","doi-asserted-by":"crossref","unstructured":"Dollar P. Rabaud V. Cottrell G. Belongie S.:Behavior recognition via sparse spatial\u2010temporal features. In:IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance pp.65\u201372.IEEE Piscataway NJ(2005)","DOI":"10.1109\/VSPETS.2005.1570899"},{"key":"e_1_2_10_5_1","doi-asserted-by":"crossref","unstructured":"Donahue J. Hendricks L.A. Rohrbach M. Venugopalan S. Guadarrama S. Saenko K. Darrell T.:Long\u2010term recurrent convolutional networks for visual recognition and description. In2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) pp.2625\u20132634(2015). [Online]. Available:https:\/\/api.semanticscholar.org\/CorpusID:5736847","DOI":"10.1109\/CVPR.2015.7298878"},{"key":"e_1_2_10_6_1","volume-title":"Deep Learning","author":"Goodfellow I.","year":"2016"},{"key":"e_1_2_10_7_1","unstructured":"Padoy N. Twinanda A.P.:M2CAI 2016 Challenge.http:\/\/camma.u\u2010strasbg.fr\/m2cai2016\/"},{"key":"e_1_2_10_8_1","doi-asserted-by":"crossref","unstructured":"Sokolova N. Schoeffmann K. Taschwer M. Putzgruber\u2010Adamitsch D. ElShabrawi Y.:Evaluating the generalization performance of instrument classification in cataract surgery videos. In:Conference on Multimedia Modeling pp.626\u2013636.Springer Cham(2019)","DOI":"10.1007\/978-3-030-37734-2_51"},{"key":"e_1_2_10_9_1","unstructured":"Sahu A.S.M. Mukhopadhyay A. Zachow S.:Tool and phase recognition using contextual cnn features. M2CAI 2016 (2016)"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.xops.2022.100235"},{"key":"e_1_2_10_11_1","unstructured":"Padoy N. Twinanda A.P.:M2CAI 2016 Challenge.http:\/\/camma.u\u2010strasbg.fr\/m2cai2016"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-019-02025-w"},{"key":"e_1_2_10_13_1","doi-asserted-by":"crossref","unstructured":"Jin A. Yeung S. Jopling J. Krause J. Azagury D. Milstein A. Fei\u2010Fei L.:Tool detection and operative skill assessment in surgical videos using region\u2010based convolutional neural networks. In:IEEE Winter Conference on Applications of Computer Vision pp.691\u2013699.IEEE Piscataway NJ(2018)","DOI":"10.1109\/WACV.2018.00081"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-019-01956-8"},{"key":"e_1_2_10_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11548\u2010019\u201001995\u20101"},{"key":"e_1_2_10_16_1","doi-asserted-by":"crossref","unstructured":"Zia A. Sharma Y. Bettadapura V. Sarin E.L. Clements M.A. Essa I.:Automated assessment of surgical skills using frequency analysis. In:Proceedings of the 18th International Conference on Medical Image Computing and Computer\u2010Assisted Intervention vol.9349 pp.430\u2013438. MICCAI 2015.Springer Cham(2015).https:\/\/doi.org\/10.1007\/978\u20103\u2010319\u201024553\u20109_53","DOI":"10.1007\/978-3-319-24553-9_53"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-018-1704-z"},{"key":"e_1_2_10_18_1","doi-asserted-by":"crossref","unstructured":"Tran D. Bourdev L. Fergus R. Torresani L. Paluri M.:Learning spatiotemporal features with 3d convolutional networks. In:IEEE International Conference on Computer Vision (ICCV) pp.4489\u20134497.IEEE Piscataway NJ(2015)","DOI":"10.1109\/ICCV.2015.510"},{"key":"e_1_2_10_19_1","unstructured":"Diba A. Fayyaz M. Sharma A. Karami A.H. Arzani M.M. Yousefzadeh R. Gool L.V.:Temporal 3d convnets: new architecture and transfer learning for video classification. ArXiv vol. abs\/1711.08200 (2017)"},{"key":"e_1_2_10_20_1","doi-asserted-by":"crossref","unstructured":"Szegedy C. Ioffe S. Vanhoucke V. Alemi A.:Inception\u2010v4 Inception Resnet and the impact of residual connections on learning. In:Proceedings of the AAAI Conference on Artificial Intelligence vol.31(2017).https:\/\/doi.org\/10.1609\/aaai.v31i1.11231","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"e_1_2_10_21_1","unstructured":"Tanin U.H.:Deep video analysis methods for surgical skill assessment in cataract surgery.Master's thesis Carleton University(2022).https:\/\/curve.carleton.ca\/77d85ffd0cfb\u2010468b\u2010b9f0\u201081939778349f"},{"key":"e_1_2_10_22_1","unstructured":"Chen G. Chen P. Shi Y. Hsieh C.\u2010Y. Liao B. Zhang S.:Rethinking the usage of batch normalization and dropout in the training of deep neural networks. ArXiv vol. abs\/1905.05928 (2019)"}],"container-title":["Healthcare Technology Letters"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ietresearch.onlinelibrary.wiley.com\/doi\/pdf\/10.1049\/htl2.12078","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T05:45:48Z","timestamp":1761630348000},"score":1,"resource":{"primary":{"URL":"https:\/\/ietresearch.onlinelibrary.wiley.com\/doi\/10.1049\/htl2.12078"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,17]]},"references-count":21,"journal-issue":{"issue":"2-3","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["10.1049\/htl2.12078"],"URL":"https:\/\/doi.org\/10.1049\/htl2.12078","archive":["Portico"],"relation":{},"ISSN":["2053-3713","2053-3713"],"issn-type":[{"value":"2053-3713","type":"print"},{"value":"2053-3713","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,17]]},"assertion":[{"value":"2024-01-03","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-01-22","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}