{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T10:58:43Z","timestamp":1773313123877,"version":"3.50.1"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2022,1,20]],"date-time":"2022-01-20T00:00:00Z","timestamp":1642636800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,20]],"date-time":"2022-01-20T00:00:00Z","timestamp":1642636800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100004440","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["WT101957"],"award-info":[{"award-number":["WT101957"]}],"id":[{"id":"10.13039\/100004440","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"published-print":{"date-parts":[[2022,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Purpose<\/jats:title><jats:p>Laparoscopic sacrocolpopexy is the gold standard procedure for the management of vaginal vault prolapse. Studying surgical skills and different approaches to this procedure requires an analysis at the level of each of its individual phases, thus motivating investigation of automated surgical workflow for expediting this research. Phase durations in this procedure are significantly larger and more variable than commonly available benchmarks such as Cholec80, and we assess these differences.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methodology<\/jats:title><jats:p>We introduce sequence-to-sequence (seq2seq) models for coarse-level phase segmentation in order to deal with highly variable phase durations in Sacrocolpopexy. Multiple architectures (LSTM and transformer), configurations (time-shifted, time-synchronous), and training strategies are tested with this novel framework to explore its flexibility.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We perform 7-fold cross-validation on a dataset with 14 complete videos of sacrocolpopexy. We perform both a frame-based (accuracy, F1-score) and an event-based (Ward metric) evaluation of our algorithms and show that different architectures present a trade-off between higher number of accurate frames (LSTM, Mode average) or more consistent ordering of phase transitions (Transformer). We compare the implementations on the widely used Cholec80 dataset and verify that relative performances are different to those in Sacrocolpopexy.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>We show that workflow segmentation of Sacrocolpopexy videos has specific challenges that are different to the widely used benchmark Cholec80 and require dedicated approaches to deal with the significantly larger phase durations. We demonstrate the feasibility of seq2seq models in Sacrocolpopexy, a broad framework that can be further explored with new configurations. We show that an event-based evaluation metric is useful to evaluate workflow segmentation algorithms and provides complementary insight to the more commonly used metrics such as accuracy or F1-score.<\/jats:p><\/jats:sec>","DOI":"10.1007\/s11548-021-02544-5","type":"journal-article","created":{"date-parts":[[2022,1,20]],"date-time":"2022-01-20T10:02:26Z","timestamp":1642672946000},"page":"467-477","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Large-scale surgical workflow segmentation for laparoscopic sacrocolpopexy"],"prefix":"10.1007","volume":"17","author":[{"given":"Yitong","family":"Zhang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sophia","family":"Bano","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ann-Sophie","family":"Page","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jan","family":"Deprest","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danail","family":"Stoyanov","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francisco","family":"Vasconcelos","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,1,20]]},"reference":[{"key":"2544_CR1","doi-asserted-by":"crossref","unstructured":"Balicki M, Kyne S, Toporek G, Holthuizen R, Homan R, Popovic A, Burstr\u00f6m G, Persson O, Edstr\u00f6m E, Elmi-Terander A, Patriciu A (2020) Design and control of an image-guided robot for spine surgery in a hybrid OR. Int J Med Robot Comput Assist Surg e2108","DOI":"10.1002\/rcs.2108"},{"key":"2544_CR2","doi-asserted-by":"publisher","first-page":"37493","DOI":"10.1109\/ACCESS.2018.2850284","volume":"6","author":"S Bano","year":"2018","unstructured":"Bano S, Suveges T, Zhang J, Mckenna SJ (2018) Multimodal egocentric analysis of focused interactions. IEEE Access 6:37493\u201337505","journal-title":"IEEE Access"},{"key":"2544_CR3","doi-asserted-by":"crossref","unstructured":"Bloice MD, Stocker C, Holzinger A (2017) Augmentor: an image augmentation library for machine learning. arXiv preprint arXiv:1708.04680","DOI":"10.21105\/joss.00432"},{"key":"2544_CR4","doi-asserted-by":"crossref","unstructured":"Chen W, Feng J, Lu J, Zhou J (2018) Endo3d: online workflow analysis for endoscopic surgeries based on 3D CNN and LSTM. In: OR 2.0 context-aware operating theaters, computer assisted robotic endoscopy, clinical image-based procedures, and skin image analysis, pp 97\u2013107. Springer","DOI":"10.1007\/978-3-030-01201-4_12"},{"key":"2544_CR5","doi-asserted-by":"crossref","unstructured":"Chiu HK, Adeli E, Wang B, Huang DA, Niebles JC (2019) Action-agnostic human pose forecasting. In: 2019 IEEE winter conference on applications of computer vision (WACV), pp 1423\u20131432. IEEE","DOI":"10.1109\/WACV.2019.00156"},{"key":"2544_CR6","doi-asserted-by":"crossref","unstructured":"Claerhout F, Roovers JP, Lewi P, Verguts J, De Ridder D, Deprest J (2009) Implementation of laparoscopic sacrocolpopexy\u2014a single centre\u2019s experience. Int Urogynecol J 20(9):1119\u20131125","DOI":"10.1007\/s00192-009-0914-x"},{"issue":"9","key":"2544_CR7","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1007\/s00192-014-2412-z","volume":"25","author":"F Claerhout","year":"2014","unstructured":"Claerhout F, Verguts J, Werbrouck E, Veldman J, Lewi P, Deprest J (2014) Analysis of the learning process for laparoscopic sacrocolpopexy: identification of challenging steps. Int Urogynecol J 25(9):1185\u20131191","journal-title":"Int Urogynecol J"},{"key":"2544_CR8","doi-asserted-by":"crossref","unstructured":"Czempiel T, Paschali M, Keicher M, Simson W, Feussner H, Kim ST, Navab N (2020) TeCNO: surgical phase recognition with multi-stage temporal convolutional networks. In: International conference on medical image computing and computer-assisted intervention, pp 343\u2013352. Springer","DOI":"10.1007\/978-3-030-59716-0_33"},{"key":"2544_CR9","doi-asserted-by":"crossref","unstructured":"Czempiel T, Paschali M, Ostler D, Kim S.T., Busam B, Navab N (2021) Opera: attention-regularized transformers for surgical phase recognition. arXiv preprint arXiv:2103.03873","DOI":"10.1007\/978-3-030-87202-1_58"},{"issue":"4","key":"2544_CR10","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1097\/00042307-200207000-00015","volume":"12","author":"BJ Flynn","year":"2002","unstructured":"Flynn BJ, Webster GD (2002) Surgical management of the apical vaginal defect. Curr Opin Urol 12(4):353\u2013358","journal-title":"Curr Opin Urol"},{"key":"2544_CR11","doi-asserted-by":"crossref","unstructured":"Gao X, Jin Y, Long Y, Dou Q, Heng P.A. (2021) Trans-svnet: accurate phase recognition from surgical videos via hybrid embedding aggregation transformer. arXiv preprint arXiv:2103.09712","DOI":"10.1007\/978-3-030-87202-1_57"},{"issue":"7432","key":"2544_CR12","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1136\/bmj.37984.623889.F6","volume":"328","author":"R Garry","year":"2004","unstructured":"Garry R, Fountain J, Mason S, Hawe J, Napp V, Abbott J, Clayton R, Phillips G, Whittaker M, Lilford R, Bridgman S, Brown J (2004) The evaluate study: two parallel randomised trials, one comparing laparoscopic with abdominal hysterectomy, the other comparing laparoscopic with vaginal hysterectomy. BMJ 328(7432):129","journal-title":"BMJ"},{"key":"2544_CR13","doi-asserted-by":"crossref","unstructured":"Guo D, Zhou W, Li H, Wang M (2018) Hierarchical LSTM for sign language translation. In: AAAI","DOI":"10.1609\/aaai.v32i1.12235"},{"key":"2544_CR14","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735\u201380","journal-title":"Neural Comput"},{"key":"2544_CR15","doi-asserted-by":"crossref","unstructured":"Huang X, Tan H, Lin G, Tian Y (2018) A LSTM-based bidirectional translation model for optimizing rare words and terminologies. In: 2018 international conference on artificial intelligence and big data (ICAIBD), pp 185\u2013189. IEEE","DOI":"10.1109\/ICAIBD.2018.8396191"},{"key":"2544_CR16","unstructured":"Jin Y, Dou Q, Chen H, Yu L, Heng PA (2016) EndoRCN: recurrent convolutional networks for recognition of surgical workflow in cholecystectomy procedure video. IEEE Trans Med Imaging"},{"issue":"5","key":"2544_CR17","doi-asserted-by":"publisher","first-page":"1114","DOI":"10.1109\/TMI.2017.2787657","volume":"37","author":"Y Jin","year":"2018","unstructured":"Jin Y, Dou Q, Chen H, Yu L, Qin J, Fu C, Heng P (2018) SV-RCNet: workflow recognition from surgical videos using recurrent convolutional network. IEEE Trans Med Imaging 37(5):1114\u20131126","journal-title":"IEEE Trans Med Imaging"},{"key":"2544_CR18","unstructured":"Kingma D.P., Ba J (2014) Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980"},{"key":"2544_CR19","unstructured":"Krizhevsky A, Sutskever I, Hinton G.E. (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097\u20131105"},{"key":"2544_CR20","unstructured":"Lavallee S, Troccaz J, Gaborit L, Cinquin P, Benabid A, Hoffmann D (1992) Image guided operating robot: a clinical application in stereotactic neurosurgery. In: Proceedings 1992 IEEE international conference on robotics and automation. IEEE Computer Society"},{"key":"2544_CR21","doi-asserted-by":"crossref","unstructured":"Maher C, Feiner B, Baessler K, Schmid C (2013) Surgical management of pelvic organ prolapse in women. Cochrane Database Syst Rev 4","DOI":"10.1002\/14651858.CD004014.pub5"},{"issue":"6","key":"2544_CR22","doi-asserted-by":"publisher","first-page":"1059","DOI":"10.1007\/s11548-019-01958-6","volume":"14","author":"CI Nwoye","year":"2019","unstructured":"Nwoye CI, Mutter D, Marescaux J, Padoy N (2019) Weakly supervised convolutional LSTM approach for tool tracking in laparoscopic videos. Int J Comput Assist Radiol Surg 14(6):1059\u20131067","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"2544_CR23","doi-asserted-by":"crossref","unstructured":"Schmidt F (2019) Generalization in generation: a closer look at exposure bias. arXiv preprint. arXiv:1910.00292","DOI":"10.18653\/v1\/D19-5616"},{"issue":"4","key":"2544_CR24","first-page":"646","volume":"98","author":"LL Subak","year":"2001","unstructured":"Subak LL, Waetjen LE, Van Den Eeden S, Thom DH, Vittinghoff E, Brown JS (2001) Cost of pelvic organ prolapse surgery in the United States. Obstet Gynecol 98(4):646\u2013651","journal-title":"Obstet Gynecol"},{"key":"2544_CR25","unstructured":"Sutskever I, Vinyals O, Le QV (2014) Sequence to sequence learning with neural networks. In: Advances in neural information processing systems, pp 3104\u20133112"},{"issue":"1","key":"2544_CR26","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/TMI.2016.2593957","volume":"36","author":"AP Twinanda","year":"2016","unstructured":"Twinanda AP, Shehata S, Mutter D, Marescaux J, De Mathelin M, Padoy N (2016) EndoNet: a deep architecture for recognition tasks on laparoscopic videos. IEEE Trans Med Imaging 36(1):86\u201397","journal-title":"IEEE Trans Med Imaging"},{"key":"2544_CR27","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A.N., Kaiser \u0141, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, pp 5998\u20136008"},{"issue":"1","key":"2544_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1889681.1889687","volume":"2","author":"JA Ward","year":"2011","unstructured":"Ward JA, Lukowicz P, Gellersen HW (2011) Performance metrics for activity recognition. ACM Trans Intell Syst Technol (TIST) 2(1):1\u201323","journal-title":"ACM Trans Intell Syst Technol (TIST)"},{"key":"2544_CR29","doi-asserted-by":"crossref","unstructured":"Weede O, Dittrich F, W\u00f6rn H, Jensen B, Knoll A, Wilhelm D, Kranzfelder M, Schneider A, Feussner H (2012) Workflow analysis and surgical phase recognition in minimally invasive surgery. In: 2012 IEEE international conference on robotics and biomimetics (ROBIO), pp 1080\u20131074. IEEE","DOI":"10.1109\/ROBIO.2012.6491111"},{"key":"2544_CR30","unstructured":"Wei Z, Wang B, Hoai M, Zhang J, Shen X, Lin Z, Mech R, Samaras D (2019) Sequence-to-segments networks for detecting segments in videos. IEEE Trans Pattern Anal Mach Intell 1\u20131"},{"key":"2544_CR31","doi-asserted-by":"crossref","unstructured":"Xu N, Yang L, Fan Y, Yang J, Yue D, Liang Y, Price B, Cohen S, Huang T (2018) YouTube-VOS: sequence-to-sequence video object segmentation. In: Proceedings of the European conference on computer vision (ECCV), pp 585\u2013601","DOI":"10.1007\/978-3-030-01228-1_36"},{"key":"2544_CR32","doi-asserted-by":"crossref","unstructured":"Yuan K, Holden M, Gao S, Lee WS (2021) Surgical workflow anticipation using instrument interaction. In: International conference on medical image computing and computer-assisted intervention, pp 615\u2013625. Springer","DOI":"10.1007\/978-3-030-87202-1_59"},{"key":"2544_CR33","doi-asserted-by":"crossref","unstructured":"Zisimopoulos O, Flouty E, Luengo I, Giataganas P, Nehme J, Chow A, Stoyanov D (2018)DeepPhase: surgical phase recognition in cataracts videos. In: International conference on medical image computing and computer-assisted intervention, pp 265\u2013272. Springer","DOI":"10.1007\/978-3-030-00937-3_31"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-021-02544-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-021-02544-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-021-02544-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,23]],"date-time":"2023-01-23T21:37:12Z","timestamp":1674509832000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-021-02544-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,20]]},"references-count":33,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,3]]}},"alternative-id":["2544"],"URL":"https:\/\/doi.org\/10.1007\/s11548-021-02544-5","relation":{},"ISSN":["1861-6410","1861-6429"],"issn-type":[{"value":"1861-6410","type":"print"},{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,20]]},"assertion":[{"value":"9 July 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 December 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 January 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}},{"value":"For this type of study, formal consent is not required.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"This article does not contain patient data.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}