{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,13]],"date-time":"2025-12-13T06:07:33Z","timestamp":1765606053643,"version":"3.48.0"},"reference-count":72,"publisher":"Wiley","issue":"12","license":[{"start":{"date-parts":[[2025,6,29]],"date-time":"2025-06-29T00:00:00Z","timestamp":1751155200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001839","name":"University Grants Committee","doi-asserted-by":"publisher","award":["RIF R4020\u201022"],"award-info":[{"award-number":["RIF R4020\u201022"]}],"id":[{"id":"10.13039\/501100001839","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001839","name":"University Grants Committee","doi-asserted-by":"publisher","award":["CRF C4026\u201021GF"],"award-info":[{"award-number":["CRF C4026\u201021GF"]}],"id":[{"id":"10.13039\/501100001839","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001839","name":"University Grants Committee","doi-asserted-by":"publisher","award":["GRF 14203323"],"award-info":[{"award-number":["GRF 14203323"]}],"id":[{"id":"10.13039\/501100001839","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001839","name":"University Grants Committee","doi-asserted-by":"publisher","award":["GRF 14216022"],"award-info":[{"award-number":["GRF 14216022"]}],"id":[{"id":"10.13039\/501100001839","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001839","name":"University Grants Committee","doi-asserted-by":"publisher","award":["GRF 14211420"],"award-info":[{"award-number":["GRF 14211420"]}],"id":[{"id":"10.13039\/501100001839","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["advanced.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Advanced Intelligent Systems"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:p>Endoscopic surgery is the gold standard for robotic\u2010assisted minimally invasive surgery. However, the complexity of surgical scenes, characterized by high variability in different surgical activity scenarios, presents challenges for surgical environment understanding. Deep learning models often struggle with cross\u2010activity interference, leading to suboptimal performance in each downstream task. To address this limitation, we explores multitask learning which utilizes the interrelated features between tasks to enhance overall task performance. In this article, we proposes EndoARSS, a novel multitask learning framework specifically designed for endoscopy surgery activity recognition and semantic segmentation. Built upon the DINOv2 foundation model, EndoARSS integrates low\u2010rank adaptation to facilitate efficient fine\u2010tuning while incorporating task efficient shared low\u2010rank adapters to mitigate gradient conflicts across diverse tasks. Additionally, we introduces the spatially\u2010aware multi\u2010scale attention that enhances feature representation discrimination by enabling cross\u2010spatial learning of global information within complex surgical environments. In order to evaluate the effectiveness of our framework, we presents three novel datasets, tailored for endoscopic surgery scenarios. Extensive experiments demonstrate that EndoARSS achieves remarkable performance across multiple benchmarks, improving both accuracy and robustness compared to existing models. These results underscore the potential of EndoARSS to advance AI\u2010driven surgical systems, offering valuable insights for enhancing surgical safety and efficiency.<\/jats:p>","DOI":"10.1002\/aisy.202500288","type":"journal-article","created":{"date-parts":[[2025,6,29]],"date-time":"2025-06-29T15:08:39Z","timestamp":1751209719000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["EndoARSS: Adapting Spatially Aware Foundation Model for Efficient Activity Recognition and Semantic Segmentation in Endoscopic Surgery"],"prefix":"10.1002","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2440-4950","authenticated-orcid":false,"given":"Guankun","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Electronic Engineering The Chinese University of Hong Kong  Hong Kong SAR 999077 P. R. China"},{"name":"Shenzhen Research Institute The Chinese University of Hong Kong  Shenzhen 518000 P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rui","family":"Tang","sequence":"additional","affiliation":[{"name":"School of Advanced Manufacturing Fuzhou University  Fuzhou 350000 P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mengya","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering The Chinese University of Hong Kong  Hong Kong SAR 999077 P. R. China"},{"name":"Shenzhen Research Institute The Chinese University of Hong Kong  Shenzhen 518000 P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Long","family":"Bai","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering The Chinese University of Hong Kong  Hong Kong SAR 999077 P. R. China"},{"name":"Shenzhen Research Institute The Chinese University of Hong Kong  Shenzhen 518000 P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huxin","family":"Gao","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering The Chinese University of Hong Kong  Hong Kong SAR 999077 P. R. China"},{"name":"Shenzhen Research Institute The Chinese University of Hong Kong  Shenzhen 518000 P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6488-1551","authenticated-orcid":false,"given":"Hongliang","family":"Ren","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering The Chinese University of Hong Kong  Hong Kong SAR 999077 P. R. China"},{"name":"Shenzhen Research Institute The Chinese University of Hong Kong  Shenzhen 518000 P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2025,6,29]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_10_2_1","DOI":"10.1016\/j.compbiomed.2023.107412"},{"unstructured":"S.Ali N.Ghatwary B.Braden D.Lamarque A.Bailey S.Realdon R.Cannizzaro J.Rittscher C.Daul J.East(Preprint arXiv:2003.03376 v1 Submitted: Mar.2020.","key":"e_1_2_10_3_1"},{"doi-asserted-by":"publisher","key":"e_1_2_10_4_1","DOI":"10.21037\/atm.2017.02.12"},{"doi-asserted-by":"publisher","key":"e_1_2_10_5_1","DOI":"10.1055\/s-0029-1215129"},{"doi-asserted-by":"publisher","key":"e_1_2_10_6_1","DOI":"10.1109\/TASE.2022.3203631"},{"unstructured":"M.Allan S.Kondo S.Bodenstedt S.Leger R.Kadkhodamohammadi I.Luengo F.Fuentes E.Flouty A.Mohammed M.Pedersen A.Kori V.Alex G.Krishnamurthi D.Rauber R.Mendel C.Palm S.Bano G.Saibro C.-S.Shih H.-A.Chiang J.Zhuang J.Yang V.Iglovikov A.Dobrenkii M.Reddiboina A.Reddy X.Liu C.Gao M.Unberath M.Kim et al. (Preprint) arXiv:2001.11190 v1 Submitted: Jan.2020.","key":"e_1_2_10_7_1"},{"doi-asserted-by":"crossref","unstructured":"M.Islam L.Seenivasan L. C.Ming H.Ren inInt. Conf. on Medical Image Computing and Computer\u2010Assisted Intervention Springer2020 pp.627\u2013636.","key":"e_1_2_10_8_1","DOI":"10.1007\/978-3-030-59716-0_60"},{"doi-asserted-by":"publisher","key":"e_1_2_10_9_1","DOI":"10.1007\/s11517-023-02877-0"},{"unstructured":"L.Bai M.Islam L.Seenivasan H.Ren(Preprint) arXiv:2305.11692 v1 Submitted: May2023.","key":"e_1_2_10_10_1"},{"doi-asserted-by":"publisher","key":"e_1_2_10_11_1","DOI":"10.1109\/LRA.2022.3146544"},{"unstructured":"Q.Tan L.Bai G.Wang M.Islam H.Ren(Preprint) arXiv:2402.11476 v1 Submitted: Feb.2024.","key":"e_1_2_10_12_1"},{"unstructured":"L.Bai G.Wang J.Wang X.Yang H.Gao X.Liang A.Wang M.Islam H.Ren(Preprint) arXiv:2402.06985 v1 Submiitted: Feb.2024.","key":"e_1_2_10_13_1"},{"key":"e_1_2_10_14_1","volume":"2","author":"Xu Y.","year":"2021","journal-title":"Innovation"},{"doi-asserted-by":"crossref","unstructured":"A.Haque A.\u2010A.\u2010Z.Imran A.Wang D.Terzopoulos in2021 IEEE 18th Int. Symp. on Biomedical Imaging (ISBI) IEEE Nice France2021 pp.693\u2013696.","key":"e_1_2_10_15_1","DOI":"10.1109\/ISBI48211.2021.9434167"},{"doi-asserted-by":"crossref","unstructured":"A.Wang M.Islam M.Xu Y.Zhang H.Ren inInt. Conf. on Medical Image Computing and Computer\u2010Assisted Intervention Springer2023 pp.234\u2013244.","key":"e_1_2_10_16_1","DOI":"10.1007\/978-3-031-47401-9_23"},{"doi-asserted-by":"publisher","key":"e_1_2_10_17_1","DOI":"10.1007\/s11548-024-03083-5"},{"unstructured":"M.Oquab T.Darcet T.Moutakanni H.Vo M.Szafraniec V.Khalidov P.Fernandez D.Haziza F.Massa A.El\u2010Nouby M.Assran N.Ballas W.Galuba R.Howes P.-Y.Huang S.\u2010W.Li I.Misra M.Rabbat V.Sharma G.Synnaeve H.Xu H.Jegou J.Mairal P.Labatut A.Joulin P.Bojanowski(Preprint) arXiv:2304.07193 v1 Submitted: Apr.2023.","key":"e_1_2_10_18_1"},{"unstructured":"E. J.Hu Y.Shen P.Wallis Z.Allen\u2010Zhu Y.Li S.Wang L.Wang W.Chen(Preprint) arXiv:2106.09685 v1 Submitted: Jun.2021.","key":"e_1_2_10_19_1"},{"doi-asserted-by":"crossref","unstructured":"R.Caruana inProc. of the Tenth Int. Conf. on Machine Learning Citeseer1993 pp.41\u201348.","key":"e_1_2_10_20_1","DOI":"10.1016\/B978-1-55860-307-3.50012-5"},{"unstructured":"L.Duong T.Cohn S.Bird P.Cook inProc. of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th Int. Joint Conf. on Natural Language Processing (Volume 2: Short Papers)2015 pp.845\u2013850.","key":"e_1_2_10_21_1"},{"key":"e_1_2_10_22_1","volume":"30","author":"Long M.","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"unstructured":"Y.Lu A.Kumar S.Zhai Y.Cheng T.Javidi R.Feris inProc. of the IEEE Conf. on Computer Vision and Pattern Recognition2017 pp.5334\u20135343.","key":"e_1_2_10_23_1"},{"unstructured":"A.Kendall Y.Gal R.Cipolla inProc. of the IEEE Conf. on Computer Vision and Pattern Recognition2018 pp.7482\u20137491.","key":"e_1_2_10_24_1"},{"unstructured":"Z.Chen V.Badrinarayanan C.\u2010Y.Lee A.Rabinovich inInt. Conf. on Machine Learning PMLR2018 pp.794\u2013803.","key":"e_1_2_10_25_1"},{"key":"e_1_2_10_26_1","volume":"31","author":"Sener O.","year":"2018","journal-title":"Adv. Neural Inf. Process. Systems"},{"doi-asserted-by":"crossref","unstructured":"I.Misra A.Shrivastava A.Gupta M.Hebert inProc. of the IEEE Conf. on Computer Vision and Pattern Recognition2016 pp.3994\u20134003.","key":"e_1_2_10_27_1","DOI":"10.1109\/CVPR.2016.433"},{"doi-asserted-by":"crossref","unstructured":"S.Liu E.Johns A. J.Davison inProc. of the IEEE\/CVF Conf. on Computer Vision and Pattern Recognition2019 pp.1871\u20131880.","key":"e_1_2_10_28_1","DOI":"10.1109\/CVPR.2019.00197"},{"unstructured":"M.Wallingford H.Li A.Achille A.Ravichandran C.Fowlkes R.Bhotika S.Soatto inProc. of the IEEE\/CVF Conf. on Computer Vision and Pattern Recognition2022 pp.7561\u20137570.","key":"e_1_2_10_29_1"},{"unstructured":"N.Shazeer A.Mirhoseini K.Maziarz A.Davis Q.Le G.Hinton J.Dean(Preprint) arXiv:1701.06538 v1 Submitted: Jan.2017.","key":"e_1_2_10_30_1"},{"key":"e_1_2_10_31_1","first-page":"28441","volume":"35","author":"Liang H.","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"doi-asserted-by":"publisher","key":"e_1_2_10_32_1","DOI":"10.1109\/TCBB.2022.3175456"},{"unstructured":"R.Hu A.Singh inProc. of the IEEE\/CVF Int. Conf. on Computer Vision2021 pp.1439\u20131449.","key":"e_1_2_10_33_1"},{"unstructured":"H.Ye D.Xu inThe Eleventh Int. Conf. on Learning Representations2022.","key":"e_1_2_10_34_1"},{"doi-asserted-by":"publisher","key":"e_1_2_10_35_1","DOI":"10.1109\/TEVC.2022.3160196"},{"doi-asserted-by":"crossref","unstructured":"Z.Zhu D.Jin K.Yan T.\u2010Y.Ho X.Ye D.Guo C.\u2010H.Chao J.Xiao A.Yuille L.Lu inInt. Conf. on Medical Image Computing and Computer\u2010Assisted InterventionSpringer2020 pp.753\u2013762.","key":"e_1_2_10_36_1","DOI":"10.1007\/978-3-030-59728-3_73"},{"doi-asserted-by":"crossref","unstructured":"A.Grimwood H.McNair Y.Hu E.Bonmati D.Barratt E. J.Harris inInt. Conf. on Medical Image Computing and Computer\u2010Assisted InterventionSpringer2020 pp.544\u2013552.","key":"e_1_2_10_37_1","DOI":"10.1007\/978-3-030-59716-0_52"},{"doi-asserted-by":"publisher","key":"e_1_2_10_38_1","DOI":"10.1007\/s11548-021-02388-z"},{"doi-asserted-by":"publisher","key":"e_1_2_10_39_1","DOI":"10.1109\/JBHI.2020.3016699"},{"doi-asserted-by":"crossref","unstructured":"Z.Xu Y.Huo J.Park B.Landman A.Milkowski S.Grbic S.Zhou inMedical Image Computing and Computer Assisted Intervention\u2013MICCAI 2018: 21st Int. Conf. Granada Spain September 16\u201320 2018 Proceedings Part II 11 Springer2018 pp.711\u2013719.","key":"e_1_2_10_40_1","DOI":"10.1007\/978-3-030-00934-2_79"},{"doi-asserted-by":"publisher","key":"e_1_2_10_41_1","DOI":"10.1016\/j.eclinm.2020.100379"},{"doi-asserted-by":"publisher","key":"e_1_2_10_42_1","DOI":"10.1016\/j.media.2021.102150"},{"doi-asserted-by":"publisher","key":"e_1_2_10_43_1","DOI":"10.1007\/s11548-022-02800-2"},{"doi-asserted-by":"publisher","key":"e_1_2_10_44_1","DOI":"10.1109\/TMI.2021.3062902"},{"doi-asserted-by":"publisher","key":"e_1_2_10_45_1","DOI":"10.1109\/JBHI.2020.2973614"},{"unstructured":"J. D. M.\u2010W. C.Kenton L. K.Toutanova inProc. of NAACL\u2010HLT Minneapolis MN2019 1 2.","key":"e_1_2_10_46_1"},{"key":"e_1_2_10_47_1","first-page":"9","volume":"1","author":"Radford A.","year":"2019","journal-title":"OpenAI blog"},{"unstructured":"A.Kirillov E.Mintun N.Ravi H.Mao C.Rolland L.Gustafson T.Xiao S.Whitehead A. C.Berg W.\u2010Y.Lo P.Doll\u00e1r R.Girshick inProc. of the IEEE\/CVF Int. Conf. on Computer Vision2023 pp.4015\u20134026.","key":"e_1_2_10_48_1"},{"unstructured":"N.Ravi V.Gabeur Y.\u2010T.Hu R.Hu C.Ryali T.Ma H.Khedr R.R\u00e4dle C.Rolland L.Gustafson E.Mintun J.Pan K. V.Alwala N.Carion C.\u2010Y.Wu R.Girshick P.Doll\u00e1r C.Feichtenhofer(Preprint) arXiv:2408.00714 v1 Submitted: Aug.2024.","key":"e_1_2_10_49_1"},{"doi-asserted-by":"publisher","key":"e_1_2_10_50_1","DOI":"10.1109\/TMC.2024.3454634"},{"unstructured":"G.Wang L.Bai W. J.Nah J.Wang Z.Zhang Z.Chen J.Wu M.Islam H.Liu H.Ren(Preprint) arXiv:2405.10948 v1 Submitted: Mar.2024.","key":"e_1_2_10_51_1"},{"unstructured":"S.Chen Y.Ju H.Dalal Z.Zhu A.Khisti(Preprint) arXiv:2409.02346 v1 Submitted: Sep.2024.","key":"e_1_2_10_52_1"},{"unstructured":"K. P.Selvam R.Ramos\u2010Pollan F.Kalaitzis(Preprint) arXiv:2409.09907 v1 Submitted: Sep.2024.","key":"e_1_2_10_53_1"},{"unstructured":"F.Paischer L.Hauzenberger T.Schmied B.Alkin M. P.Deisenroth S.Hochreiter(Preprint) arXiv:2410.07170 v1 Submitted: \u00a02024.","key":"e_1_2_10_54_1"},{"doi-asserted-by":"publisher","key":"e_1_2_10_55_1","DOI":"10.1109\/TPAMI.2017.2699184"},{"key":"e_1_2_10_56_1","first-page":"1","volume":"21","author":"Raffel C.","year":"2020","journal-title":"J. Mach. Learning Res."},{"unstructured":"S.Mehta M.Rastegari(Preprint) arXiv:2110.02178 v1 Submitted: Oct.2021.","key":"e_1_2_10_57_1"},{"doi-asserted-by":"crossref","unstructured":"D.Ouyang S.He G.Zhang M.Luo H.Guo J.Zhan Z.Huang inICASSP 2023\u20102023 IEEE Int. Conf. on Acoustics Speech and Signal Processing (ICASSP) IEEE2023 pp.1\u20135.","key":"e_1_2_10_58_1","DOI":"10.1109\/ICASSP49357.2023.10096516"},{"unstructured":"K.Zhang D.Liu(Preprint) arXiv:2304.13785 v1 Submitted: Apr.2023.","key":"e_1_2_10_59_1"},{"unstructured":"Y.Zhou Z.Zhao H.Li S.Du J.Yao Y.Zhang Y.Wang(Preprint) arXiv:2406.09679 v1 Submitted: Jun.2024.","key":"e_1_2_10_60_1"},{"key":"e_1_2_10_61_1","first-page":"027836492312093","volume":"43","author":"Gao H.","year":"2023","journal-title":"Int. J. Rob. Res."},{"doi-asserted-by":"publisher","key":"e_1_2_10_62_1","DOI":"10.1016\/j.gie.2023.10.024"},{"doi-asserted-by":"publisher","key":"e_1_2_10_63_1","DOI":"10.1016\/j.inffus.2024.102602"},{"unstructured":"M.Allan A.Shvets T.Kurmann Z.Zhang R.Duggal Y.\u2010H.Su N.Rieke I.Laina N.Kalavakonda S.Bodenstedt L.Herrera W.Li V.Iglovikov H.Luo J.Yang D.Stoyanov L.Maier\u2010Hein S.Speidel M.Azizian(Preprint) arXiv:1902.06426 v1 Submitted: Feb.2019.","key":"e_1_2_10_64_1"},{"unstructured":"B.Lin Y.Zhang(Preprint) arXiv:2203.14338 v1 Submitted: Mar.2022.","key":"e_1_2_10_65_1"},{"doi-asserted-by":"crossref","unstructured":"K.He X.Zhang S.Ren J.Sun inProc. of the IEEE Conf. on Computer Vision and Pattern Recognition2016 pp.770\u2013778.","key":"e_1_2_10_66_1","DOI":"10.1109\/CVPR.2016.90"},{"doi-asserted-by":"crossref","unstructured":"J.Ma Z.Zhao X.Yi J.Chen L.Hong E. H.Chi inProc. of the 24th ACM SIGKDD Int. Conf. on Knowledge Discovery & Data Mining2018 pp.1930\u20131939.","key":"e_1_2_10_67_1","DOI":"10.1145\/3219819.3220007"},{"key":"e_1_2_10_68_1","first-page":"29335","volume":"34","author":"Hazimeh H.","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"unstructured":"H.Fernando H.Shen M.Liu S.Chaudhury K.Murugesan T.Chen inInt. Conf. on Learning Representations2023.","key":"e_1_2_10_69_1"},{"doi-asserted-by":"crossref","unstructured":"D.Senushkin N.Patakin A.Kuznetsov A.Konushin inProc. of the IEEE\/CVF Conf. on Computer Vision and Pattern Recognition2023 pp.20083\u201320093.","key":"e_1_2_10_70_1","DOI":"10.1109\/CVPR52729.2023.01923"},{"unstructured":"X.Lin X.Zhang Z.Yang F.Liu Z.Wang Q.Zhang(Preprint) arXiv:2402.19078 v1 Submitted: Feb.2024.","key":"e_1_2_10_71_1"},{"unstructured":"B.Lin W.Jiang F.Ye Y.Zhang P.Chen Y.\u2010C.Chen S.Liu J.Kwok(Preprint) arXiv:2308.12029 v1 Submitted: Aug.2023.","key":"e_1_2_10_72_1"},{"unstructured":"L.\u2010C.Chen G.Papandreou F.Schroff H.Adam(Preprint) arXiv:1706.05587 v1 Submitted: Jun.2017.","key":"e_1_2_10_73_1"}],"container-title":["Advanced Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202500288","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,13]],"date-time":"2025-12-13T06:03:24Z","timestamp":1765605804000},"score":1,"resource":{"primary":{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/10.1002\/aisy.202500288"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,29]]},"references-count":72,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["10.1002\/aisy.202500288"],"URL":"https:\/\/doi.org\/10.1002\/aisy.202500288","archive":["Portico"],"relation":{},"ISSN":["2640-4567","2640-4567"],"issn-type":[{"type":"print","value":"2640-4567"},{"type":"electronic","value":"2640-4567"}],"subject":[],"published":{"date-parts":[[2025,6,29]]},"assertion":[{"value":"2025-03-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-06-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e202500288"}}