{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:28:16Z","timestamp":1740122896211,"version":"3.37.3"},"reference-count":20,"publisher":"Springer Science and Business Media LLC","issue":"17","license":[{"start":{"date-parts":[[2023,11,4]],"date-time":"2023-11-04T00:00:00Z","timestamp":1699056000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,4]],"date-time":"2023-11-04T00:00:00Z","timestamp":1699056000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001769","name":"Charles Sturt University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001769","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The aim of this research is to propose an extended mean value cloning algorithm with automatic trimap generation and accurate alpha matting. This implementation improves the visualization accuracy of the merged video by reducing the discolored and smudging artefacts of the remote surgeon\u2019s boundary. It also makes the merge robust for the illumination changes by taking less processing time in real time surgery. The proposed system uses automatic trimap generation from the source video for accurate foreground extraction. Extended mean value cloning with gradient mixing is then applied for the cloning with optimized alpha matting for accurate and realistic video composition. The proposed system improved the visualization accuracy by providing almost 99.7% visibility of the pixels compared to the state-of-the-art solution, which provides 99.1% visibility of pixels. The overlay error was reduced from 0.93\u00a0mm to 0.63\u00a0mm. The processing time was also reduced. The proposed solution processed 8 frames per second, which is less time than the state-of-the-art solution, which processed 5 frames per second. The extended mean value cloning smooths the differences that presented in the target and source frames for seamless and realistic blending of pixels. The automatic trimap generation reduced the risk of false foreground selection and the generated optimal trimaps improved the alpha matte quality, which is optimized to reduce the smudging artefacts completely and to produce accurate visualization of the final merged image.<\/jats:p>","DOI":"10.1007\/s11042-023-17331-4","type":"journal-article","created":{"date-parts":[[2023,11,4]],"date-time":"2023-11-04T07:02:53Z","timestamp":1699081373000},"page":"49845-49874","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Mixed reality in surgical telepresence: a novel extended mean value cloning with automatic trimap generation and accurate alpha matting for visualization"],"prefix":"10.1007","volume":"83","author":[{"given":"Roshan","family":"Dallakoti","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2309-3540","authenticated-orcid":false,"given":"Abeer","family":"Alsadoon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"P. W. C.","family":"Prasad","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sarmad","family":"Al Aloussi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tarik A.","family":"Rashid","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Omar Hisham","family":"Alsadoon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ahmad","family":"Alrubaie","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sami","family":"Haddad","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,11,4]]},"reference":[{"key":"17331_CR1","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1016\/j.cmpb.2019.05.025","volume":"177","author":"HS Venkata","year":"2019","unstructured":"Venkata HS et al (2019) A novel mixed reality in breast and constructive jaw surgical tele-presence. Comput Methods Programs Biomed 177:253\u2013268","journal-title":"Comput Methods Programs Biomed"},{"key":"17331_CR2","doi-asserted-by":"crossref","unstructured":"Wang J, Sheng B, Li P, Jin Y, Feng DD (2019) Illumination-guided video composition via gradient consistency optimization. IEEE Trans Image Process","DOI":"10.1109\/TIP.2019.2916769"},{"key":"17331_CR3","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1016\/j.eswa.2019.05.019","volume":"133","author":"C Henry","year":"2019","unstructured":"Henry C, Lee S-W (2019) Automatic trimap generation and artifact reduction in alpha matte using unknown region detection. Expert Syst Appl 133:242\u2013259","journal-title":"Expert Syst Appl"},{"key":"17331_CR4","doi-asserted-by":"publisher","first-page":"19332","DOI":"10.1109\/ACCESS.2019.2896084","volume":"7","author":"J Li","year":"2019","unstructured":"Li J, Yuan G, Fan H (2019) Generating trimap for image matting using color co-fusion. IEEE Access 7:19332\u201319354","journal-title":"IEEE Access"},{"key":"17331_CR5","unstructured":"S Yehu, W Lei, X Qiming, P Zhenyun, W Qicong (2015) A simple real-time image cloning algorithm based on modified mean-value coordinates, presented at the 2015 International Conference on Control, Automation and Information Sciences (ICCAIS)"},{"issue":"1","key":"17331_CR6","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1007\/s12293-018-0275-4","volume":"11","author":"Z-Q Cai","year":"2019","unstructured":"Cai Z-Q, Lv L, Huang H, Liang Y-H (2019) A discrete bio-inspired metaheuristic algorithm for efficient and accurate image matting. Memet Comput 11(1):53\u201364","journal-title":"Memet Comput"},{"issue":"8","key":"17331_CR7","doi-asserted-by":"publisher","first-page":"1504","DOI":"10.1109\/TPAMI.2016.2606397","volume":"39","author":"C Donghyeon","year":"2017","unstructured":"Donghyeon C, Sunyeong K, Yu-Wing T, In So K (2017) Automatic trimap generation and consistent matting for light-field images. IEEE Trans Pattern Anal Mach Intell 39(8):1504\u20131517","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"2","key":"17331_CR8","first-page":"436","volume":"41","author":"P Pawin","year":"2019","unstructured":"Pawin P, Jakkrit D, Toshiaki K, Itthisek N (2019) A real-time hand segmentation method using background subtraction and color information. Songklanakarin J Sci Technol (SJST) 41(2):436\u2013444","journal-title":"Songklanakarin J Sci Technol (SJST)"},{"issue":"3","key":"17331_CR9","doi-asserted-by":"publisher","first-page":"806","DOI":"10.1016\/j.dsp.2009.10.008","volume":"20","author":"JM Chaves-Gonz\u00e1lez","year":"2010","unstructured":"Chaves-Gonz\u00e1lez JM, Vega-Rodr\u00edguez MA, G\u00f3mez-Pulido JA, S\u00e1nchez-P\u00e9rez JM (2010) Detecting skin in face recognition systems: A colour spaces study. Digit Signal Process 20(3):806\u2013823","journal-title":"Digit Signal Process"},{"issue":"9","key":"17331_CR10","doi-asserted-by":"publisher","first-page":"1896","DOI":"10.1109\/TMM.2016.2576283","volume":"18","author":"KR Jerripothula","year":"2016","unstructured":"Jerripothula KR, Cai J, Yuan J (2016) Image co-segmentation via saliency co-fusion. IEEE Trans Multimedia 18(9):1896\u20131909","journal-title":"IEEE Trans Multimedia"},{"issue":"7","key":"17331_CR11","doi-asserted-by":"publisher","first-page":"2532","DOI":"10.1109\/TIP.2013.2251642","volume":"22","author":"T Chen","year":"2013","unstructured":"Chen T, Zhu JY, Shamir A, Hu SM (2013) Motion-aware gradient domain video composition. IEEE Trans Image Process 22(7):2532\u20132544","journal-title":"IEEE Trans Image Process"},{"issue":"18","key":"17331_CR12","doi-asserted-by":"publisher","first-page":"24477","DOI":"10.1007\/s11042-018-5737-7","volume":"77","author":"Q Hu","year":"2018","unstructured":"Hu Q, Sun H, Li P, Shen R, Sheng B (2018) Illumination-aware live videos background replacement using antialiasing optimization. Multimedia Tools Appl 77(18):24477\u201324497","journal-title":"Multimedia Tools Appl"},{"issue":"2","key":"17331_CR13","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1111\/j.1467-8659.2009.01627.x","volume":"29","author":"ESL Gastal","year":"2010","unstructured":"Gastal ESL, Oliveira MM (2010) Shared sampling for real-time alpha matting. Computer Graphics Forum 29(2):575\u2013584","journal-title":"Computer Graphics Forum"},{"issue":"5\u20138","key":"17331_CR14","doi-asserted-by":"publisher","first-page":"1339","DOI":"10.1007\/s00170-018-03237-1","volume":"102","author":"P Wang","year":"2019","unstructured":"Wang P et al (2019) 2.5DHANDS: a gesture-based MR remote collaborative platform. Int J Adv Manuf Technol 102(5\u20138):1339\u20131353","journal-title":"Int J Adv Manuf Technol"},{"key":"17331_CR15","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/j.future.2017.12.055","volume":"82","author":"D Anton","year":"2018","unstructured":"Anton D, Kurillo G, Bajcsy R (2018) User experience and interaction performance in 2D\/3D telecollaboration. Futur Gener Comput Syst 82:77\u201388","journal-title":"Futur Gener Comput Syst"},{"issue":"4","key":"17331_CR16","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1007\/s10006-018-0719-5","volume":"22","author":"BR Basnet","year":"2018","unstructured":"Basnet BR, Alsadoon A, Withana C, Deva A, Paul M (2018) A novel noise filtered and occlusion removal: navigational accuracy in augmented reality-based constructive jaw surgery. Oral Maxillofac Surg 22(4):385\u2013401","journal-title":"Oral Maxillofac Surg"},{"issue":"7","key":"17331_CR17","doi-asserted-by":"publisher","first-page":"1409","DOI":"10.1109\/TPAMI.2011.239","volume":"34","author":"Z Kalal","year":"2012","unstructured":"Kalal Z, Mikolajczyk K, Matas J (2012) Tracking-Learning-Detection. IEEE Trans Pattern Anal Mach Intell 34(7):1409\u20131422","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"11","key":"17331_CR18","doi-asserted-by":"publisher","first-page":"1717","DOI":"10.1007\/s11548-018-1825-4","volume":"13","author":"J Hettig","year":"2018","unstructured":"Hettig J, Engelhardt S, Hansen C, Mistelbauer G (2018) AR in VR: assessing surgical augmented reality visualizations in a steerable virtual reality environment. Int J Comput Assist Radiol Surg 13(11):1717\u20131725","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"17331_CR19","doi-asserted-by":"crossref","unstructured":"Perkins SL, Lin MA, Srinivasan S, Wheeler AJ, Hargreaves BA, Daniel BL (2017) A mixed-reality system for breast surgical planning, presented at the 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)","DOI":"10.1109\/ISMAR-Adjunct.2017.92"},{"issue":"6\u20138","key":"17331_CR20","doi-asserted-by":"publisher","first-page":"1123","DOI":"10.1007\/s00371-010-0466-6","volume":"26","author":"Z-F Xie","year":"2010","unstructured":"Xie Z-F, Shen Y, Ma L-Z, Chen Z-H (2010) Seamless video composition using optimized mean-value cloning. Vis Comput 26(6\u20138):1123\u20131134","journal-title":"Vis Comput"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-17331-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-023-17331-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-17331-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T07:12:16Z","timestamp":1715757136000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-023-17331-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,4]]},"references-count":20,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["17331"],"URL":"https:\/\/doi.org\/10.1007\/s11042-023-17331-4","relation":{},"ISSN":["1573-7721"],"issn-type":[{"type":"electronic","value":"1573-7721"}],"subject":[],"published":{"date-parts":[[2023,11,4]]},"assertion":[{"value":"25 January 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 December 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 September 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 November 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"There is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interests"}}]}}