{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T03:05:13Z","timestamp":1740107113623,"version":"3.37.3"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T00:00:00Z","timestamp":1716854400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T00:00:00Z","timestamp":1716854400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100015276","name":"Sabanc\u0131 University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100015276","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis Comput"],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Comic inpainting is essential for language localization and adapting comics into animations, involving the removal of speech boxes, textboxes, and sound effects while maintaining artistic integrity. This paper introduces an automated approach leveraging the Manga inpainting method by Xie et al., adapted for western comics like Tex Willer. Tex Willer comics, known for their fusion of Italian art and American Western imagery, pose unique challenges due to their distinct styles. Customized Manga Restoration and Structural Line Extraction codes are employed, along with automated mask generation using deep CNN-based speech balloon detection and segmentation. Our contributions include the development of a precise model tailored to Tex Willer Comics, resulting in visually coherent inpainting results. The paper follows a structured format, covering State-of-the-Art, methodology, results, and conclusions, aiming to streamline the process of western comic inpainting for professionals in the comics and animation industries.<\/jats:p>","DOI":"10.1007\/s00371-024-03440-0","type":"journal-article","created":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T14:01:42Z","timestamp":1716904902000},"page":"4585-4592","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Automated inpainting of Tex Willer comics: adapting manga techniques for western comic transformation"],"prefix":"10.1007","volume":"40","author":[{"given":"Ekin","family":"Marlali","sequence":"first","affiliation":[]},{"given":"Selim","family":"Balcisoy","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,5,28]]},"reference":[{"issue":"4","key":"3440_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3450626.3459822","volume":"40","author":"M Xie","year":"2021","unstructured":"Xie, M., Xia, M., Liu, X., Li, C., Wong, T.-T.: Seamless manga inpainting with semantics awareness. ACM Trans. Graph. 40(4), 1\u201311 (2021)","journal-title":"ACM Trans. Graph."},{"key":"3440_CR2","doi-asserted-by":"crossref","unstructured":"Xie, M., Xia, M., Wong, T.-T.: Exploiting aliasing for manga restoration. In 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2021)","DOI":"10.1109\/CVPR46437.2021.01320"},{"issue":"4","key":"3440_CR3","first-page":"1","volume":"36","author":"C Li","year":"2017","unstructured":"Li, C., Liu, X., Wong, T.-T.: Deep extraction of manga structural lines. ACM Trans. Graph. 36(4), 1\u201312 (2017)","journal-title":"ACM Trans. Graph."},{"key":"3440_CR4","doi-asserted-by":"crossref","unstructured":"Dubray, D., Laubrock, J.: Deep cnn-based speech balloon detection and segmentation for comic books. In 2019 International Conference on Document Analysis and Recognition (ICDAR), (2019)","DOI":"10.1109\/ICDAR.2019.00200"},{"key":"3440_CR5","doi-asserted-by":"crossref","unstructured":"S\u00fdkora, D., Buri\u00e1nek, J., \u017e\u00e1ra, J.: Unsupervised colorization of black-and-white cartoons. In Proceedings of the 3rd International Symposium on Non-photorealistic Animation and Rendering (2004)","DOI":"10.1145\/987657.987677"},{"key":"3440_CR6","doi-asserted-by":"crossref","unstructured":"Qu, Y., Wong, T.-T., Heng, P.-A.: Manga colorization. ACM SIGGRAPH 2006 Papers on - SIGGRAPH 06 (2006)","DOI":"10.1145\/1179352.1142017"},{"issue":"5","key":"3440_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1409060.1409108","volume":"27","author":"Y Qu","year":"2008","unstructured":"Qu, Y., Pang, W.-M., Wong, T.-T., Heng, P.-A.: Richness-preserving manga screening. ACM Trans. Graph. 27(5), 1\u20138 (2008)","journal-title":"ACM Trans. Graph."},{"key":"3440_CR8","unstructured":"Ito, K., Matsui, Y., Yamasaki, T., Aizawa, K.: Separation of manga line drawings and screentones (2015)"},{"key":"3440_CR9","doi-asserted-by":"crossref","unstructured":"Wu, H., Ma, Z., Wu, W., Liu, X., Li, C., Wen, Z.: Shading-guided manga screening from reference. IEEE Transactions on Visualization and Computer Graphics (2023)","DOI":"10.1109\/TVCG.2023.3282223"},{"issue":"6","key":"3440_CR10","first-page":"1","volume":"31","author":"J Kopf","year":"2012","unstructured":"Kopf, J., Lischinski, D.: Digital reconstruction of halftoned color comics. ACM Trans. Graph. 31(6), 1\u201310 (2012)","journal-title":"ACM Trans. Graph."},{"issue":"6","key":"3440_CR11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3414685.3417873","volume":"39","author":"M Xie","year":"2020","unstructured":"Xie, M., Li, C., Liu, X., Wong, T.-T.: Manga filling style conversion with screentone variational autoencoder. ACM Trans. Graph. 39(6), 1\u201315 (2020)","journal-title":"ACM Trans. Graph."},{"issue":"4","key":"3440_CR12","doi-asserted-by":"publisher","first-page":"618","DOI":"10.1109\/TVCG.2009.9","volume":"15","author":"S-H Zhang","year":"2009","unstructured":"Zhang, S.-H., Chen, T., Zhang, Y.-F., Hu, S.-M., Martin, R.R.: Vectorizing cartoon animations. IEEE Trans. Vis. Comput. Graph. 15(4), 618\u2013629 (2009)","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"3440_CR13","doi-asserted-by":"crossref","unstructured":"Ho, A.K.N., Burie, J.-C., Ogier, J.-M.: Panel and speech balloon extraction from comic books. In: 2012 10th IAPR International Workshop on Document Analysis Systems (2012)","DOI":"10.1109\/DAS.2012.66"},{"issue":"6","key":"3440_CR14","first-page":"1","volume":"31","author":"L Xu","year":"2012","unstructured":"Xu, L., Yan, Q., Xia, Y., Jia, J.: Structure extraction from texture via relative total variation. ACM Trans. Graph. 31(6), 1\u201310 (2012)","journal-title":"ACM Trans. Graph."},{"issue":"20","key":"3440_CR15","doi-asserted-by":"publisher","first-page":"21811","DOI":"10.1007\/s11042-016-4020-z","volume":"76","author":"Y Matsui","year":"2017","unstructured":"Matsui, Y., Ito, K., Aramaki, Y., Fujimoto, A., Ogawa, T., Yamasaki, T., Aizawa, K.: Sketch-based manga retrieval using manga109 dataset. Multimed. Tools Appl. 76(20), 21811\u201321838 (2017)","journal-title":"Multimed. Tools Appl."},{"issue":"2","key":"3440_CR16","doi-asserted-by":"publisher","first-page":"1070","DOI":"10.1109\/TVCG.2016.2525774","volume":"23","author":"C-Y Yao","year":"2017","unstructured":"Yao, C.-Y., Hung, S.-H., Li, G.-W., Chen, I.-Y., Adhitya, R., Lai, Y.-C.: Manga vectorization and manipulation with procedural simple screentone. IEEE Trans. Vis. Comput. Graph. 23(2), 1070\u20131084 (2017)","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"issue":"1","key":"3440_CR17","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1007\/s41095-016-0069-x","volume":"3","author":"X Liu","year":"2017","unstructured":"Liu, X., Li, C., Wong, T.-T.: Boundary-aware texture region segmentation from manga. Comput. Vis. Med. 3(1), 61\u201371 (2017)","journal-title":"Comput. Vis. Med."},{"key":"3440_CR18","unstructured":"Xie, M., Li, C., Wong, T.-T.: Manga Rescreening with Interpretable Screentone Representation (2023)"},{"key":"3440_CR19","doi-asserted-by":"crossref","unstructured":"Rigaud, C., Burie, J.-C., Ogier, J.-M., Karatzas, D., Van De\u00a0Weijer, J.: An active contour model for speech balloon detection in comics. In 2013 12th International Conference on Document Analysis and Recognition (2013)","DOI":"10.1109\/ICDAR.2013.251"},{"issue":"1","key":"3440_CR20","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1007\/s41095-015-0007-3","volume":"1","author":"X Mao","year":"2015","unstructured":"Mao, X., Liu, X., Wong, T.-T., Xu, X.: Region-based structure line detection for cartoons. Comput. Vis. Med. 1(1), 69\u201378 (2015)","journal-title":"Comput. Vis. Med."},{"key":"3440_CR21","doi-asserted-by":"crossref","unstructured":"Nguyen, N.-V., Rigaud, C., Burie, J.-C.: Comic characters detection using deep learning. In 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), (2017)","DOI":"10.1109\/ICDAR.2017.290"},{"key":"3440_CR22","doi-asserted-by":"crossref","unstructured":"Chu, W.-T., Li, W.-W.: Manga facenet: face detection in manga based on deep neural network. In Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval, (2017)","DOI":"10.1145\/3078971.3079031"},{"key":"3440_CR23","unstructured":"Ogawa, T., Otsubo, A., Narita, R., Matsui, Y., Yamasaki, T., Aizawa, K.: Object Detection for Comics using Manga109 Annotations (2018)"},{"key":"3440_CR24","doi-asserted-by":"crossref","unstructured":"Sasaki, K., Iizuka, S., Simo-Serra, E., Ishikawa, H.: Joint gap detection and inpainting of line drawings. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2017)","DOI":"10.1109\/CVPR.2017.611"},{"key":"3440_CR25","doi-asserted-by":"crossref","unstructured":"Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., Huang, T.S.: Generative image inpainting with contextual attention. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (2018)","DOI":"10.1109\/CVPR.2018.00577"},{"key":"3440_CR26","doi-asserted-by":"crossref","unstructured":"Zeng, Y., Fu, J., Chao, H., Guo, B.: Learning pyramid-context encoder network for high-quality image inpainting. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (2019)","DOI":"10.1109\/CVPR.2019.00158"},{"key":"3440_CR27","unstructured":"Nazeri, K., Ng, E., Joseph, T., Qureshi, F.Z., Ebrahimi, M.: EdgeConnect: generative image inpainting with adversarial edge learning (2019)"},{"key":"3440_CR28","doi-asserted-by":"crossref","unstructured":"Liu, G., Reda, F.A., Shih, K.J., Wang, T.-C., Tao, A., Catanzaro, B.: Image inpainting for irregular holes using partial convolutions. In Proceedings of the European Conference on Computer Vision (ECCV), (2018)","DOI":"10.1007\/978-3-030-01252-6_6"},{"key":"3440_CR29","doi-asserted-by":"crossref","unstructured":"Tsubota, K., Ikami, D., Aizawa, K.: Synthesis of screentone patterns of manga characters. In: 2019 IEEE International Symposium on Multimedia (ISM), (2019)","DOI":"10.1109\/ISM46123.2019.00046"},{"key":"3440_CR30","doi-asserted-by":"crossref","unstructured":"Ren, Y., Yu, X., Zhang, R., Li, T.H., Liu, S., Li, G.: Structureflow: image inpainting via structure-aware appearance flow. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), (2019)","DOI":"10.1109\/ICCV.2019.00027"},{"key":"3440_CR31","doi-asserted-by":"crossref","unstructured":"Ono, N., Aizawa, K., Matsui, Y.: Comic image inpainting via distance transform. SIGGRAPH Asia 2021 Technical Communications (2021)","DOI":"10.1145\/3478512.3488607"},{"key":"3440_CR32","doi-asserted-by":"crossref","unstructured":"Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: Patchmatch: A randomized correspondence algorithm for structural image editing. Seminal Graphics Papers: Pushing the Boundaries, vol. 2 (2009)","DOI":"10.1145\/1576246.1531330"},{"key":"3440_CR33","unstructured":"Tex Willer 001 - La Mano Rossa. (2021) https:\/\/archive.org\/details\/tex-willer-001-la-mano-rossa\/. Internet Archive"}],"container-title":["The Visual Computer"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-024-03440-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00371-024-03440-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-024-03440-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,4]],"date-time":"2024-07-04T15:13:14Z","timestamp":1720105994000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00371-024-03440-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,28]]},"references-count":33,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["3440"],"URL":"https:\/\/doi.org\/10.1007\/s00371-024-03440-0","relation":{},"ISSN":["0178-2789","1432-2315"],"issn-type":[{"type":"print","value":"0178-2789"},{"type":"electronic","value":"1432-2315"}],"subject":[],"published":{"date-parts":[[2024,5,28]]},"assertion":[{"value":"29 April 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 May 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}