{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T18:22:27Z","timestamp":1778955747163,"version":"3.51.4"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2025,7,2]],"date-time":"2025-07-02T00:00:00Z","timestamp":1751414400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,2]],"date-time":"2025-07-02T00:00:00Z","timestamp":1751414400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005950","name":"Hong Kong University of Science and Technology","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005950","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis Comput"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>A graphic design image can be considered as an arrangement of design elements filled with specific colors according to certain layout rules. This study focuses on developing an automatic pipeline to identify and extract core design elements from any <jats:italic>unknown<\/jats:italic> input design images, and it also converts the extracted design elements to a neat vector format with a new optimization algorithm. More specifically, an unsupervised learning technique is applied for core design element extraction to address the problem of no available dataset on labeled designs. Next, a novel design element vectorization method is proposed based on color features. Extensive experiments have demonstrated the effectiveness of the proposed method on design image processing. The proposed method can process, namely extract and vectorize, core design elements of an <jats:italic>unknown<\/jats:italic> image within around 29\u00a0s. The output vector graphics of design elements have very compact format, compared to other commercial software, and are optimized for reuse and re-editing. Source code and demonstration of the proposed pipeline can be found at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/ZoeQU\/Recycling-Upcycling-Graphic-Design-Automatic-Design-Elements-Extraction-and-Vectorization\" ext-link-type=\"uri\">https:\/\/github.com\/ZoeQU\/Recycling-Upcycling-Graphic-Design-Automatic-Design-Elements-Extraction-and-Vectorization<\/jats:ext-link>.<\/jats:p>","DOI":"10.1007\/s00371-025-04039-9","type":"journal-article","created":{"date-parts":[[2025,7,2]],"date-time":"2025-07-02T15:22:34Z","timestamp":1751469754000},"page":"10317-10331","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Recycling\/upcycling graphic design: automatic design elements extraction and vectorization"],"prefix":"10.1007","volume":"41","author":[{"given":"Hong","family":"Qu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"K. P.","family":"Chau","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"P. Y.","family":"Mok","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,7,2]]},"reference":[{"key":"4039_CR1","unstructured":"Li, J., Yang, J., Hertzmann, A., Zhang, J., Xu, T.: LayoutGAN: Generating graphic layouts with wireframe discriminator. In: International Conference on Learning Representations (2019)"},{"key":"4039_CR2","doi-asserted-by":"crossref","unstructured":"Ambrose, G., Harris, P., Ball, N.: The Fundamentals of Graphic Design, (2019)","DOI":"10.5040\/9781474270304"},{"key":"4039_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2021.103826","volume":"130","author":"G Demir","year":"2021","unstructured":"Demir, G., \u00c7ekmi\u015f, A., Ye\u015filkaynak, V.B., Unal, G.: Detecting visual design principles in art and architecture through deep convolutional neural networks. Autom. Constr. 130, 103826 (2021)","journal-title":"Autom. Constr."},{"issue":"4","key":"4039_CR4","first-page":"1","volume":"35","author":"P Guerrero","year":"2016","unstructured":"Guerrero, P., Bernstein, G., Li, W., Mitra, N.J.: PATEX: exploring pattern variations. ACM Trans. Gr. 35(4), 1\u201313 (2016)","journal-title":"ACM Trans. Gr."},{"issue":"12","key":"4039_CR5","doi-asserted-by":"publisher","first-page":"1069","DOI":"10.1016\/j.cad.2010.07.002","volume":"42","author":"J Bai","year":"2010","unstructured":"Bai, J., Gao, S., Tang, W., Liu, Y., Guo, S.: Design reuse oriented partial retrieval of cad models. Comput. Aided Des. 42(12), 1069\u20131084 (2010)","journal-title":"Comput. Aided Des."},{"key":"4039_CR6","unstructured":"Fletcher, D., Gu, P.: Adaptable design for design reuse. Proceedings of the Canadian Engineering Education Association (2005)"},{"issue":"6","key":"4039_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3130800.3130888","volume":"36","author":"J-D Favreau","year":"2017","unstructured":"Favreau, J.-D., Lafarge, F., Bousseau, A.: Photo2clipart: image abstraction and vectorization using layered linear gradients. ACM Trans. Gr. 36(6), 1\u201311 (2017)","journal-title":"ACM Trans. Gr."},{"issue":"1","key":"4039_CR8","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1007\/s00371-011-0597-4","volume":"28","author":"S Bergen","year":"2012","unstructured":"Bergen, S., Ross, B.J.: Automatic and interactive evolution of vector graphics images with genetic algorithms. Vis. Comput. 28(1), 35\u201345 (2012)","journal-title":"Vis. Comput."},{"key":"4039_CR9","doi-asserted-by":"crossref","unstructured":"Lu, S., Jiang, W., Ding, X., Kaplan, C.S., Jin, X., Gao, F., Chen, J.: Depth-aware image vectorization and editing. The Visual Computer (2019)","DOI":"10.1007\/s00371-019-01671-0"},{"issue":"4","key":"4039_CR10","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1145\/3386569.3392401","volume":"39","author":"EA Dominici","year":"2020","unstructured":"Dominici, E.A., Schertler, N., Griffin, J., Hoshyari, S., Sigal, L., Sheffer, A.: Polyfit: Perception-aligned vectorization of raster clip-art via intermediate polygonal fitting. ACM Trans. Gr. 39(4), 77 (2020)","journal-title":"ACM Trans. Gr."},{"key":"4039_CR11","doi-asserted-by":"crossref","unstructured":"Inglis, T., Kaplan, C.S.: Pixelating vector line art. SIGGRAPH Posters 108 (2012)","DOI":"10.1145\/2342896.2343021"},{"issue":"2","key":"4039_CR12","doi-asserted-by":"publisher","first-page":"1063","DOI":"10.1109\/TVCG.2015.2440273","volume":"22","author":"M Yang","year":"2015","unstructured":"Yang, M., Chao, H., Zhang, C., Guo, J., Yuan, L., Sun, J.: Effective clipart image vectorization through direct optimization of bezigons. IEEE Trans. Vis. Comput. Graphics 22(2), 1063\u20131075 (2015)","journal-title":"IEEE Trans. Vis. Comput. Graphics"},{"key":"4039_CR13","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/7068349","author":"A Voulodimos","year":"2018","unstructured":"Voulodimos, A., Doulamis, N., Doulamis, A., Protopapadakis, E.: Deep learning for computer vision: a brief review. Comput. Intell. Neurosci. (2018). https:\/\/doi.org\/10.1155\/2018\/7068349","journal-title":"Comput. Intell. Neurosci."},{"issue":"4","key":"4039_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1778765.1778820","volume":"29","author":"M-M Cheng","year":"2010","unstructured":"Cheng, M.-M., Zhang, F.-L., Mitra, N.J., Huang, X., Hu, S.-M.: Repfinder: finding approximately repeated scene elements for image editing. ACM Trans. Gr. 29(4), 1\u20138 (2010)","journal-title":"ACM Trans. Gr."},{"key":"4039_CR15","doi-asserted-by":"crossref","unstructured":"Yang, H., Zhang, Y.: A context- and level-aware feature pyramid network for object detection with attention mechanism. The Visual Computer (2023)","DOI":"10.1007\/s00371-022-02758-x"},{"key":"4039_CR16","doi-asserted-by":"crossref","unstructured":"Zou, Z., Chen, K., Shi, Z., Guo, Y., Ye, J.: Object detection in 20 years: A survey. Proceedings of the IEEE (2023)","DOI":"10.1109\/JPROC.2023.3238524"},{"key":"4039_CR17","doi-asserted-by":"publisher","first-page":"1221","DOI":"10.1007\/s00371-020-01995-2","volume":"37","author":"L Huang","year":"2021","unstructured":"Huang, L., Wang, Y., Bai, T.: Recognizing art work image from natural type: a deep adaptive depiction fusion method. Vis. Comput. 37, 1221\u20131232 (2021)","journal-title":"Vis. Comput."},{"key":"4039_CR18","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1023\/B:VISI.0000022288.19776.77","volume":"59","author":"PF Felzenszwalb","year":"2004","unstructured":"Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. Int. J. Comput. Vision 59, 167\u2013181 (2004)","journal-title":"Int. J. Comput. Vision"},{"issue":"5","key":"4039_CR19","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1109\/34.1000236","volume":"24","author":"D Comaniciu","year":"2002","unstructured":"Comaniciu, D., Meer, P.: Mean shift: A robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603\u2013619 (2002)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"issue":"4","key":"4039_CR20","doi-asserted-by":"publisher","first-page":"618","DOI":"10.1109\/TVCG.2009.9","volume":"15","author":"S-H Zhang","year":"2009","unstructured":"Zhang, S.-H., Chen, T., Zhang, Y.-F., Hu, S.-M., Martin, R.R.: Vectorizing cartoon animations. IEEE Trans. Vis. Comput. Gr. 15(4), 618\u2013629 (2009)","journal-title":"IEEE Trans. Vis. Comput. Gr."},{"key":"4039_CR21","doi-asserted-by":"crossref","unstructured":"Kanezaki, A.: Unsupervised image segmentation by backpropagation. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1543\u20131547 (2018)","DOI":"10.1109\/ICASSP.2018.8462533"},{"key":"4039_CR22","doi-asserted-by":"publisher","first-page":"8055","DOI":"10.1109\/TIP.2020.3011269","volume":"29","author":"W Kim","year":"2020","unstructured":"Kim, W., Kanezaki, A., Tanaka, M.: Unsupervised learning of image segmentation based on differentiable feature clustering. IEEE Trans. Image Process. 29, 8055\u20138068 (2020)","journal-title":"IEEE Trans. Image Process."},{"key":"4039_CR23","doi-asserted-by":"publisher","unstructured":"Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp. 1150\u20131157. IEEE, Kerkyra, Greece (1999). https:\/\/doi.org\/10.1109\/ICCV.1999.790410","DOI":"10.1109\/ICCV.1999.790410"},{"key":"4039_CR24","doi-asserted-by":"crossref","unstructured":"Shimoda, W., Yanai, K.: Learning food image similarity for food image retrieval. In: IEEE International Conference on Multimedia Big Data, pp. 165\u2013168 (2017)","DOI":"10.1109\/BigMM.2017.73"},{"key":"4039_CR25","unstructured":"Appalaraju, S., Chaoji, V.: Image similarity using deep cnn and curriculum learning. (2017)arXiv preprint arXiv:1709.08761"},{"issue":"11","key":"4039_CR26","doi-asserted-by":"publisher","first-page":"3452","DOI":"10.1109\/TIP.2006.881948","volume":"15","author":"V Monga","year":"2006","unstructured":"Monga, V., Evans, B.L.: Perceptual image hashing via feature points: performance evaluation and tradeoffs. IEEE Trans. Image Process. 15(11), 3452\u20133465 (2006)","journal-title":"IEEE Trans. Image Process."},{"key":"4039_CR27","doi-asserted-by":"publisher","first-page":"571","DOI":"10.5194\/isprs-archives-XLII-2-W15-571-2019","volume":"42","author":"W Hua","year":"2019","unstructured":"Hua, W., Hou, M., Yang, S., Dong, Y.: Discrimination of cultural relics similarity based on phash algorithm and sift operator. Int. Arch. Photogramm. Remote Sens. Spat. Inform. Sci. 42, 571\u2013575 (2019)","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inform. Sci."},{"key":"4039_CR28","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1016\/j.jpdc.2021.02.022","volume":"152","author":"R Kumar","year":"2021","unstructured":"Kumar, R., Tripathi, R., Marchang, N., Srivastava, G., Gadekallu, T.R., Xiong, N.N.: A secured distributed detection system based on ipfs and blockchain for industrial image and video data security. J. Parall. Distrib. Comput. 152, 128\u2013143 (2021)","journal-title":"J. Parall. Distrib. Comput."},{"key":"4039_CR29","doi-asserted-by":"crossref","unstructured":"Zannettou, S., Caulfield, T., Blackburn, J., De\u00a0Cristofaro, E., Sirivianos, M., Stringhini, G., Suarez-Tangil, G.: On the origins of memes by means of fringe web communities. In: Proceedings of the ACM Internet Measurement Conference, pp. 188\u2013202 (2018)","DOI":"10.1145\/3278532.3278550"},{"issue":"3","key":"4039_CR30","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1007\/s41095-020-0182-8","volume":"6","author":"A Wang","year":"2020","unstructured":"Wang, A., He, C., Hou, F., Cai, Z., Zhao, G.: Designing planar cubic b-spline curves with monotonic curvature for curve interpolation. Comput. Vis. Med. 6(3), 349\u2013354 (2020)","journal-title":"Comput. Vis. Med."},{"key":"4039_CR31","unstructured":"Adobe: Adobe illustrator: Image trace. http:\/\/www.adobe.com\/ (2022)"},{"key":"4039_CR32","doi-asserted-by":"crossref","unstructured":"Reddy, P., Gharbi, M., Lukac, M., Mitra, N.J.: Im2vec: Synthesizing vector graphics without vector supervision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7342\u20137351 (2021)","DOI":"10.1109\/CVPR46437.2021.00726"},{"key":"4039_CR33","doi-asserted-by":"crossref","unstructured":"Lopes, R.G., Ha, D., Eck, D., Shlens, J.: A learned representation for scalable vector graphics. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 7930\u20137939 (2019)","DOI":"10.1109\/ICCV.2019.00802"},{"key":"4039_CR34","unstructured":"Inkscape: Inkscape Project. https:\/\/inkscape.org\/ (2020)"},{"key":"4039_CR35","doi-asserted-by":"crossref","unstructured":"Kerautret, B., Lachaud, J.-O.: Geometric total variation for image vectorization, zooming and pixel art depixelizing. In: Pattern Recognition, pp. 391\u2013405 (2020)","DOI":"10.1007\/978-3-030-41404-7_28"},{"issue":"4","key":"4039_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3197517.3201312","volume":"37","author":"S Hoshyari","year":"2018","unstructured":"Hoshyari, S., Dominici, E.A., Sheffer, A., Carr, N., Wang, Z., Ceylan, D., Shen, I.-C.: Perception-driven semi-structured boundary vectorization. ACM Trans. Gr. 37(4), 1\u201314 (2018)","journal-title":"ACM Trans. Gr."},{"key":"4039_CR37","unstructured":"Glorot, X., Bengio, Y.: Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the International Conference on Artificial Intelligence and Statistics, pp. 249\u2013256 (2010)"},{"key":"4039_CR38","unstructured":"Selinger, P.: Potrace: a polygon-based tracing algorithm (2003)"},{"issue":"8","key":"4039_CR39","doi-asserted-by":"publisher","first-page":"1467","DOI":"10.1109\/JPROC.2010.2050290","volume":"98","author":"A Torralba","year":"2010","unstructured":"Torralba, A., Russell, B.C., Yuen, J.: Labelme: Online image annotation and applications. Proc. IEEE 98(8), 1467\u20131484 (2010)","journal-title":"Proc. IEEE"},{"key":"4039_CR40","unstructured":"Godi, M., Joppi, C., Giachetti, A., Pellacini, F., Cristani, M.: Texel-att: Representing and classifying element-based textures by attributes. (2019) arXiv preprint arXiv:1908.11127"},{"issue":"11","key":"4039_CR41","doi-asserted-by":"publisher","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","volume":"34","author":"R Achanta","year":"2012","unstructured":"Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., S\u00fcsstrunk, S.: Slic superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274\u20132282 (2012)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"4039_CR42","unstructured":"VectorMagic: Vector Magic. https:\/\/vectormagic.com\/ (2021)"},{"key":"4039_CR43","unstructured":"Kozea: CairoSVG. https:\/\/github.com\/Kozea\/CairoSVG\/ (2023)"}],"container-title":["The Visual Computer"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-025-04039-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00371-025-04039-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00371-025-04039-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,15]],"date-time":"2025-09-15T09:37:01Z","timestamp":1757929021000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00371-025-04039-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,2]]},"references-count":43,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["4039"],"URL":"https:\/\/doi.org\/10.1007\/s00371-025-04039-9","relation":{},"ISSN":["0178-2789","1432-2315"],"issn-type":[{"value":"0178-2789","type":"print"},{"value":"1432-2315","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,2]]},"assertion":[{"value":"29 May 2025","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 July 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflict of interest to declare that is relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}