{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T18:47:20Z","timestamp":1787165240417,"version":"build-2736575974"},"reference-count":36,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2023,6,14]],"date-time":"2023-06-14T00:00:00Z","timestamp":1686700800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Korean Government (MOTIE)","award":["P0008473"],"award-info":[{"award-number":["P0008473"]}]},{"name":"BK21FOUR","award":["P0008473"],"award-info":[{"award-number":["P0008473"]}]},{"name":"Creative Human Resource Education","award":["P0008473"],"award-info":[{"award-number":["P0008473"]}]},{"name":"ICT Convergence","award":["P0008473"],"award-info":[{"award-number":["P0008473"]}]},{"name":"Korea Institute for Advancement of Technology (KIAT)","award":["P0008473"],"award-info":[{"award-number":["P0008473"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In recent years, the field of robotic portrait drawing has garnered considerable interest, as evidenced by the growing number of researchers focusing on either the speed or quality of the output drawing. However, the pursuit of either speed or quality alone has resulted in a trade-off between the two objectives. Therefore, in this paper, we propose a new approach that combines both objectives by leveraging advanced machine learning techniques and a variable line width Chinese calligraphy pen. Our proposed system emulates the human drawing process, which entails planning the sketch and creating it on the canvas, thus providing a realistic and high-quality output. One of the main challenges in portrait drawing is preserving the facial features, such as the eyes, mouth, nose, and hair, which are crucial for capturing the essence of a person. To overcome this challenge, we employ CycleGAN, a powerful technique that retains important facial details while transferring the visualized sketch onto the canvas. Moreover, we introduce the Drawing Motion Generation and Robot Motion Control Modules to transfer the visualized sketch onto a physical canvas. These modules enable our system to create high-quality portraits within seconds, surpassing existing methods in terms of both time efficiency and detail quality. Our proposed system was evaluated through extensive real-life experiments and showcased at the RoboWorld 2022 exhibition. During the exhibition, our system drew portraits of more than 40 visitors, yielding a survey outcome with a satisfaction rate of 95%. This result indicates the effectiveness of our approach in creating high-quality portraits that are not only visually pleasing but also accurate.<\/jats:p>","DOI":"10.3390\/s23125589","type":"journal-article","created":{"date-parts":[[2023,6,15]],"date-time":"2023-06-15T02:28:56Z","timestamp":1686796136000},"page":"5589","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Artistic Robotic Arm: Drawing Portraits on Physical Canvas under 80 Seconds"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4532-7475","authenticated-orcid":false,"given":"Shady","family":"Nasrat","sequence":"first","affiliation":[{"name":"Electrical Engineering Department, Pusan National University, Busan 46241, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8018-584X","authenticated-orcid":false,"given":"Taewoong","family":"Kang","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Pusan National University, Busan 46241, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3425-0054","authenticated-orcid":false,"given":"Jinwoo","family":"Park","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Pusan National University, Busan 46241, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8184-7059","authenticated-orcid":false,"given":"Joonyoung","family":"Kim","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Pusan National University, Busan 46241, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3700-4967","authenticated-orcid":false,"given":"Seung-Joon","family":"Yi","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Pusan National University, Busan 46241, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Almeida, D., and Karayiannidis, Y. (2019, January 11\u201313). A Lyapunov-Based Approach to Exploit Asymmetries in Robotic Dual-Arm Task Resolution. Proceedings of the 2019 IEEE 58th Conference on Decision and Control (CDC), Nice, France.","DOI":"10.1109\/CDC40024.2019.9030011"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Chancharoen, R., Chaiprabha, K., Wuttisittikulkij, L., Asdornwised, W., Saadi, M., and Phanomchoeng, G. (2023). Digital Twin for a Collaborative Painting Robot. Sensors, 23.","DOI":"10.3390\/s23010017"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"TWOMEY, R. (2023, May 10). Three Stage Drawing Transfer. Available online: https:\/\/roberttwomey.com\/three-stage-drawing-transfer\/.","DOI":"10.1145\/3532837.3534954"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Putra, R.Y., Kautsar, S., Adhitya, R., Syai\u2019in, M., Rinanto, N., Munadhif, I., Sarena, S., Endrasmono, J., and Soeprijanto, A. (2016, January 29\u201330). Neural Network Implementation for Invers Kinematic Model of Arm Drawing Robot. Proceedings of the 2016 International Symposium on Electronics and Smart Devices (ISESD), Bandung, Indonesia.","DOI":"10.1109\/ISESD.2016.7886710"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Baccaglini-Frank, A.E., Santi, G., Del Zozzo, A., and Frank, E. (2020). Teachers\u2019 Perspectives on the Intertwining of Tangible and Digital Modes of Activity with a Drawing Robot for Geometry. Educ. Sci., 10.","DOI":"10.3390\/educsci10120387"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"H\u00e1mori, A., Lengyel, J., and Resk\u00f3, B. (2011, January 23\u201325). 3DOF drawing robot using LEGO-NXT. Proceedings of the 2011 15th IEEE International Conference on Intelligent Engineering Systems, Poprad, High Tatras, Slovakia.","DOI":"10.1109\/INES.2011.5954761"},{"key":"ref_7","unstructured":"Junyou, Y., Guilin, Q., Le, M., Dianchun, B., and Xu, H. (2011, January 16\u201318). Behavior-based control of brush drawing robot. Proceedings of the 2011 International Conference on Transportation, Mechanical, and Electrical Engineering (TMEE), Changchun, China."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hsu, C.F., Kao, W.H., Chen, W.Y., and Wong, K.Y. (2017, January 27\u201330). Motion planning and control of a picture-based drawing robot system. Proceedings of the 2017 Joint 17th World Congress of International Fuzzy Systems Association and 9th International Conference on Soft Computing and Intelligent Systems (IFSA-SCIS), Otsu, Japan.","DOI":"10.1109\/IFSA-SCIS.2017.8023232"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Dziemian, S., Abbott, W.W., and Faisal, A.A. (2016, January 26\u201329). Gaze-based teleprosthetic enables intuitive continuous control of complex robot arm use: Writing & drawing. Proceedings of the 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob), Singapore.","DOI":"10.1109\/BIOROB.2016.7523807"},{"key":"ref_10","unstructured":"Sylvain, C., Epiney, J., and Aude, B. (2005, January 5\u20137). A Humanoid Robot Drawing Human Portraits. Proceedings of the 2005 5th IEEE-RAS International Conference on Humanoid Robots, Tsukuba, Japan."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Salameen, L., Estatieh, A., Darbisi, S., Tutunji, T.A., and Rawashdeh, N.A. (2020, January 9\u201311). Interfacing Computing Platforms for Dynamic Control and Identification of an Industrial KUKA Robot Arm. Proceedings of the 2020 21st International Conference on Research and Education in Mechatronics (REM), Cracow, Poland.","DOI":"10.1109\/REM49740.2020.9313878"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Cammarata, A., and Madd\u00edo, P.D. (2021). A system-based reduction method for spatial deformable multibody systems using global flexible modes. J. Sound Vib., 504.","DOI":"10.1016\/j.jsv.2021.116118"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/978-3-030-00365-4_4","article-title":"A two-step algorithm for the dynamic reduction of flexible mechanisms","volume":"66","author":"Cammarata","year":"2019","journal-title":"Mech. Mach. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1988","DOI":"10.1002\/rnc.6499","article-title":"Asymptotic tracking with novel integral robust schemes for mismatched uncertain nonlinear systems","volume":"33","author":"Yang","year":"2023","journal-title":"Int. J. Robust Nonlinear Control."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"6127","DOI":"10.1002\/rnc.6143","article-title":"Neuroadaptive learning algorithm for constrained nonlinear systems with disturbance rejection","volume":"32","author":"Yang","year":"2022","journal-title":"Int. J. Robust Nonlinear Control."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Beltramello, A., Scalera, L., Seriani, S., and Gallina, P. (2020). Artistic Robotic Painting Using the Palette Knife Technique. Robotics, 9.","DOI":"10.3390\/robotics9010015"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Karimov, A., Kopets, E., Kolev, G., Leonov, S., Scalera, L., and Butusov, D. (2021). Image Preprocessing for Artistic Robotic Painting. Inventions, 6.","DOI":"10.3390\/inventions6010019"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Karimov, A., Kopets, E., Leonov, S., Scalera, L., and Butusov, D. (2023). A Robot for Artistic Painting in Authentic Colors. J. Intell. Robot. Syst., 107.","DOI":"10.1007\/s10846-023-01831-4"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Guo, C., Bai, T., Wang, X., Zhang, X., Lu, Y., Dai, X., and Wang, F.Y. (2022). ShadowPainter: Active Learning Enabled Robotic Painting through Visual Measurement and Reproduction of the Artistic Creation Process. J. Intell. Robot. Syst., 105.","DOI":"10.1007\/s10846-022-01616-1"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lee, G., Kim, M., Lee, M., and Zhang, B.T. (2022, January 23\u201327). From Scratch to Sketch: Deep Decoupled Hierarchical Reinforcement Learning for Robotic Sketching Agent. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.","DOI":"10.1109\/ICRA46639.2022.9811858"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Scalera, L., Seriani, S., Gasparetto, A., and P., G. (2019). Non-Photorealistic Rendering Techniques for Artistic Robotic Painting. Robotics, 8.","DOI":"10.3390\/robotics8010010"},{"key":"ref_22","unstructured":"Aguilar, C., and Lipson, H. (2008, January 16\u201318). A robotic system for interpreting images into painted artwork. Proceedings of the GA2008, 11th Generative Art Conference, Milan, Italy."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1111\/cgf.12562","article-title":"Hardware-Based Non-Photorealistic Rendering Using a Painting Robot","volume":"34","author":"Lindemeier","year":"2015","journal-title":"Comput. Graph. Forum"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Luo, R.C., and Liu, Y.J. (2018, January 1\u20135). Robot Artist Performs Cartoon Style Facial Portrait Painting. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8594147"},{"key":"ref_25","first-page":"10402","article-title":"RoboCoDraw: Robotic Avatar Drawing with GAN-Based Style Transfer and Time-Efficient Path Optimization","volume":"34","author":"Wang","year":"2020","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Dong, L., Li, W., Xin, N., Zhang, L., and Lu, Y. (2018, January 15\u201316). Stylized Portrait Generation and Intelligent Drawing of Portrait Rendering Robot. Proceedings of the 2018 International Conference on Mechanical, Electronic and Information Technology, Shanghai, China.","DOI":"10.12783\/dtetr\/icmeit2018\/23434"},{"key":"ref_27","unstructured":"Patrick, T., and Frederic, F.L. (2012, January 4\u20136). Sketches by Paul the Robot. Proceedings of the Eighth Annual Symposium on Computational Aesthetics in Graphics, Visualization, and Imaging, Annecy, France."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"9753","DOI":"10.1177\/09544062221096946","article-title":"Artistic robotic pencil sketching using closed-loop force control","volume":"236","author":"Wu","year":"2022","journal-title":"Proc. Inst. Mech. Eng. Part J. Mech. Eng. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Gao, F., Zhu, J., Yu, Z., Li, P., and Wang, T. (2020, January 25\u201329). Making Robots Draw A Vivid Portrait In Two Minutes. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9340940"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Gao, Q., Chen, H., Yu, R., Yang, J., and Duan, X. (2019, January 13\u201315). A Robot Portraits Pencil Sketching Algorithm Based on Face Component and Texture Segmentation. Proceedings of the 2019 IEEE International Conference on Industrial Technology (ICIT), Melbourne, Australia.","DOI":"10.1109\/ICIT.2019.8755142"},{"key":"ref_31","unstructured":"Lin, C.Y., Chuang, L.W., and Mac, T.T. (2009, January 14\u201317). Human portrait generation system for robot arm drawing. Proceedings of the 2009 IEEE\/ASME International Conference on Advanced Intelligent Mechatronics, Singapore."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Xue, T., and Liu, Y. (2017, January 5\u20138). Robot portrait rendering based on multi-features fusion method inspired by human painting. Proceedings of the 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO), Macau, China.","DOI":"10.1109\/ROBIO.2017.8324781"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/TPAMI.2019.2929257","article-title":"OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields","volume":"43","author":"Cao","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yi, R., Liu, Y.J., Lai, Y.K., and Rosin, P.L. (2020, January 9\u201313). Unpaired Portrait Drawing Generation via Asymmetric Cycle Mapping. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00824"},{"key":"ref_35","unstructured":"(2023, May 10). ZEUS Zero 6-DOF Robotic Qrm. Available online: http:\/\/zero.globalzeus.com\/en\/6axis\/."},{"key":"ref_36","unstructured":"(2023, May 10). RoboWorld ZEUS Competition. Available online: http:\/\/www.globalzeus.com\/kr\/sub\/ir\/mediaView.asp?bid=2&b_idx=182."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/12\/5589\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:55:07Z","timestamp":1760126107000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/12\/5589"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,14]]},"references-count":36,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["s23125589"],"URL":"https:\/\/doi.org\/10.3390\/s23125589","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,14]]}}}