{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T10:52:49Z","timestamp":1762253569946,"version":"build-2065373602"},"reference-count":59,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2020,10,9]],"date-time":"2020-10-09T00:00:00Z","timestamp":1602201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A novel interactive system for calligraphy called mind calligraphy that reflects the writer\u2019s emotions in real time by affective computing and visualization techniques is proposed. Differently from traditional calligraphy, which emphasizes artistic expression, the system is designed to visualize the writer\u2019s mental-state changes during writing using audio-visual tools. The writer\u2019s mental state is measured with a brain wave machine to yield attention and meditation signals, which are classified next into the four types of emotion, namely, focusing, relaxation, calmness, and anxiety. These emotion types then are represented both by animations and color palettes for by-standing observers to appreciate. Based on conclusions drawn from data collected from on-site observations, surveys via Likert-scale questionnaires, and semi-structured interviews, the proposed system was improved gradually. The participating writers\u2019 cognitive, emotional, and behavioral engagements in the system were recorded and analyzed to obtain the following findings: (1) the interactions with the system raise the writer\u2019s interest in calligraphy; (2) the proposed system reveals the writer\u2019s emotions during the writing process in real time via animations of mixtures of fish swimming and sounds of raindrops, insects, and thunder; (3) the dynamic visualization of the writer\u2019s emotion through animations and color-palette displays makes the writer understand better the connection of calligraphy and personal emotions; (4) the real-time audio-visual feedback increases the writer\u2019s willingness to continue in calligraphy; and (5) the engagement of the writer in the system with interactions of diversified forms provides the writer with a new experience of calligraphy.<\/jats:p>","DOI":"10.3390\/s20205741","type":"journal-article","created":{"date-parts":[[2020,10,14]],"date-time":"2020-10-14T21:24:39Z","timestamp":1602710679000},"page":"5741","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Design of an Interactive Mind Calligraphy System by Affective Computing and Visualization Techniques for Real-Time Reflections of the Writer\u2019s Emotions"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8919-3704","authenticated-orcid":false,"given":"Chao-Ming","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Digital Media Design, National Yunlin University of Science and Technology, Douliu 64002, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu-Chen","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Digital Media Design, National Yunlin University of Science and Technology, Douliu 64002, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Sun, Y., Qian, H., and Xu, Y. (June, January 31). A Geometric Approach to Stroke Extraction for the Chinese Calligraphy Robot. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA2014), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907320"},{"key":"ref_2","unstructured":"Xintong, C. (2019, May 02). 5 Basic Script Styles in Chinese Calligraphy. Available online: http:\/\/www.columbia.edu\/~xc2282\/calligraphy\/calligraphy.html."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1016\/j.aasri.2013.10.079","article-title":"A Mobile Chinese calligraphic training system using virtual reality technology","volume":"5","author":"Wu","year":"2013","journal-title":"AASRI Procedia"},{"key":"ref_4","unstructured":"Mediaville, C. (1996). Calligraphy: From Calligraphy to Abstract Painting, Scirpus-Publications."},{"key":"ref_5","unstructured":"(2019, December 23). List of Script Typefaces. Available online: https:\/\/en.wikipedia.org\/wiki\/List_of_script_typefaces."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1016\/j.rcim.2004.11.007","article-title":"Pen-tablet as a CAD interface alternative","volume":"21","author":"Dickinson","year":"2005","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.inffus.2017.02.003","article-title":"A review of affective computing: From unimodal analysis to multimodal fusion","volume":"37","author":"Poria","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Chen, Y.C., and Wang, C.M. (2015, January 20\u201323). The Research of Human-Computer Interaction by Combining Affective Computing into Chinese Calligraphy Art. Proceedings of the 20th Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2015), Daegu, Korea.","DOI":"10.52842\/conf.caadria.2015.055"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"11896","DOI":"10.1109\/ACCESS.2020.2964794","article-title":"Non-contact emotion recognition combining heart rate and facial expression for interactive gaming environments","volume":"8","author":"Du","year":"2020","journal-title":"IEEE ACCESS"},{"key":"ref_10","unstructured":"Yoon, H., Park, S.-W., Lee, Y.-K., and Jang, J.-H. (2013, January 14\u201316). Emotion Recognition of Serious Game Players Using a Simple Brain Computer Interface. Proceedings of the IEEE International Conference on ICT Convergence (ICTC 2013), Jeju Island, Korea."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1109\/TSMCA.2011.2116000","article-title":"Emotion assessment from physiological signals for adaptation of game difficulty","volume":"41","author":"Chanel","year":"2011","journal-title":"IEEE Trans. Syst. Man Cybern. Part A Syst. Hum."},{"key":"ref_12","unstructured":"Chen, Y.C., and Wang, C.M. (2016, January 14\u201317). The Research of Interactive Installation Design by Combining Affective Computing Technology into Chinese Calligraphy Art. Proceedings of the 3rd ISAT: Collision, Collaboration and the Future of Artsci, Tainan, Taiwan."},{"key":"ref_13","unstructured":"Kantowitz, B.H., and Sorkin, R.D. (1983). Human Factors: Understanding People-system Relationships, Wiley."},{"key":"ref_14","unstructured":"Arnold, M.B. (1970). The assumption of identity and peripheralist-centralist controversies in motivation and emotion. Feelings and Emotions: The Loyola Symposium, Academic Press."},{"key":"ref_15","unstructured":"Ping, G.F. (2005). Emotional Psychology, Xin Li Press. (In Chinese)."},{"key":"ref_16","unstructured":"Ekman, P. (2004). Emotion Revealed: Understanding Faces and Feelings, Phoenix Press."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Picard, R.W. (1997). Affective Computing, MIT Press.","DOI":"10.7551\/mitpress\/1140.001.0001"},{"key":"ref_18","unstructured":"Kao, S.J. (1986). Calligraphy Psychology, Tung Da Books."},{"key":"ref_19","unstructured":"Sassoon, R. (1993). The Art and Science of Handwriting, Intellect Books."},{"key":"ref_20","unstructured":"(2020, January 10). Draft of a Requiem to My Nephew, Yan Zhenqing, Tang Dynasty. Available online: https:\/\/www.npmshops.com\/mainssl\/modules\/MySpace\/PrdInfo.php?sn=npmshops&pc=1608600148068."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.procs.2016.09.288","article-title":"Affective computing as complex systems science","volume":"95","author":"Lee","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/T-AFFC.2012.16","article-title":"Affective body expression perception and recognition: A survey","volume":"4","author":"Kleinsmith","year":"2013","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/S0953-5438(01)00055-8","article-title":"Computers that recognize and respond to user emotion: Theoretical and practical implications","volume":"14","author":"Picard","year":"2002","journal-title":"Interact. Comput."},{"key":"ref_24","first-page":"70","article-title":"Emotions and brain","volume":"367","author":"Yang","year":"2003","journal-title":"Sci. Dev."},{"key":"ref_25","first-page":"527","article-title":"\u00dcber das elektrenkephalogramm des menschen","volume":"87","author":"Berger","year":"1929","journal-title":"Eur. Arch. Psychiatry Clin. Neurosci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/S0304-3940(01)02094-8","article-title":"Human anterior and frontal midline theta and lower alpha reflect emotionally positive state and internalized attention: High-resolution EEG investigation of meditation","volume":"310","author":"Aftanas","year":"2001","journal-title":"Neurosci. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1109\/TRE.2000.847807","article-title":"Brain-computer interface technology: A review of the first international meeting","volume":"8","author":"Wolpaw","year":"2000","journal-title":"IEEE Trans. Rehabil. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"573734","DOI":"10.1155\/2013\/573734","article-title":"A review on the computational methods for emotional state estimation from the human EEG","volume":"2013","author":"Kim","year":"2013","journal-title":"Comput. Math. Methods Med."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Rieiro, H., Diaz-Piedra, C., Morales, J.M., Catena, A., Romero, S., Roca-Gonzalez, J., Fuentes, L.J., and Di Stasi, L.L. (2019). Validation of electroencephalographic recordings obtained with a consumer-grade, single dry electrode, low-cost device: A comparative study. Sensors, 19.","DOI":"10.3390\/s19122808"},{"key":"ref_30","unstructured":"(2020, January 23). MindWave Mobile 2\u2014Brainwave Sensing Headset. Available online: https:\/\/store.neurosky.com\/pages\/mindwave."},{"key":"ref_31","unstructured":"Yuang, F. (2002). Social Research Methods, Wu Nan Books."},{"key":"ref_32","unstructured":"Eliason, A.L. (1987). Systems Development: Analysis, Design, and Implementation, Scott, Foresman & Co."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1080\/15428119791012793","article-title":"Development and evaluation of an observational method for assessing repetition in hand tasks","volume":"58","author":"Latko","year":"1997","journal-title":"Am. Ind. Hyg. Assoc. J."},{"key":"ref_34","unstructured":"Lidwell, W., Holden, K., and Butler, J. (2010). Universal Principles of Design, Revised and Updated: 125 Ways to Enhance Usability, Influence Perception, Increase Appeal, Make Better Design Decisions, and Teach through Design, Rockport Publishers."},{"key":"ref_35","unstructured":"Agresti, A. (2013). Categorical Data Analysis. Hoboken, John Wiley & Sons."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1993). Usability Engineering, AP Professional.","DOI":"10.1016\/B978-0-08-052029-2.50007-3"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1111\/j.1744-6570.2007.00083.x","article-title":"Positive psychological capital: Measurement and relationship with performance and satisfaction","volume":"60","author":"Norman","year":"2007","journal-title":"Pers. Psychol."},{"key":"ref_38","unstructured":"Yeh, C.J. (2010). The Principles of Interaction Design, Artist Publishing."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1362\/026725799784870496","article-title":"Experiential marketing","volume":"15","author":"Schmitt","year":"1999","journal-title":"J. Mark. Manag."},{"key":"ref_40","first-page":"64","article-title":"Likert scales and data analyses","volume":"40","author":"Allen","year":"2007","journal-title":"Qual. Prog."},{"key":"ref_41","unstructured":"Kuan, H.S. (2009). Design Research Methods, Chuan Hwa Books."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1207\/s15327906mbr1201_3","article-title":"A study of a measure of sampling adequacy for factor-analytic correlation matrices","volume":"12","author":"Cerny","year":"1977","journal-title":"Multivar. Behav. Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/BF02291817","article-title":"A second generation Little Jiffy","volume":"35","author":"Kaiser","year":"1970","journal-title":"Psychometrika"},{"key":"ref_44","unstructured":"(2020, February 16). Kaiser-Meyer-Olkin (KMO) Test for Sampling Adequacy. Available online: https:\/\/www.statisticshowto.datasciencecentral.com\/kaiser-meyer-olkin\/."},{"key":"ref_45","unstructured":"(2020, February 25). KMO and Bartlett\u2019s Test. Available online: https:\/\/www.ibm.com\/support\/knowledgecenter\/SSLVMB_23.0.0\/spss\/tutorials\/fac_telco_kmo_01.html."},{"key":"ref_46","unstructured":"(2020, February 23). A Guide to Bartlett\u2019s Test of Sphericity. Available online: https:\/\/www.statology.org\/a-guide-to-bartletts-test-of-sphericity\/."},{"key":"ref_47","unstructured":"Hair, J.F., Black, W.C., Babin, B.J., and Anderson, R.E. (2010). Multivariate Data Analysis: A Global Perspective, Pearson."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1086\/266577","article-title":"Reliability of content analysis: The case of nominal scale coding","volume":"19","author":"Scott","year":"1955","journal-title":"Public Opin. Q."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/BF02310555","article-title":"Coefficient alpha and the internal structure of tests","volume":"16","author":"Cronbach","year":"1951","journal-title":"Psychometrika"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1007\/s11165-016-9602-2","article-title":"The use of Cronbach\u2019s Alpha when developing and reporting research instruments in science education","volume":"48","author":"Taber","year":"2018","journal-title":"Res. Sci. Educ."},{"key":"ref_51","unstructured":"Gildford, J.P. (1954). Psychometric Methods, McGraw-Hill. [2nd ed.]."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"15","DOI":"10.3946\/kjme.2017.49","article-title":"Reliability and validity test of the Korean version of Noe\u2019s evaluation","volume":"29","author":"Ho","year":"2017","journal-title":"Korean J. Med Educ."},{"key":"ref_53","unstructured":"Hair, J.F., Tatham, R.L., Anderson, R.E., and Black, W.C. (1998). Multivariate Data Analysis, Pearson Prentice Hall. [5th ed.]."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1207\/s15327906mbr3202_5","article-title":"Power analysis in covariance structure modeling using GFI and AGFI","volume":"32","author":"MacCallum","year":"1997","journal-title":"Multivar. Behav. Res."},{"key":"ref_55","unstructured":"Bentler, P.M. (1995). EQS Structural Equations Program Manual, Multivariate Software, Inc."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/10705519909540118","article-title":"Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives","volume":"6","author":"Hu","year":"1999","journal-title":"Struct. Equ. Modeling A Multidiscip. J."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1080\/10705519909540119","article-title":"Effects of sample size, estimation method, and model specification on structural equation modeling fit indexes","volume":"6","author":"Fan","year":"1999","journal-title":"Struct. Equ. Modeling A Multidiscip. J."},{"key":"ref_58","unstructured":"(2020, February 23). Research Methods Knowledge Base. Available online: https:\/\/conjointly.com\/kb\/construct-validity\/."},{"key":"ref_59","unstructured":"Salkin, N.J. (2007). Correlation coefficient. Encyclopedia of Measurement and Statistics, Sage Publications."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/20\/5741\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:18:01Z","timestamp":1760177881000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/20\/5741"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,9]]},"references-count":59,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["s20205741"],"URL":"https:\/\/doi.org\/10.3390\/s20205741","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,10,9]]}}}