{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T07:37:23Z","timestamp":1767339443688,"version":"3.41.0"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2017,6,30]],"date-time":"2017-06-30T00:00:00Z","timestamp":1498780800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Google Faculty Research Award, and Microsoft Azure Award"},{"DOI":"10.13039\/100000001","name":"National Science Foundation Award","doi-asserted-by":"publisher","award":["#IIS-1464162"],"award-info":[{"award-number":["#IIS-1464162"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2017,6,30]]},"abstract":"<jats:p>This paper presents a description and evaluation of the ROC Speak system, a platform that allows ubiquitous access to communication skills training. ROC Speak (available at rocspeak.com) enables anyone to go to a website, record a video, and receive feedback on smile intensity, body movement, volume modulation, filler word usage, unique word usage, word cloud of the spoken words, in addition to overall assessment and subjective comments by peers. Peer comments are automatically ranked and sorted for usefulness and sentiment (i.e., positive vs. negative). We evaluated the system with a diverse group of 56 online participants for a 10-day period. Participants submitted responses to career oriented prompts every other day. The participants were randomly split into two groups: 1) treatment - full feedback from the ROC Speak system; 2) control \u2013 written feedback from online peers. When judged by peers (p &lt; .001) and independent raters (p &lt; .05), participants from the treatment group demonstrated statistically significant improvement in overall speaking skills rating while the control group did not. Furthermore, in terms of speaking attributes, treatment group showed an improvement in friendliness (p &lt; .001), vocal variety (p &lt; .05) and articulation (p &lt; .01).<\/jats:p>","DOI":"10.1145\/3090097","type":"journal-article","created":{"date-parts":[[2017,6,30]],"date-time":"2017-06-30T18:32:46Z","timestamp":1498847566000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["Semi-Automated 8 Collaborative Online Training Module for Improving Communication Skills"],"prefix":"10.1145","volume":"1","author":[{"given":"Ru","family":"Zhao","sequence":"first","affiliation":[{"name":"University of Rochester"}]},{"given":"Vivian","family":"Li","sequence":"additional","affiliation":[{"name":"University of Rochester"}]},{"given":"Hugo","family":"Barbosa","sequence":"additional","affiliation":[{"name":"University of Rochester"}]},{"given":"Gourab","family":"Ghoshal","sequence":"additional","affiliation":[{"name":"University of Rochester"}]},{"given":"Mohammed Ehsan","family":"Hoque","sequence":"additional","affiliation":[{"name":"University of Rochester"}]}],"member":"320","published-online":{"date-parts":[[2017,6,30]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971743"},{"volume-title":"The TARDIS framework: Intelligent virtual agents for social coaching in job interviews","series-title":"Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)","author":"Anderson Keith","key":"e_1_2_2_2_1"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124916"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(02)00077-8"},{"volume-title":"Louis Philippe Morency, and Stefan Scherer","year":"2013","author":"Batrinca Ligia","key":"e_1_2_2_5_1"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866078"},{"key":"e_1_2_2_7_1","unstructured":"P Boersma and D Weenink. 2007. Praat: doing phonetics by computer (Version 4.5.){Computer program}. (2007) 341--345 pages. papers3:\/\/publication\/uuid\/AF582E4D-2F7A-409E-B4F1-7A10385D9135  P Boersma and D Weenink. 2007. Praat: doing phonetics by computer (Version 4.5.){Computer program}. (2007) 341--345 pages. papers3:\/\/publication\/uuid\/AF582E4D-2F7A-409E-B4F1-7A10385D9135"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.185"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.evolhumbehav.2014.08.001"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858411"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2663204.2663265"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2806060"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02175503"},{"volume-title":"Social anxiety and self-evaluation of interpersonal performance. Psychological reports 36, 1","year":"1975","author":"Clark J V","key":"e_1_2_2_14_1"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1080\/03634520109379238"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.114.3.494"},{"key":"e_1_2_2_17_1","unstructured":"J Cohen. 1988. Statistical power analysis for the behavioral sciences. (1988) 567 pages.  J Cohen. 1988. Statistical power analysis for the behavioral sciences. (1988) 567 pages."},{"volume-title":"Games are better than books: In-situ comparison of an interactive job interview game with conventional training","series-title":"Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)","author":"Damian Ionut","key":"e_1_2_2_18_1"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702314"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1958824.1958844"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1162\/jocn_a_00963"},{"volume-title":"Retrieved","year":"2017","key":"e_1_2_2_22_1"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/1949767.1949786"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804265"},{"volume-title":"Proceedings of the 13th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2014)","year":"2014","author":"Gebhard Patrick","key":"e_1_2_2_25_1"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/17470215808416261"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.1753"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.system.2005.04.002"},{"volume-title":"Retrieved","year":"2017","key":"e_1_2_2_29_1"},{"volume-title":"Your Perfect Presentation: Speak in Front of Any Audience Anytime Anywhere and Never Be Nervous Again","author":"Hoogterp Bill","key":"e_1_2_2_30_1"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493502"},{"volume-title":"Retrieved","year":"2017","author":"Google Inc.","key":"e_1_2_2_32_1"},{"volume-title":"Gestures: Your body speaks.","year":"2011","author":"International Toastmasters","key":"e_1_2_2_33_1"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00998265"},{"volume-title":"Content Analysis: An Introduction to Its Methodology.","year":"2004","author":"Krippendorff Klaus","key":"e_1_2_2_35_1"},{"volume-title":"Retrieved","year":"2017","author":"Lab Penn Phonetics","key":"e_1_2_2_36_1"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985761"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380122"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647367"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0021-9924(03)00032-7"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702349"},{"key":"e_1_2_2_42_1","unstructured":"Oscar T Lenning and Larry H Ebbers. 1999. The powerful potential of learning communities: Improving education for the future. (1999) 363--365 pages. http:\/\/ezproxy.library.wisc.edu\/login?url=http:\/\/search.ebscohost.com\/login.aspx?direct=true  Oscar T Lenning and Larry H Ebbers. 1999. The powerful potential of learning communities: Improving education for the future. (1999) 363--365 pages. http:\/\/ezproxy.library.wisc.edu\/login?url=http:\/\/search.ebscohost.com\/login.aspx?direct=true"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1257\/jep.21.2.153"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-011-0124-6"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0045106"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2015.7163127"},{"volume-title":"Retrieved","year":"2017","key":"e_1_2_2_47_1"},{"volume-title":"Retrieved","year":"2012","key":"e_1_2_2_48_1"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-843X.101.4.728"},{"volume-title":"Retrieved","year":"2017","author":"Inc. Rate Speeches.","key":"e_1_2_2_50_1"},{"volume-title":"Retrieved","year":"2017","author":"Room Own The","key":"e_1_2_2_51_1"},{"volume-title":"Retrieved","year":"2014","author":"Rosencrance Linda","key":"e_1_2_2_52_1"},{"volume-title":"Retrieved","year":"2016","author":"Sachs Goldman","key":"e_1_2_2_53_1"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818346.2830603"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1080\/03634523.2012.670709"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.5555\/1613715.1613751"},{"volume-title":"Retrieved","year":"2017","key":"e_1_2_2_57_1"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701368"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701386"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2856767.2856785"},{"volume-title":"Retrieved","year":"2017","key":"e_1_2_2_61_1"},{"volume-title":"Effective Speaking: Communicating in Speech. Taylor 8 Francis.","year":"1985","author":"Turk Christopher","key":"e_1_2_2_62_1"},{"volume-title":"Retrieved","year":"2017","author":"Carnegie Mellon University","key":"e_1_2_2_63_1"},{"volume-title":"Retrieved","year":"2017","author":"Northwestern University","key":"e_1_2_2_64_1"},{"volume-title":"Retrieved","year":"2016","author":"Yang Nicole","key":"e_1_2_2_65_1"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:RIHE.0000015692.88534.de"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3090097","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3090097","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3090097","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:23:47Z","timestamp":1750220627000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3090097"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,30]]},"references-count":66,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2017,6,30]]}},"alternative-id":["10.1145\/3090097"],"URL":"https:\/\/doi.org\/10.1145\/3090097","relation":{},"ISSN":["2474-9567"],"issn-type":[{"type":"electronic","value":"2474-9567"}],"subject":[],"published":{"date-parts":[[2017,6,30]]},"assertion":[{"value":"2016-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-06-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}