{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T12:45:37Z","timestamp":1753879537156,"version":"3.41.2"},"reference-count":12,"publisher":"ASME International","issue":"1","content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2013,3,1]]},"abstract":"<jats:p>Multimodal systems have been previously used as an aid to improve quality and safety inspection in various domains, though few studies have evaluated these systems for accuracy and user comfort. Our research aims to combine our software interface designed for high usability with multimodal hardware configurations and to evaluate these systems to determine their user performance benefits and user acceptance data. We present two multimodal systems for using a novel system-directed interface to aid in inspecting vehicles along the assembly line: (1) wearable monocular display with speech input and audio output and (2) large screen display with speech input and audio output. We conducted two evaluations: (a) an experimental evaluation with novice users, resulting in accuracy, timing, user preferences, and other performance results and (b) an expert-based usability evaluation conducted on and off the assembly line providing insight on user acceptance, preferences, and performance potential in the production environment. We also compared these systems to current technology used in the production environment: a handheld display without speech input\/output. Our results show that for visual and tactile tasks, benefits of system-directed interfaces are best realized when used with multimodal systems that reduce visual and tactile interaction per item and instead deliver system-directed information on the audio channel. Interface designers that combine system-directed interfaces with multimodal systems can expect faster and more efficient user performance when the delivery channel is different from channels necessary for task completion.<\/jats:p>","DOI":"10.1115\/1.4023004","type":"journal-article","created":{"date-parts":[[2013,1,8]],"date-time":"2013-01-08T23:06:58Z","timestamp":1357686418000},"update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":2,"title":["Evaluation of System-Directed Multimodal Systems for Vehicle Inspection"],"prefix":"10.1115","volume":"13","author":[{"given":"Lauren","family":"Cairco Dukes","sequence":"first","affiliation":[{"name":"Graduate Research Assistant Virtual Environments Group, School of Computing, Clemson University, Clemson, SC 29632 e-mail:"}]},{"given":"Amy Ulinski","family":"Banic","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Wyoming, Laramie, WY 82071 e-mail:"}]},{"given":"Jerome","family":"McClendon","sequence":"additional","affiliation":[{"name":"Graduate Research Assistant e-mail:"}]},{"given":"Toni","family":"Bloodworth Pence","sequence":"additional","affiliation":[{"name":"Graduate Research Assistant e-mail:\u2002 Virtual Environments Group, School of Computing, Clemson University, Clemson, SC 29632"}]},{"given":"James","family":"Mathieson","sequence":"additional","affiliation":[{"name":"Graduate Research Assistant e-mail:"}]},{"given":"Joshua","family":"Summers","sequence":"additional","affiliation":[{"name":"Associate Professor Mem. ASME e-mail:\u2002 CEDAR Lab, Department of Mechanical Engineering, Clemson University, Clemson, SC 29632"}]},{"given":"Larry F.","family":"Hodges","sequence":"additional","affiliation":[{"name":"Professor School of Computing, Clemson University, Clemson, SC 29632 e-mail:"}]}],"member":"33","published-online":{"date-parts":[[2013,1,7]]},"reference":[{"key":"2019100603332964300_B1","doi-asserted-by":"crossref","unstructured":"Boronowsky, M., Nicolai, T., Schlieder, C., and Schmidt, A., 2001, \u201cWinspect: A Case Study for Wearable Computing-Supported Inspection Tasks,\u201d Proceedings Fifth International Symposium on Wearable Computers, IEEE, pp. 163\u2013164.","DOI":"10.1109\/ISWC.2001.962124"},{"year":"2000","key":"2019100603332964300_B2","article-title":"Speech-Controlled Wearable Computer: A Mobile System Supporting Inspections in Garages"},{"key":"2019100603332964300_B3","doi-asserted-by":"crossref","unstructured":"Ockerman, J., and Pritchett, A., 1998, \u201cPreliminary Investigation of Wearable Computers for Task Guidance in Aircraft Inspection,\u201d Digest of Papers, Second International Symposium on Wearable Computers, IEEE, pp. 33\u201340.","DOI":"10.1109\/ISWC.1998.729527"},{"key":"2019100603332964300_B4","doi-asserted-by":"crossref","unstructured":"Sunkpho, J., Garrett, J., Jr., Smailagic, A., and Siewiorek, D., 1998, \u201cMIA: A Wearable Computer for Bridge Inspectors,\u201d Digest of Papers, Second International Symposium on Wearable Computers, IEEE, pp. 160\u2013161.","DOI":"10.1109\/ISWC.1998.729545"},{"year":"2012","author":"BMW Manufacturing Co.","key":"2019100603332964300_B5"},{"key":"2019100603332964300_B6","doi-asserted-by":"crossref","unstructured":"Cairco, L., Ulinski, A., McClendon, J., Bloodworth, T., Matheison, J., Hodges, L., and Summers, J., 2010, \u201cInterface Design and Display Modalities to Improve the Vehicle Inspection Process,\u201d Proceedings on WINVR, ASME.","DOI":"10.1115\/WINVR2010-3733"},{"issue":"4","key":"2019100603332964300_B7","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MPRV.2007.89","article-title":"Wearit@work: Toward Real-World Industrial Wearable Computing","volume":"6","year":"2007","journal-title":"IEEE Pervasive Comput."},{"key":"2019100603332964300_B8","unstructured":"Maurtua, I., Kirisci, P., Stiefmeier, T., Sbodio, M., and Witt, H., 2007. \u201cA Wearable Computing Prototype for Supporting Training Activities in Automotive Production,\u201d 4th International Forum on Applied Wearable Computing (IFAWC), VDE, pp. 1\u201312."},{"year":"2012","key":"2019100603332964300_B9"},{"key":"2019100603332964300_B10","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1016\/j.procs.2011.07.051","article-title":"Wearable Computing in Industrial Service Applications","volume":"5","year":"2011","journal-title":"Proc. Comput. Sci."},{"volume-title":"Interaction Design: Beyond Human-Computer Interaction","year":"2011","key":"2019100603332964300_B11"},{"issue":"2","key":"2019100603332964300_B12","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1037\/h0043158","article-title":"The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information","volume":"63","year":"1956","journal-title":"Psychol. Rev."}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/doi\/10.1115\/1.4023004\/6099032\/jcis_13_1_011002.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/doi\/10.1115\/1.4023004\/6099032\/jcis_13_1_011002.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,29]],"date-time":"2025-04-29T16:32:48Z","timestamp":1745944368000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/doi\/10.1115\/1.4023004\/371381\/Evaluation-of-SystemDirected-Multimodal-Systems"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,1,7]]},"references-count":12,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,3,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4023004","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"type":"print","value":"1530-9827"},{"type":"electronic","value":"1944-7078"}],"subject":[],"published":{"date-parts":[[2013,1,7]]},"article-number":"011002"}}