{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,25]],"date-time":"2025-03-25T18:45:33Z","timestamp":1742928333977,"version":"3.40.3"},"publisher-location":"Berlin, Heidelberg","reference-count":18,"publisher":"Springer Berlin Heidelberg","isbn-type":[{"type":"print","value":"9783642025761"},{"type":"electronic","value":"9783642025778"}],"license":[{"start":{"date-parts":[[2009,1,1]],"date-time":"2009-01-01T00:00:00Z","timestamp":1230768000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009]]},"DOI":"10.1007\/978-3-642-02577-8_9","type":"book-chapter","created":{"date-parts":[[2009,7,13]],"date-time":"2009-07-13T19:36:05Z","timestamp":1247513765000},"page":"75-83","source":"Crossref","is-referenced-by-count":12,"title":["Reliable Evaluation of Multimodal Dialogue Systems"],"prefix":"10.1007","author":[{"given":"Florian","family":"Metze","sequence":"first","affiliation":[]},{"given":"Ina","family":"Wechsung","sequence":"additional","affiliation":[]},{"given":"Stefan","family":"Schaffer","sequence":"additional","affiliation":[]},{"given":"Julia","family":"Seebode","sequence":"additional","affiliation":[]},{"given":"Sebastian","family":"M\u00f6ller","sequence":"additional","affiliation":[]}],"member":"297","reference":[{"key":"9_CR1","unstructured":"Sturm, J.: On the usability of multimodal interaction for mobile access to information services. PhD thesis, Radboud University Nijmegen, Nijmegen, The Netherlands (2005)"},{"key":"9_CR2","doi-asserted-by":"crossref","unstructured":"Larsen, L.B.: Assessment of spoken dialogue system usability - what are we really measuring? In: Eurospeech 2003, pp. 1945\u20131948 (2003)","DOI":"10.21437\/Eurospeech.2003-286"},{"key":"9_CR3","unstructured":"Naumann, A., Wechsung, I.: Developing Usability Methods for Multimodal Systems: The Use of Subjective and Objective Measures. In: Proceedings of the International Workshop on Meaningful Measures: Valid Useful User Experience Measurement (VUUM), pp. 8\u201312 (2008)"},{"key":"9_CR4","doi-asserted-by":"crossref","unstructured":"Bolt, R.A.: \u201cPut-that-there\u201d: Voice and gesture at the graphics interface. In: Proceedings of the 7th Annual Conference on Computer Graphics and interactive Techniques (1980)","DOI":"10.1145\/800250.807503"},{"key":"9_CR5","doi-asserted-by":"crossref","unstructured":"Cohen, P.R., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., Clow, J.: QuickSet: multimodal interaction for distributed applications. In: Proceedings of the Fifth ACM international Conference on Multimedia (1997)","DOI":"10.3115\/974557.974562"},{"key":"9_CR6","first-page":"12","volume":"86","author":"J. Martin","year":"2006","unstructured":"Martin, J., Buisine, S., Pitel, G., Bernsen, N.O.: Fusion of children\u2019s speech and 2D gestures when conversing with 3D characters. Signal Process\u00a086, 12 (2006)","journal-title":"Signal Process"},{"issue":"1","key":"9_CR7","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1109\/MIS.2001.1183338","volume":"16","author":"D. Perzanowski","year":"2001","unstructured":"Perzanowski, D., Schultz, A.C., Adams, W., Marsh, E., Bugajska, M.: Building a Multimodal Human-Robot Interface. IEEE Intelligent Systems\u00a016(1), 16\u201321 (2001)","journal-title":"IEEE Intelligent Systems"},{"key":"9_CR8","doi-asserted-by":"crossref","unstructured":"Thalmann, D.: The virtual human as a multimodal interface. In: Proceedings of the Working Conference on Advanced Visual interfaces (2000)","DOI":"10.1145\/345513.345232"},{"key":"9_CR9","volume-title":"Human-Centric Interfaces for Ambient Intelligence","author":"S. M\u00f6ller","year":"2009","unstructured":"M\u00f6ller, S., Engelbrecht, K.-P., K\u00fchnel, C., Wechsung, I., Weiss, B.: Evaluation of Multimodal Interfaces for Ambient Intelligence. In: Aghajan, H., L\u00f3pez-C\u00f3zar Delgado, R., Augusto, J.C. (eds.) Human-Centric Interfaces for Ambient Intelligence. Elsevier, Amsterdam (2009)"},{"key":"9_CR10","series-title":"LNAI","doi-asserted-by":"publisher","first-page":"276","DOI":"10.1007\/978-3-540-69369-7_32","volume-title":"Perception in Multimodal Dialogue Systems","author":"I. Wechsung","year":"2008","unstructured":"Wechsung, I., Naumann, A.B.: Evaluation Methods for Multimodal Systems: A Comparison of Standardized Usability Questionnaires. In: Andr\u00e9, E., Dybkj\u00e6r, L., Minker, W., Neumann, H., Pieraccini, R., Weber, M. (eds.) PIT 2008. LNCS (LNAI), vol.\u00a05078, pp. 276\u2013284. Springer, Heidelberg (2008)"},{"key":"9_CR11","first-page":"4","volume":"37","author":"J. Nielsen","year":"1994","unstructured":"Nielsen, J., Levy, J.: Measuring usability: Preference vs. performance. Communications of the ACM\u00a037, 4 (1994)","journal-title":"performance. Communications of the ACM"},{"key":"9_CR12","volume-title":"Proc. CHI 2005","author":"J. Sauro","year":"2005","unstructured":"Sauro, J., Kindlund, E.: A method to standardize usability metrics into a single score. In: Proc. CHI 2005. ACM Press, New York (2005)"},{"key":"9_CR13","volume-title":"Bedienen und Verstehen. 4. Berliner Werkstatt Mensch-Maschine-Systeme","author":"N.C. Kr\u00e4mer","year":"2002","unstructured":"Kr\u00e4mer, N.C., Nitschke, J.: Ausgabemodalit\u00e4ten im Vergleich: Ver\u00e4ndern sie das Eingabeverhalten der Benutzer? [Output modalities in comparison: Do they change user\u2019s input behaviour?]. In: Marzi, R., Karavezyris, V., Erbe, H.-H., Timpe, K.-P. (Hrsg.) Bedienen und Verstehen. 4. Berliner Werkstatt Mensch-Maschine-Systeme, VDI-Verlag, D\u00fcsseldorf (2002)"},{"key":"9_CR14","volume-title":"Fortschritte der Akustik - DAGA 2006","author":"S. M\u00f6ller","year":"2006","unstructured":"M\u00f6ller, S.: Messung und Vorhersage der Effizienz bei der Interaktion mit Sprachdialogdiensten [Measuring and predicting efficiency for the interaction with speech dialogue systems]. In: Langer, S., Scholl, W. (eds.) Fortschritte der Akustik - DAGA 2006. DEGA, Berlin (2006)"},{"key":"9_CR15","volume-title":"Proc. CHI 2000","author":"E. Fr\u00f8kj\u00e6r","year":"2000","unstructured":"Fr\u00f8kj\u00e6r, E., Hertzum, M., Hornb\u00e6k, K.: Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In: Proc. CHI 2000. ACM Press, New York (2000)"},{"key":"9_CR16","volume-title":"Proc. CHI 2007","author":"K. Hornb\u00e6k","year":"2007","unstructured":"Hornb\u00e6k, K., Law, E.L.: Meta-analysis of correlations among usability measures. In: Proc. CHI 2007. ACM Press, New York (2007)"},{"key":"9_CR17","volume-title":"Mensch & Computer 2003. Interaktion in Bewegung","author":"M. Hassenzahl","year":"2003","unstructured":"Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualit\u00e4t [A questionnaire for measuring perceived hedonic and pragmatic quality]. In: Ziegler, J., Szwillus, G. (eds.) Mensch & Computer 2003. Interaktion in Bewegung. B.G. Teubner, Stuttgart (2003)"},{"key":"9_CR18","doi-asserted-by":"crossref","unstructured":"Hone, K., Graham, R.: Subjective assessment of speech-system interface usability. In: Proceedings of Eurospeech 2001, vol.\u00a03 (2001)","DOI":"10.21437\/Eurospeech.2001-491"}],"container-title":["Lecture Notes in Computer Science","Human-Computer Interaction. Novel Interaction Methods and Techniques"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-642-02577-8_9","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,26]],"date-time":"2023-05-26T00:09:33Z","timestamp":1685059773000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/978-3-642-02577-8_9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009]]},"ISBN":["9783642025761","9783642025778"],"references-count":18,"URL":"https:\/\/doi.org\/10.1007\/978-3-642-02577-8_9","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"type":"print","value":"0302-9743"},{"type":"electronic","value":"1611-3349"}],"subject":[],"published":{"date-parts":[[2009]]}}}