{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T18:05:24Z","timestamp":1754157924507,"version":"3.41.2"},"reference-count":35,"publisher":"Emerald","issue":"3","license":[{"start":{"date-parts":[[2009,9,4]],"date-time":"2009-09-04T00:00:00Z","timestamp":1252022400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,9,4]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-heading\">Purpose<\/jats:title><jats:p>Mobile handheld devices, such as cellular phones and personal digital assistants, are inherently small and lack an intuitive and natural user interface. Speech recognition and synthesis technology can be used in mobile handheld devices to improve the user experience. The purpose of this paper is to describe a prototype system that supports multiple speech\u2010enabled applications in a mobile handheld device.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Design\/methodology\/approach<\/jats:title><jats:p>The main component of the system, the Program Manager, coordinates and controls the speech\u2010enabled applications. Human speech requests to, and responses from, these applications are processed in the mobile handheld device, to achieve the goal of human\u2010like interactions between the human and the device. In addition to speech, the system also supports graphics and text, i.e., multimodal input and output, for greater usability, flexibility, adaptivity, accuracy, and robustness. The paper presents a qualitative and quantitative evaluation of the prototype system. The Program Manager is currently designed to handle the specific speech\u2010enabled applications that we developed.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Findings<\/jats:title><jats:p>The paper determines that many human interactions involve not single applications but multiple applications working together in possibly unanticipated ways.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Research limitations\/implications<\/jats:title><jats:p>Future work includes generalization of the Program Manager so that it supports arbitrary applications and the addition of new applications dynamically. Future work also includes deployment of the Program Manager and the applications on cellular phones running the Android Platform or the Openmoko Framework.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Originality\/value<\/jats:title><jats:p>This paper presents a first step towards a future human interface for mobile handheld devices and for speech\u2010enabled applications operating on those devices.<\/jats:p><\/jats:sec>","DOI":"10.1108\/17427370910991884","type":"journal-article","created":{"date-parts":[[2009,10,5]],"date-time":"2009-10-05T12:30:29Z","timestamp":1254745829000},"page":"332-359","source":"Crossref","is-referenced-by-count":3,"title":["Managing multiple speech\u2010enabled applications in a mobile handheld device"],"prefix":"10.1108","volume":"5","author":[{"given":"Michael","family":"Schuricht","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zachary","family":"Davis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Hu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shreyas","family":"Prasad","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter M.","family":"Melliar\u2010Smith","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Louise E.","family":"Moser","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2022032120310160700_b1","unstructured":"Android (n.d.), available at: www.google.com\/android\/"},{"key":"key2022032120310160700_b2","unstructured":"AT&T Labs (2006), \u201cNatural Voices\u201d, Menlo Park, CA, available at: www.naturalvoices.att.com\/\u2010products\/"},{"key":"key2022032120310160700_b3","doi-asserted-by":"crossref","unstructured":"Cohen, P., Johnston, M., McGee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L. and Clow, J. (1997), \u201cQuickset: multimodal interaction for distributed applications\u201d, Proceedings of the Fifth ACM International Multimedia Conference, Seattle, WA, pp. 31\u201040.","DOI":"10.3115\/974557.974562"},{"key":"key2022032120310160700_b4","doi-asserted-by":"crossref","unstructured":"Deligne, S., Dharanipragada, S., Gopinath, R., Maison, B., Olsen, P. and Printz, H. (2002), \u201cA robust high accuracy speech recognition system for mobile applications\u201d, IEEE Transactions on Speech and Audio Processing, Vol. 10 No. 8, pp. 551\u201061.","DOI":"10.1109\/TSA.2002.804541"},{"key":"key2022032120310160700_b5","doi-asserted-by":"crossref","unstructured":"Deng, L. and Huang, X. (2004), \u201cChallenges in adopting speech recognition\u201d, Communications of the ACM, Vol. 47 No. 1, pp. 69\u201075.","DOI":"10.1145\/962081.962108"},{"key":"key2022032120310160700_b6","doi-asserted-by":"crossref","unstructured":"Deng, L., Wang, K., Acero, A., Hon, H., Droppo, J., Boulis, C., Wang, Y., Jacoby, D., Mahajan, M., Chelba, C. and Huang, X. (2002), \u201cDistributed speech processing in MiPad's multimodal user interface\u201d, IEEE Transactions on Speech and Audio Processing, Vol. 10, pp. 605\u201019.","DOI":"10.1109\/TSA.2002.804538"},{"key":"key2022032120310160700_b7","doi-asserted-by":"crossref","unstructured":"D'Ulizia, A., Ferri, F. and Grifoni, P. (2007) \u201cA hybrid grammar\u2010based approach to multimodal languages specification\u201d, in Meersman, R. et al. (Eds), Lecture Notes in Computer Science 4805, Springer\u2010Verlag, Berlin\/Heidelberg, Vilamoura, pp. 367\u201076.","DOI":"10.1007\/978-3-540-76888-3_59"},{"key":"key2022032120310160700_b8","unstructured":"Englert, R. and Glass, G. (2006), \u201cArchitecture for multimodal mobile applications\u201d, Proceedings of the 20th International Symposium on Human Factors in Telecommunication."},{"key":"key2022032120310160700_b9","doi-asserted-by":"crossref","unstructured":"Grasso, M.A., Ebert, D.S. and Finin, T.W. (1998) \u201cThe integrality of speech in multi\u2010modal interfaces\u201d, ACM Transactions on Computer\u2010Human Interaction, Vol. 5 No. 4, pp. 303\u201025.","DOI":"10.1145\/300520.300521"},{"key":"key2022032120310160700_b10","unstructured":"Huang, X., Acero, A., Chelba, C., Deng, L., Droppo, J., Duchene, D., Goodman, J., Hon, H., Jacoby, D., Jiang, L., Loynd, R., Mahajan, J., Mau, P., Meredith, S., Mughal, S., Neto, S., Plumpe, M., Stery, K., Venolia, G., Wang, K. and Wang, Y. (2001), \u201cMiPad: a multimodal interaction prototype\u201d, Proceedings of the International Conference on Acoustics, Speech and Signal Processing, Vol. 1, pp. 9\u201012."},{"key":"key2022032120310160700_b11","doi-asserted-by":"crossref","unstructured":"Johnston, M. and Bangalore, S. (2000), \u201cFinite\u2010state multimodal parsing and understanding\u201d, Proceedings of the 18th Conference on Computational Linguistics, Saarbrucken, pp. 369\u201075.","DOI":"10.3115\/990820.990874"},{"key":"key2022032120310160700_b12","doi-asserted-by":"crossref","unstructured":"Johnston, M., Cohen, P.R., McGee, D., Oviatt, S.L., Pittman, J.A. and Smith, I. (1997), \u201cUnification\u2010based multimodal integration\u201d, Proceedings of the Eighth Conference on European Chapter of the Association for Computational Linguistics, Madrid, pp. 281\u201088.","DOI":"10.3115\/979617.979653"},{"key":"key2022032120310160700_b13","doi-asserted-by":"crossref","unstructured":"Johnston, M., Bangalore, S., Vasireddy, G., Stent, A., Ehlen, P., Walker, M., Wittaker, S. and Maloor, P. (2002), \u201cMATCH: an architecture for multimodal dialogue systems\u201d, Proceedings of the 40th Annual Meeting of the Assoication for Computational Linguistics, Philadelphia, PA, pp. 376\u201083.","DOI":"10.3115\/1073083.1073146"},{"key":"key2022032120310160700_b14","unstructured":"Kondratova, I. (2004), \u201cSpeech\u2010enabled mobile field applications\u201d, Proceedings of the IASTED International Conference on Internet and Multimedia Systems, Kauai, Hawaii, HI."},{"key":"key2022032120310160700_b15","doi-asserted-by":"crossref","unstructured":"Kondratova, I. (2005), \u201cSpeech\u2010enabled handheld computing for fieldwork\u201d, National Research Council Canada, Institute for Information Technology.","DOI":"10.1061\/40794(179)102"},{"key":"key2022032120310160700_b16","unstructured":"Machon, P., Perez, G. and Amores, G. (2006), \u201cMultimodal fusion: new hybrid strategy for dialogue systems\u201d, Proceedings of the Eighth International Conference on Multimodal Interfaces, Banff, Alberta, pp. 357\u201063."},{"key":"key2022032120310160700_b17","doi-asserted-by":"crossref","unstructured":"Moran, D.B., Cheyer, A.J., Julia, L.E., Martin, D.L. and Park, S. (1998), \u201cMultimodal user interfaces in the open agent architecture\u201d, Knowledge\u2010Based Systems, Elsevier Science, Vol. 10, pp. 295\u2010303.","DOI":"10.1016\/S0950-7051(97)00037-3"},{"key":"key2022032120310160700_b18","unstructured":"National Oceanic and Atmospheric Administration (n.d.), National Weather Service, available at: www.nws.noaa.gov"},{"key":"key2022032120310160700_b19","unstructured":"Openmoko (n.d.), available at: www.openmoko.org"},{"key":"key2022032120310160700_b20","unstructured":"OQO Inc. (2006), \u201cOQO personal computer\u201d, San Francisco, CA, available at: www.oqo.com"},{"key":"key2022032120310160700_b21","doi-asserted-by":"crossref","unstructured":"Oviatt, S. and Cohen, P. (2000), \u201cMulti\u2010modal interfaces that process what comes naturally\u201d, Communications of the ACM, Vol. 43 No. 3, pp. 45\u201053.","DOI":"10.1145\/330534.330538"},{"key":"key2022032120310160700_b22","unstructured":"Pakucs, B. (2003), \u201cTowards dynamic multi\u2010domain dialogue processing\u201d, Proceedings of the Eurospeech'03, Geneva, Vol. 1, pp. 741\u201044."},{"key":"key2022032120310160700_b23","unstructured":"Pakucs, B. (2004), \u201cButler: A universal speech interface for mobile environments\u201d, in Brewster, S. and Dunlop, M. (Eds), Lecture Notes in Computer Science, Springer\u2010Verlag, Berlin\/Heidelberg, Vol. 3160, pp. 339\u2010409."},{"key":"key2022032120310160700_b24","doi-asserted-by":"crossref","unstructured":"Pearce, D., Engelsma, J., Ferrans, J. and Johnson, J. (2005), \u201cAn architecture for seamless access to distributed multimodal services\u201d, Proceedings of the Interspeech 2005, Lisbon, pp. 2845\u201048.","DOI":"10.21437\/Interspeech.2005-833"},{"key":"key2022032120310160700_b25","doi-asserted-by":"crossref","unstructured":"Portillo, P.M., Garcia, G.P. and Carredano, G.A. (2006), \u201cMultimodal fusion: new hybrid strategy for dialogue systems\u201d, Proceedings of the 8th ACM International Conference on Multimodal Interfaces, Banff, Alberta, pp. 357\u201063.","DOI":"10.1145\/1180995.1181061"},{"key":"key2022032120310160700_b26","unstructured":"Rabiner, L. and Juang, B.H. (1993), Fundamentals of Speech Recognition, Prentice Hall, Upper Saddle River, NJ."},{"key":"key2022032120310160700_b27","doi-asserted-by":"crossref","unstructured":"Reithinger, N., Alexandersson, J., Becker, T., Blocher, A., Engel, R., Lockelt, M., Muller, J., Pfleger, N., Poller, P., Streit, M. and Tschernomas, V. (2003), \u201cSmartKom: adaptive and flexible multimodal access to multiple applications\u201d, Proceedings of the 5th International Conference on Multimodal Interfaces, Vancouver, British Columbia, pp. 101\u20108.","DOI":"10.1145\/958432.958454"},{"key":"key2022032120310160700_b28","doi-asserted-by":"crossref","unstructured":"Sarker, S. and Wells, J.D. (2005), \u201cUnderstanding mobile handheld device use and adoption\u201d, Communications of the ACM, Vol. 43 No. 12, pp. 35\u201040.","DOI":"10.1145\/953460.953484"},{"key":"key2022032120310160700_b29","doi-asserted-by":"crossref","unstructured":"Sharp, A. and Kurkovsky, S. (2007), \u201cVOICE: a framework for speech\u2010based mobile systems\u201d, Proceedings of the IEEE International Conference on Advanced Information Networking and Applications Workshops, pp. 38\u201043.","DOI":"10.1109\/AINAW.2007.369"},{"key":"key2022032120310160700_b30","unstructured":"SRI International (2006), \u201cDynaSpeak\u201d, Menlo Park, CA, available at: www.speechatsri.com\/pro\u2010ducts\/sdk.shtml"},{"key":"key2022032120310160700_b31","doi-asserted-by":"crossref","unstructured":"Varga, I., Aalburg, S., Andrassy, B., Astrov, S., Bauer, J.G., Beaugeant, C., Geissler, C. and Hoge, H. (2002), \u201cASR in mobile phones An industrial approach\u201d, IEEE Transactions on Speech and Audio Processing, Vol. 10 No. 8, pp. 562\u201069.","DOI":"10.1109\/TSA.2002.804548"},{"key":"key2022032120310160700_b32","unstructured":"Yahoo! Finance (n.d.), available at: http:\/\/finance.yahoo.com"},{"key":"key2022032120310160700_b33","unstructured":"Yahoo! LocalSearch (n.d.), available at: http:\/\/developer.yahoo.net\/search\/local\/V1\/local Search.html"},{"key":"key2022032120310160700_b34","doi-asserted-by":"crossref","unstructured":"Zaykovskiy, D., Schmitt, A. and Lutz, A. (2007), \u201cNew use of mobile phones: towards multimodal information access systems\u201d, Proceedings of the 3rd IET International Conference on Intelligent Environments, pp. 255\u201059.","DOI":"10.1049\/cp:20070378"},{"key":"key2022032120310160700_b35","unstructured":"Zhang, W., He, L., Chow, Y., Yang, R. and Su, Y. (2000), \u201cThe study on distributed speech recognition system\u201d, Proceedings of the IEEE International Conference on Acoustical Speech and Signal Processing, Istanbul, pp. 1431\u201034."}],"container-title":["International Journal of Pervasive Computing and Communications"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/17427370910991884","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/17427370910991884\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/17427370910991884\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:24:14Z","timestamp":1753403054000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ijpcc\/article\/5\/3\/332-359\/163038"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,9,4]]},"references-count":35,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2009,9,4]]}},"alternative-id":["10.1108\/17427370910991884"],"URL":"https:\/\/doi.org\/10.1108\/17427370910991884","relation":{},"ISSN":["1742-7371"],"issn-type":[{"type":"print","value":"1742-7371"}],"subject":[],"published":{"date-parts":[[2009,9,4]]}}}