{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T22:53:39Z","timestamp":1767653619181,"version":"3.48.0"},"reference-count":45,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2020,6,24]],"date-time":"2020-06-24T00:00:00Z","timestamp":1592956800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:p>Mobile devices are the technological basis of computational intelligent systems, yet traditional mobile application interfaces tend to rely only on the touch modality. That said, such interfaces could improve human\u2013computer interaction by combining diverse interaction modalities, such as visual, auditory and touch. Also, a lot of information on the Web is published under the Linked Data principles to allow people and computers to share, use and\/or reuse high-quality information; however, current tools for searching for, browsing and visualising this kind of data are not fully developed. The goal of this research is to propose a novel architecture called NaLa-Search to effectively explore the Linked Open Data cloud. We present a mobile application that combines voice commands and touch for browsing and searching for such semantic information through faceted search, which is a widely used interaction scheme for exploratory search that is faithful to its richness and practical for real-world use. NaLa-Search was evaluated by real users from the clinical pharmacology domain. In this evaluation, the users had to search and navigate among the DrugBank dataset through voice commands. The evaluation results show that faceted search combined with multiple interaction modalities (e.g. speech and touch) can enhance users\u2019 interaction with semantic knowledge bases.<\/jats:p>","DOI":"10.1177\/0165551520930918","type":"journal-article","created":{"date-parts":[[2020,6,24]],"date-time":"2020-06-24T12:34:25Z","timestamp":1593002065000},"page":"753-769","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":6,"title":["NaLa-Search: A multimodal, interaction-based architecture for faceted search on linked open data"],"prefix":"10.1177","volume":"47","author":[{"given":"Jos\u00e9 Luis","family":"S\u00e1nchez-Cervantes","sequence":"first","affiliation":[{"name":"CONACYT-Tecnol\u00f3gico Nacional de M\u00e9xico\/I.T. Orizaba, Division of Research and Postgraduate Studies, Orizaba, Mexico"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3296-0981","authenticated-orcid":false,"given":"Giner","family":"Alor-Hern\u00e1ndez","sequence":"additional","affiliation":[{"name":"Tecnol\u00f3gico Nacional de M\u00e9xico\/I.T. Orizaba, Division of Research and Postgraduate Studies, Orizaba, Mexico"}]},{"given":"Mario Andr\u00e9s","family":"Paredes-Valverde","sequence":"additional","affiliation":[{"name":"Tecnol\u00f3gico Nacional de M\u00e9xico\/I.T. Orizaba, Division of Research and Postgraduate Studies, Orizaba, Mexico"}]},{"given":"Lisbeth","family":"Rodr\u00edguez-Mazahua","sequence":"additional","affiliation":[{"name":"Tecnol\u00f3gico Nacional de M\u00e9xico\/I.T. Orizaba, Division of Research and Postgraduate Studies, Orizaba, Mexico"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2457-1791","authenticated-orcid":false,"given":"Rafael","family":"Valencia-Garc\u00eda","sequence":"additional","affiliation":[{"name":"Departamento de Inform\u00e1tica y Sistemas, Facultad de Inform\u00e1tica, Universidad de Murcia, Campus de Espinardo, 30100 Murcia, Spain"}]}],"member":"179","published-online":{"date-parts":[[2020,6,24]]},"reference":[{"key":"e_1_3_4_2_2","doi-asserted-by":"crossref","DOI":"10.1075\/nlp.5","volume-title":"Natural language processing for online applications: text retrieval, extraction and categorization","author":"Jackson P","year":"2007","unstructured":"Jackson P, Moulinier I. Natural language processing for online applications: text retrieval, extraction and categorization, vol. 5. 2nd ed. Wolverhampton: John Benjamins Publishing, 2007.","edition":"2"},{"key":"e_1_3_4_3_2","volume-title":"Natural language understanding","author":"Allen J","year":"1995","unstructured":"Allen J. Natural language understanding. 2nd ed. Redwood City, CA: Benjamin-Cummings Publishing, 1995.","edition":"2"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.2200\/S00174ED1V01Y200901ICR003"},{"issue":"1","key":"e_1_3_4_5_2","first-page":"1","article-title":"Faceted search","volume":"1","author":"Tunkelang D","year":"2009","unstructured":"Tunkelang D. Faceted search. Synth Lect Inf Concepts Retrieval Serv 2009; 1(1): 1\u201380.","journal-title":"Synth Lect Inf Concepts Retrieval Serv"},{"key":"e_1_3_4_6_2","unstructured":"English J Hearst M Sinha R et al. Flexible search and navigation using faceted metadata 2002 http:\/\/bailando.sims.berkeley.edu\/papers\/flamenco02.pdf"},{"key":"e_1_3_4_7_2","unstructured":"Berners-Lee T. Linked Data \u2013 design issues. Linked Data 2006. https:\/\/www.w3.org\/DesignIssues\/LinkedData.html"},{"key":"e_1_3_4_8_2","first-page":"197","volume-title":"Proceedings of the international working conference on advanced visual interfaces","author":"Cutugno F","unstructured":"Cutugno F, Leano VA, Rinaldi R, et al. Multimodal framework for mobile interaction. In: Proceedings of the international working conference on advanced visual interfaces, Capri Island, 21\u201325 May 2012, pp. 197\u2013203. New York: ACM."},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/93.556457"},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2013.07.003"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2013.05.023"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2012.04.001"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.csi.2012.11.002"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2014.09.087"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11036-014-0561-4"},{"key":"e_1_3_4_16_2","first-page":"2016","article-title":"A natural language interface concordant with a knowledge base","volume":"9174683","author":"Han Y-J","year":"2016","unstructured":"Han Y-J, Park S-B, Park S-Y. A natural language interface concordant with a knowledge base. Comput Intell Neurosci 2016; 2016: 9174683.","journal-title":"Comput Intell Neurosci"},{"key":"e_1_3_4_17_2","first-page":"96","volume-title":"IEEE workshop on speech, language and audio in multimedia (SLAM) workshop","author":"Heck L","unstructured":"Heck L, Hakkani-Tur D, Chinthakunta M, et al. Multimodal conversational search and browse. In: IEEE workshop on speech, language and audio in multimedia (SLAM) workshop, Marseille, 22\u201323 August 2013, pp. 96\u2013101. New York: IEEE."},{"key":"e_1_3_4_18_2","doi-asserted-by":"crossref","unstructured":"Zanibbi R Orakwue A. Math search for the masses: multimodal search interfaces and appearance-based retrieval 2015 https:\/\/arxiv.org\/abs\/1505.02798","DOI":"10.1007\/978-3-319-20615-8_2"},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.12.070"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.02.034"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.10.110"},{"key":"e_1_3_4_22_2","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/978-3-319-07227-2_3","volume-title":"Human-computer interaction: applications and services","author":"Khokale R","year":"2014","unstructured":"Khokale R, Atique M. Intelligent interface for Web information retrieval with document understanding. In: Kurosu M (ed.) Human-computer interaction: applications and services (SE \u2013 3), vol. 8512. Berlin: Springer, 2014, pp. 21\u201331."},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2014.10.002"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2012.12.003"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2013.10.004"},{"key":"e_1_3_4_26_2","unstructured":"McCrae JP. The Linked Open Data Cloud 2017. Retrieved June 13 2020 from https:\/\/lod-cloud.net\/"},{"key":"e_1_3_4_27_2","first-page":"477","volume-title":"Proceeding of the 17th international conference on World Wide Web \u2013 WWW\u201908","author":"Koren J","unstructured":"Koren J, Zhang Y, Liu X. Personalized interactive faceted search. In: Proceeding of the 17th international conference on World Wide Web \u2013 WWW\u201908, Beijing, China, 21\u201325 April 2008, p. 477. New York: ACM."},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1177\/0165551515616311"},{"key":"e_1_3_4_29_2","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1007\/978-3-642-41242-4_45","volume-title":"The semantic Web: ESWC 2013 satellite events","author":"Marie N","year":"2013","unstructured":"Marie N, Gandon F, Ribi\u00e8re M. Exploratory search on the top of DBpedia chapters with the discovery hub application. In: Cimiano P, Fern\u00e1ndez M, Lopez V, et al. (eds) The semantic Web: ESWC 2013 satellite events (SE \u2013 45), vol. 7955. Berlin: Springer, 2013, pp. 287\u2013288."},{"key":"e_1_3_4_30_2","first-page":"175","volume-title":"Proceedings of the companion publication of the 23rd international conference on World Wide Web companion","author":"Stadler C","unstructured":"Stadler C, Martin M, Auer S. Exploring the Web of spatial data with Facete. In: Proceedings of the companion publication of the 23rd international conference on World Wide Web companion, Seoul, Korea, 7\u201311 April 2014, pp. 175\u2013178. New York: ACM."},{"key":"e_1_3_4_31_2","first-page":"6","article-title":"Humboldt: exploring linked data","volume":"7","author":"Kobilarov G","year":"2008","unstructured":"Kobilarov G, Dickinson I. Humboldt: exploring linked data. Context 2008; 6: 7.","journal-title":"Context"},{"key":"e_1_3_4_32_2","first-page":"217","volume-title":"18th international workshop on database and expert systems applications DEXA\u201907","author":"Stefaner M","unstructured":"Stefaner M, Muller B. Elastic lists for facet browsers. In: 18th international workshop on database and expert systems applications DEXA\u201907, Regensburg, 3\u20137 September 2007, pp. 217\u2013221. New York: IEEE."},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10844-016-0413-8"},{"issue":"194","key":"e_1_3_4_34_2","first-page":"4","article-title":"SUS-A Quick and Dirty Usability Scale","volume":"189","author":"Brooke J","year":"1996","unstructured":"Brooke J. SUS-A Quick and Dirty Usability Scale. Usability Eval Ind 1996; 189(194): 4\u20137.","journal-title":"Usability Eval Ind"},{"key":"e_1_3_4_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2015.2476458"},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-49381-6_19"},{"key":"e_1_3_4_37_2","first-page":"49","volume-title":"2015 3rd international conference on information and communication technology (ICoICT)","author":"Sidiq M","unstructured":"Sidiq M, Budi WTA, Sa\u2019adah S. Vomma: android application launcher using voice command. In: 2015 3rd international conference on information and communication technology (ICoICT), Nusa Dua, Indonesia, 27\u201329 May 2015, pp. 49\u201353. New York: IEEE."},{"issue":"2","key":"e_1_3_4_38_2","first-page":"29","article-title":"SUS: a retrospective","volume":"8","author":"Brooke J","year":"2013","unstructured":"Brooke J. SUS: a retrospective. J Usability Stud 2013; 8(2): 29\u201340.","journal-title":"J Usability Stud"},{"key":"e_1_3_4_39_2","doi-asserted-by":"publisher","DOI":"10.1504\/IJMSO.2012.048508"},{"key":"e_1_3_4_40_2","first-page":"20","volume-title":"Proceedings of the 9th Indian conference on human computer interaction","author":"Bhikne B","unstructured":"Bhikne B, Joshi A, Joshi M, et al. How much faster can you type by speaking in Hindi? Comparing keyboard-only and keyboard+speech text entry. In: Proceedings of the 9th Indian conference on human computer interaction, Bangalore, India, 16\u201318 December 2018, pp. 20\u201328. New York: ACM."},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3161187"},{"key":"e_1_3_4_42_2","unstructured":"Ruan S Wobbrock JO Liou K et al. Speech is 3x faster than typing for english and mandarin text entry on mobile devices. arXiv Prepr.arXiv1608.07323 2016."},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2016.06.006"},{"key":"e_1_3_4_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2017.05.001"},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/792550.792552"},{"key":"e_1_3_4_46_2","first-page":"829","volume-title":"Proceedings of the 15th international conference on World Wide Web","author":"Dai H","unstructured":"Dai H, Zhao L, Nie Z, et al. Detecting online commercial intention (OCI). In: Proceedings of the 15th international conference on World Wide Web, Edinburgh, 23\u201326 May 2006, pp. 829\u2013837. New York: ACM."}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0165551520930918","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0165551520930918","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0165551520930918","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T22:51:30Z","timestamp":1767653490000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0165551520930918"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,24]]},"references-count":45,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.1177\/0165551520930918"],"URL":"https:\/\/doi.org\/10.1177\/0165551520930918","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"type":"print","value":"0165-5515"},{"type":"electronic","value":"1741-6485"}],"subject":[],"published":{"date-parts":[[2020,6,24]]}}}