{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:34:28Z","timestamp":1760243668881,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2012,5,11]],"date-time":"2012-05-11T00:00:00Z","timestamp":1336694400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Current \u201cInternet of Things\u201d concepts point to a future where connected objects gather meaningful information about their environment and share it with other objects and people. In particular, objects embedding Human Machine Interaction (HMI), such as mobile devices and, increasingly, connected vehicles, home appliances, urban interactive infrastructures, etc., may not only be conceived as sources of sensor information, but, through interaction with their users, they can also produce highly valuable context-aware human-generated observations. We believe that the great promise offered by combining and sharing all of the different sources of information available can be realized through the integration of HMI and Semantic Sensor Web technologies. This paper presents a technological framework that harmonizes two of the most influential HMI and Sensor Web initiatives: the W3C\u2019s Multimodal Architecture and Interfaces (MMI) and the Open Geospatial Consortium (OGC) Sensor Web Enablement (SWE) with its semantic extension, respectively. Although the proposed framework is general enough to be applied in a variety of connected objects integrating HMI, a particular development is presented for a connected car scenario where drivers\u2019 observations about the traffic or their environment are shared across the Semantic Sensor Web. For implementation and evaluation purposes an on-board OSGi (Open Services Gateway Initiative) architecture was built, integrating several available HMI, Sensor Web and Semantic Web technologies. A technical performance test and a conceptual validation of the scenario with potential users are reported, with results suggesting the approach is sound.<\/jats:p>","DOI":"10.3390\/s120506307","type":"journal-article","created":{"date-parts":[[2012,5,11]],"date-time":"2012-05-11T11:06:37Z","timestamp":1336734397000},"page":"6307-6330","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Sharing Human-Generated Observations by Integrating HMI and the Semantic Sensor Web"],"prefix":"10.3390","volume":"12","author":[{"given":"\u00c1lvaro","family":"Sig\u00fcenza","sequence":"first","affiliation":[{"name":"ETSI Telecomunicaci\u00f3n, Universidad Polit\u00e9cnica de Madrid, Avenida Complutense 30, E-28040 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"D\u00edaz-Pardo","sequence":"additional","affiliation":[{"name":"ETSI Telecomunicaci\u00f3n, Universidad Polit\u00e9cnica de Madrid, Avenida Complutense 30, E-28040 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jes\u00fas","family":"Bernat","sequence":"additional","affiliation":[{"name":"Telef\u00f3nica Investigaci\u00f3n y Desarrollo, Distrito C. Edificio Oeste 1, Ronda de la Comunicaci\u00f3n, s\/n, 28050 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vasile","family":"Vancea","sequence":"additional","affiliation":[{"name":"ETSI Telecomunicaci\u00f3n, Universidad Polit\u00e9cnica de Madrid, Avenida Complutense 30, E-28040 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jos\u00e9 Luis","family":"Blanco","sequence":"additional","affiliation":[{"name":"ETSI Telecomunicaci\u00f3n, Universidad Polit\u00e9cnica de Madrid, Avenida Complutense 30, E-28040 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Conejero","sequence":"additional","affiliation":[{"name":"Telef\u00f3nica Investigaci\u00f3n y Desarrollo, Distrito C. Edificio Oeste 1, Ronda de la Comunicaci\u00f3n, s\/n, 28050 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luis","family":"Hern\u00e1ndez G\u00f3mez","sequence":"additional","affiliation":[{"name":"ETSI Telecomunicaci\u00f3n, Universidad Polit\u00e9cnica de Madrid, Avenida Complutense 30, E-28040 Madrid, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2012,5,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1038\/scientificamerican0991-94","article-title":"The computer for the 21st century","volume":"265","author":"Weiser","year":"1991","journal-title":"Sci. Am."},{"key":"ref_2","unstructured":"Sundmaeker, H., Guillermin, P., Friess, P., and Woelffl\u00e9, S (2010). Cluster of European Research Projects on the Internet of Things (CERP-IoT), Brussels."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2652","DOI":"10.3390\/s110302652","article-title":"New generation sensor web enablement","volume":"11","author":"Echterhoff","year":"2011","journal-title":"Sensors"},{"key":"ref_4","unstructured":"Sensorpedia Available online: http:\/\/www.sensorpedia.com\/ (accessed on 2 May 2012)."},{"key":"ref_5","unstructured":"Sensormap Available online: atom.research.microsoft.com\/sensewebv3\/sensormap\/ (accessed on 2 May 2012)."},{"key":"ref_6","unstructured":"Sensorbase Available online: sensorbase.org (accessed on 6 June 2011)."},{"key":"ref_7","unstructured":"Pachube Available online: www.pachube.com (accessed on 2 May 2012)."},{"key":"ref_8","unstructured":"OGC Open Geospatial Consortium, Inc Sensor Web Enablement (SWE). Available online: www.opengeospatial.org\/projects\/groups\/sensorweb (accessed on 28 February 2012)."},{"key":"ref_9","unstructured":"Knoesis Center, Semantic Sensor Web Project Available online: http:\/\/wiki.knoesis.org\/index.php\/SSW (accessed on 28 February 2012)."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/MIC.2008.87","article-title":"Semantic sensor web","volume":"12","author":"Sheth","year":"2008","journal-title":"IEEE Int. Comput."},{"key":"ref_11","unstructured":"Sig\u00fcenza, A., Blanco, J.L., Bernat, J., and Hern\u00e1ndez, L (2010, January 7\u201311). Using SCXML for Semantic Sensor Networks. Shanghai, China."},{"key":"ref_12","unstructured":"MARTA Project Available online: www.cenitmarta.org (accessed on 6 June 2011)."},{"key":"ref_13","unstructured":"Foerster, T., Jirka, S., Stasch, C., Pross, B., Everding, T., Br\u00f6ring, A., and Juerrens, E.H. (2010, January 20). Integrating Human Observations and Sensor Observations\u2014the Example of a Noise Mapping Community. Berlin, Germany."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sig\u00fcenza, A., Pardo, D., Blanco, J.L., Bernat, J., Garijo, M., and Hern\u00e1ndez, L (2012). Bridging the semantic sensor web and multimodal human-machine interaction using SCXML. Int. J. Sens. Wirel. Commun. Control Spec. Issue Semant. Sens. Netw., in press.","DOI":"10.2174\/2210327911202010027"},{"key":"ref_15","unstructured":"W3C Multimodal Architecture and Interfaces. Available online: http:\/\/www.w3.org\/TR\/mmi-arch\/ (accessed on 28 February 2012)."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jirka, S., Br\u00f6ring, A., and Foerster, T (2010, January 17\u201321). Handling the Semantics of Sensor Observables within SWE Discovery Solutions. Chicago, IL, USA.","DOI":"10.1109\/CTS.2010.5478495"},{"key":"ref_17","unstructured":"McGlaun, G., Althoff, F., Lang, M., and Rigoll, G. (2003, January 27\u201330). Towards Multimodal Error Management: Experimental Evaluation of User Strategies in Event of Faulty Application Behavior in Automotive Environments. Orlando, FL, USA."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Pieraccini, R., Dayanidhi, K., Bloom, J., Dahan, J., Phillips, M., Goodman, B.R., and Prasad, K.V. (2003, January 1\u20134). A Multimodal Conversational Interface for a Concept Vehicle. Geneva, Switzerland.","DOI":"10.1037\/e741632011-002"},{"key":"ref_19","unstructured":"Amditis, A., Kussmann, H., Polynchronopoulos, A., Engstr\u00f6m, J., and Andreone, L (2006, January 13\u201315). System Architecture for Integrated Adaptive HMI Solutions. Tokyo, Japan."},{"key":"ref_20","first-page":"1539","article-title":"A context model based on ontological languages: A proposal for information visualization","volume":"16","author":"Bravo","year":"2010","journal-title":"J. Univ. Comput. Sci."},{"key":"ref_21","unstructured":"Nelson, E. (2004, January 10\u201312). Defining interfaces as Services in Embedded Vehicle Software, Research and Advanced Engineering. San Diego, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s10708-007-9111-y","article-title":"Citizens as sensors: The world of volunteered geography","volume":"69","author":"Goodchild","year":"2007","journal-title":"GeoJournal"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hoch, S., Schweigert, M., Althoff, F., and Rigoll, G. (2007, January 13\u201315). The BMW SURF Project: A Contribution to the Research on Cognitive Vehicles. Istambul, Turkey.","DOI":"10.1109\/IVS.2007.4290197"},{"key":"ref_24","unstructured":"OSGi Alliance OSGi Service Platform Release 3. Available online: http:\/\/www.osgi.org\/Download\/File?url=\/download\/r3\/r3.book.pdf (accessed on 28 February 2012)."},{"key":"ref_25","unstructured":"W3C State Chart XML (SCXML): State Machine Notation for Control Abstraction. Available online: http:\/\/www.w3.org\/TR\/scxml\/ (accessed on 28 February 2012)."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/0167-6423(87)90035-9","article-title":"Statecharts: A visual formalism for complex systems","volume":"8","author":"Harel","year":"1987","journal-title":"Sci. Comput. Program."},{"key":"ref_27","unstructured":"W3C Voice Extensible Markup Language (VoiceXML) 3.0. Available online: http:\/\/www.w3.org\/TR\/voicexml30\/ (accessed on 28 February 2012)."},{"key":"ref_28","unstructured":"Salvatore, F.P., and Carlos, E.P. (2010, January 27\u201328). Using SCXML to Integrate Semantic Sensor Information into Context-Aware User Interfaces. Valencia, Spain."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1049\/iet-its:20060052","article-title":"Speech and driving-solution or problem?","volume":"1","author":"Vollrath","year":"2007","journal-title":"Intell. Trans. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1754393.1754397","article-title":"Using probabilistic confidence models for trust inference in Web-based social networks","volume":"10","author":"Kuter","year":"2010","journal-title":"J. ACM Trans. Int. Technol. (TOIT)"},{"key":"ref_31","first-page":"1521","article-title":"An ambient assisted living platform integrating RFID data-on-tag care annotations and twitter","volume":"16","year":"2010","journal-title":"J. Univ. Comput. Sci."},{"key":"ref_32","unstructured":"Ke\u00dfler, C., and Janowicz, K. (2010, January 7\u201311). Linking Sensor Data\u2013Why, to What, and How?. Shanghai, China."},{"key":"ref_33","unstructured":"W3C Resource Description Framework (RDF). Available online: http:\/\/www.w3.org\/RDF\/ (accessed on 28 February 2012)."},{"key":"ref_34","first-page":"1","article-title":"Linked data-the story so far","volume":"5","author":"Bizer","year":"2009","journal-title":"Int. J. Semantic Web Inf. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Henson, C.A., Pschorr, J.K., Sheth, A.P., and Thuirunarayan, K. (2009, January 18\u201322). SemSOS: Semantic Sensor Observation Service. Baltimore, MD, USA.","DOI":"10.1109\/CTS.2009.5067461"},{"key":"ref_36","unstructured":"W3C OWL Web Ontology Language. Available online: http:\/\/www.w3.org\/2004\/OWL\/ (accessed on 28 February 2012)."},{"key":"ref_37","unstructured":"DBpedia Available online: dbpedia.org (accesed on 2 May 2012)."},{"key":"ref_38","unstructured":"Prud'hommeaux, E., and Seaborne, A. SPARQL Query Language for RDF. Available online: http:\/\/www.w3.org\/TR\/rdf-sparql-query\/ (accessed on 28 February 2012)."},{"key":"ref_39","unstructured":"Apache Commons SCXML Available online: http:\/\/commons.apache.org\/scxml\/ (accessed on 2 May 2012)."},{"key":"ref_40","unstructured":"Sesame RDF Schema Querying and Storage. Available online: http:\/\/www.openrdf.org (accessed on 28 February 2012)."},{"key":"ref_41","unstructured":"Cyganiak, R., and Bizer, C. Pubby\u2014A Linked Data Frontend for SPARQL Endpoints. Available online: http:\/\/www4.wiwiss.fu-berlin.de\/pubby (accessed on 28 February 2012)."},{"key":"ref_42","unstructured":"Vdrift Available online: http:\/\/vdrift.net (accessed on 2 May 2012)."},{"key":"ref_43","unstructured":"Blanco, J.L., Sig\u00fcenza, A., D\u00edaz, D., Sendra, M., and Hern\u00e1ndez, L (2009, January 23\u201326). Reworking Spoken Dialogue Systems with Context Awareness and Information Prioritisation to Reduce Driver Workload. Rotterdam, Netherlands."},{"key":"ref_44","unstructured":"Nishimoto, T., Shioya, M., Takahasi, J., and Daigo, H. (2005, January 2\u20133). A Study of Dialogue Management Principles Corresponding to the Driver's Workload. Sesimbra, Portugal."},{"key":"ref_45","unstructured":"(2010). Road vehicles\u2014Ergonomic aspects of transport information and control systems\u2014Simulated lane change test to assess in-vehicle secondary task demand, International Organization for Standardization."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/12\/5\/6307\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:50:15Z","timestamp":1760219415000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/12\/5\/6307"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,5,11]]},"references-count":45,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2012,5]]}},"alternative-id":["s120506307"],"URL":"https:\/\/doi.org\/10.3390\/s120506307","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2012,5,11]]}}}