{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T12:59:38Z","timestamp":1773147578830,"version":"3.50.1"},"reference-count":54,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2019,8,9]],"date-time":"2019-08-09T00:00:00Z","timestamp":1565308800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002878","name":"Consejer\u00eda de Econom\u00eda, Innovaci\u00f3n, Ciencia y Empleo, Junta de Andaluc\u00eda","doi-asserted-by":"publisher","award":["TEP2012-530"],"award-info":[{"award-number":["TEP2012-530"]}],"id":[{"id":"10.13039\/501100002878","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Olfaction is a valuable source of information about the environment that has not been sufficiently exploited in mobile robotics yet. Certainly, odor information can contribute to other sensing modalities, e.g., vision, to accomplish high-level robot activities, such as task planning or execution in human environments. This paper organizes and puts together the developments and experiences on combining olfaction and vision into robotics applications, as the result of our five-years long project IRO: Improvement of the sensory and autonomous capability of Robots through Olfaction. Particularly, it investigates mechanisms to exploit odor information (usually coming in the form of the type of volatile and its concentration) in problems such as object recognition and scene\u2013activity understanding. A distinctive aspect of this research is the special attention paid to the role of semantics within the robot perception and decision-making processes. The obtained results have improved the robot capabilities in terms of efficiency, autonomy, and usefulness, as reported in our publications.<\/jats:p>","DOI":"10.3390\/s19163488","type":"journal-article","created":{"date-parts":[[2019,8,9]],"date-time":"2019-08-09T11:11:31Z","timestamp":1565349091000},"page":"3488","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Olfaction, Vision, and Semantics for Mobile Robots. Results of the IRO Project"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7869-7811","authenticated-orcid":false,"given":"Javier","family":"Monroy","sequence":"first","affiliation":[{"name":"Machine Perception and Intelligent Robotics group (MAPIR), Dept. of System Engineering and Automation Biomedical Research Institute of Malaga (IBIMA), University of Malaga, 29071 M\u00e1laga, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9929-5309","authenticated-orcid":false,"given":"Jose-Raul","family":"Ruiz-Sarmiento","sequence":"additional","affiliation":[{"name":"Machine Perception and Intelligent Robotics group (MAPIR), Dept. of System Engineering and Automation Biomedical Research Institute of Malaga (IBIMA), University of Malaga, 29071 M\u00e1laga, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2997-7571","authenticated-orcid":false,"given":"Francisco-Angel","family":"Moreno","sequence":"additional","affiliation":[{"name":"Machine Perception and Intelligent Robotics group (MAPIR), Dept. of System Engineering and Automation Biomedical Research Institute of Malaga (IBIMA), University of Malaga, 29071 M\u00e1laga, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2922-1969","authenticated-orcid":false,"given":"Cipriano","family":"Galindo","sequence":"additional","affiliation":[{"name":"Machine Perception and Intelligent Robotics group (MAPIR), Dept. of System Engineering and Automation Biomedical Research Institute of Malaga (IBIMA), University of Malaga, 29071 M\u00e1laga, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3845-3497","authenticated-orcid":false,"given":"Javier","family":"Gonzalez-Jimenez","sequence":"additional","affiliation":[{"name":"Machine Perception and Intelligent Robotics group (MAPIR), Dept. of System Engineering and Automation Biomedical Research Institute of Malaga (IBIMA), University of Malaga, 29071 M\u00e1laga, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Shepherd, G.M. (2004). The human sense of smell: Are we better than we think?. PLoS Biol., 2.","DOI":"10.1371\/journal.pbio.0020146"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1007\/s12369-013-0178-y","article-title":"Social Robots for Long-Term Interaction: A Survey","volume":"5","author":"Leite","year":"2013","journal-title":"Int. J. Soc. Robot."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1109\/TCDS.2017.2751963","article-title":"\u201cTo Approach Humans?\u201d: A Unified Framework for Approaching Pose Prediction and Socially Aware Robot Navigation","volume":"10","author":"Truong","year":"2018","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Palac\u00edn, J., Mart\u00ednez, D., Clotet, E., Pallej\u00e0, T., Burgu\u00e9s, J., Fonollosa, J., Pardo, A., and Marco, S. (2019). Application of an array of Metal-Oxide Semiconductor gas sensors in an assistant personal robot for early gas leak detection. Sensors, 19.","DOI":"10.3390\/s19091957"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1016\/j.snb.2018.08.125","article-title":"Investigation of the response of high-bandwidth MOX sensors to gas plumes for application on a mobile robot in hazardous environments","volume":"279","author":"Vincent","year":"2019","journal-title":"Sens. Actuators B Chem."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1021\/cr068121q","article-title":"Electronic nose: Current status and future trends","volume":"108","author":"Barsan","year":"2008","journal-title":"Chem. Rev."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.chemolab.2016.08.011","article-title":"Continuous Chemical Classification in Uncontrolled Environments with Sliding Windows","volume":"158","author":"Monroy","year":"2016","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5427693","DOI":"10.1155\/2018\/5427693","article-title":"An Electronic Architecture for Multi-Purpose Artificial Noses","volume":"2018","author":"Gongora","year":"2018","journal-title":"J. Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sanchez-Garrido, C., Monroy, J., and Gonzalez-Jimenez, J. (2014, January 2\u20135). A Configurable Smart E-Nose for Spatio-Temporal Olfactory Analysis. Proceedings of the IEEE Sensors, Valencia, Spain.","DOI":"10.1109\/ICSENS.2014.6985418"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Monroy, J., and Gonzalez-Jimenez, J. (2018). Towards Odor-Sensitive Mobile Robots. Electronic Nose Technologies and Advances in Machine Olfaction, IGI Global.","DOI":"10.4018\/978-1-5225-3862-2.ch012"},{"key":"ref_11","unstructured":"Ruiz-Sarmiento, J.R., Galindo, C., and Gonzalez-Jimenez, J. (December, January 29). Probability and Common-Sense: Tandem Towards Robust Robotic Object Recognition in Ambient Assisted Living. Proceedings of the 10th International Conference on Ubiquitous Computing and Ambient Intelligence, Las Palmas de Gran Canaria, Spain."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1016\/j.robot.2012.12.007","article-title":"Inferring robot goals from violations of semantic knowledge","volume":"61","author":"Galindo","year":"2013","journal-title":"Robot. Auton. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/3477.790446","article-title":"A method for evaluating data-preprocessing techniques for odour classification with an array of gas sensors","volume":"29","author":"Nagle","year":"1999","journal-title":"IEEE Trans. Syst. Man Cybern. Part B"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1021\/acssensors.6b00008","article-title":"E-nose sensing of low-ppb formaldehyde in gas mixtures at high relative humidity for breath screening of lung cancer","volume":"1","author":"Gunter","year":"2016","journal-title":"Acs Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1016\/j.snb.2013.06.053","article-title":"Probabilistic Gas Quantification with MOX Sensors in Open Sampling Systems\u2014A Gaussian Process Approach","volume":"188","author":"Monroy","year":"2013","journal-title":"Sens. Actuators B Chem."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1016\/j.snb.2013.11.005","article-title":"Highly sensitive and selective gas sensors using p-type oxide semiconductors: Overview","volume":"192","author":"Kim","year":"2014","journal-title":"Sens. Actuators B Chem."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"203101","DOI":"10.1063\/1.2203932","article-title":"Ultrasensitive and highly selective gas sensors using three-dimensional tungsten oxide nanowire networks","volume":"88","author":"Ponzoni","year":"2006","journal-title":"Appl. Phys. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.jpba.2014.08.030","article-title":"Qualitative and quantitative analysis on aroma characteristics of ginseng at different ages using E-nose and GC\u2013MS combined with chemometrics","volume":"102","author":"Cui","year":"2015","journal-title":"J. Pharm. Biomed. Anal."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"13664","DOI":"10.3390\/s121013664","article-title":"Overcoming the slow recovery of MOX gas sensors through a system modeling approach","volume":"12","author":"Monroy","year":"2012","journal-title":"Sensors"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"6145","DOI":"10.3390\/s110606145","article-title":"The Multi-Chamber Electronic Nose\u2013An Improved Olfaction Sensor for Mobile Robotics","volume":"11","author":"Monroy","year":"2011","journal-title":"Sensors"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Coradeschi, S., Cesta, A., Cortellessa, G., Coraci, L., Galindo, C., Gonzalez-Jimenez, J., Karlsson, L., Forsberg, A., Frennert, S., and Furfari, F. (2014). GiraffPlus: A System for Monitoring Activities and Physiological Parameters and Promoting Social Interaction for Elderly. Human-Computer Systems Interaction: Backgrounds and Applications 3, Springer.","DOI":"10.1007\/978-3-319-08491-6_22"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Luperto, M., Monroy, J., Ruiz-Sarmiento, J.R., Moreno, F.A., Basilico, N., Gonzalez-Jimenez, J., and Borghese, N.A. (2019, January 4\u20136). Towards Long-Term Deployment of a Mobile Robot for at-Home Ambient Assisted Living of the Elderly. Proceedings of the European Conference on Mobile Robots, Prague, Czech Republic.","DOI":"10.1109\/ECMR.2019.8870924"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.snb.2009.03.018","article-title":"Odour classification system for continuous monitoring applications","volume":"139","author":"Trincavelli","year":"2009","journal-title":"Sens. Actuators B Chem."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1016\/j.envsoft.2004.04.012","article-title":"Determination of the relationship between sewage odour and BOD by neural networks","volume":"20","author":"Demir","year":"2005","journal-title":"Environ. Model. Softw."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Monroy, J., Gonzalez-Jimenez, J., and Sanchez-Garrido, C. (2014, January 2\u20135). Monitoring Household Garbage Odors in Urban Areas Through Distribution Maps. Proceedings of the IEEE Sensors, Valencia, Spain.","DOI":"10.1109\/ICSENS.2014.6985265"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1016\/j.pmcj.2014.11.008","article-title":"Deriving high-resolution urban air pollution maps using mobile sensor nodes","volume":"16","author":"Hasenfratz","year":"2015","journal-title":"Pervasive Mob. Comput."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2753","DOI":"10.1109\/TBME.2010.2055864","article-title":"A novel breath analysis system based on electronic olfaction","volume":"57","author":"Guo","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1016\/S0196-0644(84)80517-X","article-title":"Accuracy and usefulness of a breath alcohol analyzer","volume":"13","author":"Gibb","year":"1984","journal-title":"Ann. Emerg. Med."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1152\/jappl.1998.84.2.401","article-title":"The alcohol breath test\u2014A review","volume":"84","author":"Hlastala","year":"1998","journal-title":"J. Appl. Physiol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/S0040-6090(02)00593-X","article-title":"Olfaction-based mobile robot navigation","volume":"418","author":"Marques","year":"2002","journal-title":"Thin Solid Film."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1016\/j.snb.2013.05.027","article-title":"On the performance of gas sensor arrays in open sampling systems using Inhibitory Support Vector Machines","volume":"185","author":"Vergara","year":"2013","journal-title":"Sens. Actuators B Chem."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1007\/s13218-011-0104-0","article-title":"Gas discrimination for mobile robots","volume":"25","author":"Trincavelli","year":"2011","journal-title":"KI-K\u00fcnst. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.engappai.2010.09.007","article-title":"A review on time series data mining","volume":"24","author":"Fu","year":"2011","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1007\/s10044-014-0442-2","article-title":"Odor recognition in robotics applications by discriminative time-series modeling","volume":"19","author":"Schleif","year":"2016","journal-title":"Pattern Anal. Appl."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1205","DOI":"10.1016\/j.snb.2016.09.013","article-title":"Gas Classification in Motion: An Experimental Analysis","volume":"240","author":"Monroy","year":"2017","journal-title":"Sens. Actuators B. Chem."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1016\/j.cviu.2010.02.004","article-title":"Context Based Object Categorization: A Critical Survey","volume":"114","author":"Galleguillos","year":"2010","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1016\/j.tics.2007.09.009","article-title":"The role of context in object recognition","volume":"11","author":"Oliva","year":"2007","journal-title":"Trends Cogn. Sci."},{"key":"ref_38","unstructured":"Koller, D., and Friedman, N. (2009). Probabilistic Graphical Models: Principles and Techniques-Adaptive Computation and Machine Learning, The MIT Press."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1017\/S0269888900007797","article-title":"Ontologies: Principles, methods and applications","volume":"11","author":"Uschold","year":"1996","journal-title":"Knowl. Eng. Rev."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1016\/j.ijar.2016.10.009","article-title":"A survey on learning approaches for Undirected Graphical Models. Application to scene object recognition","volume":"83","author":"Galindo","year":"2017","journal-title":"Int. J. Approx. Reason."},{"key":"ref_41","unstructured":"Murphy, K.P., Weiss, Y., and Jordan, M.I. (August, January 30). Loopy Belief Propagation for Approximate Inference: An Empirical Study. Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, Stockholm, Sweden."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1177\/0278364917695640","article-title":"Robot@Home, a robotic dataset for semantic mapping of home environments","volume":"36","author":"Galindo","year":"2017","journal-title":"Int. J. Robot. Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.knosys.2016.12.016","article-title":"Building Multiversal Semantic Maps for Mobile Robot Operation","volume":"119","author":"Galindo","year":"2017","journal-title":"Knowl. Based Syst."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Galindo, C., Saffiotti, A., Coradeschi, S., Buschka, P., Fernandez-Madrigal, J.A., and Gonzalez, J. (2005, January 2\u20136). Multi-hierarchical semantic maps for mobile robotics. Proceedings of the 2005 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada.","DOI":"10.1109\/IROS.2005.1545511"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.robot.2014.12.006","article-title":"Semantic mapping for mobile robotics tasks: A survey","volume":"66","author":"Kostavelis","year":"2015","journal-title":"Robot. Auton. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1109\/JPROC.1997.554212","article-title":"Sensor fusion for mobile robot navigation","volume":"85","author":"Kam","year":"1997","journal-title":"Proc. IEEE"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1177\/0278364908095118","article-title":"Robot odor localization: A taxonomy and survey","volume":"27","author":"Kowadlo","year":"2008","journal-title":"Int. J. Robot. Res."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Monroy, J., Melendez-Fernandez, F., Gongora, A., and Gonzalez-Jimenez, J. (September, January 28). Integrating Olfaction in a Robotic Telepresence Loop. Proceedings of the 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Lisbon, Portugal.","DOI":"10.1109\/ROMAN.2017.8172427"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Monroy, J., Ruiz-Sarmiento, J.R., Moreno, F.A., Galindo, C., and Gonzalez-Jimenez, J. (2018, January 11\u201315). Towards a Semantic Gas Source Localization under Uncertainty. Proceedings of the International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, C\u00e1diz, Spain.","DOI":"10.1007\/978-3-319-91479-4_42"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Gongora, A., Monroy, J., and Gonzalez-Jimenez, J. (2017, January 28\u201331). A Robotic Experiment Toward Understanding Human Gas-Source Localization Strategies. Proceedings of the 2017 ISOCS\/IEEE International Symposium on Olfaction and Electronic Nose (ISOEN), Montreal, QC, Canada.","DOI":"10.1109\/ISOEN.2017.7968899"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.robot.2018.12.008","article-title":"Olfactory telerobotics. A feasible solution for teleoperated localization of gas sources?","volume":"113","author":"Gongora","year":"2019","journal-title":"Robot. Auton. Syst."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1007\/s10514-006-7100-5","article-title":"Mobile robot navigation using vision and olfaction to search for a gas\/odor source","volume":"20","author":"Ishida","year":"2006","journal-title":"Auton. Robot."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Monroy, J., Ruiz-Sarmiento, J.R., Moreno, F.A., Melendez-Fernandez, F., Galindo, C., and Gonzalez-Jimenez, J. (2018). A Semantic-Based Gas Source Localization with a Mobile Robot Combining Vision and Chemical Sensing. Sensors, 18.","DOI":"10.3390\/s18124174"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Monroy, J., Hernandez-Bennetts, V., Fan, H., Lilienthal, A., and Gonzalez-Jimenez, J. (2017). GADEN: A 3D Gas Dispersion Simulator for Mobile Robot Olfaction in Realistic Environments. Sensors, 17.","DOI":"10.3390\/s17071479"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/16\/3488\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:09:52Z","timestamp":1760188192000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/16\/3488"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,9]]},"references-count":54,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["s19163488"],"URL":"https:\/\/doi.org\/10.3390\/s19163488","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,9]]}}}