{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T20:18:39Z","timestamp":1780085919548,"version":"3.54.0"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,5,3]],"date-time":"2021-05-03T00:00:00Z","timestamp":1620000000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,5,3]],"date-time":"2021-05-03T00:00:00Z","timestamp":1620000000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005758","name":"Universit\u00e0 Politecnica delle Marche","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005758","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Ambient Intell Human Comput"],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Assistive robots operate in complex environments and in presence of human beings, but the interaction between them can be affected by several factors, which may lead to undesired outcomes: wrong sensor readings, unexpected environmental conditions, or algorithmic errors represent just a few examples of the possible scenarios. When the safety of the user is not only an option but must be guaranteed, a feasible solution is to rely on a human-in-the-loop approach, e.g., to monitor if the robot performs a wrong action during a task execution or environmental conditions affect safety during the human-robot interaction, and provide a feedback accordingly. The present paper proposes a human-in-the-loop framework to enable safe autonomous navigation of an electric powered and sensorized (smart) wheelchair. During the wheelchair navigation towards a desired destination in an indoor scenario, possible problems (e.g. obstacles) along the trajectory cause the generation of electroencephalography (EEG) potentials when noticed by the user. These potentials can be used as additional inputs to the navigation algorithm in order to modify the trajectory planning and preserve safety. The framework has been preliminarily tested by using a wheelchair simulator implemented in ROS and Gazebo environments: EEG signals from a benchmark known in the literature were classified, passed to a custom simulation node, and made available to the navigation stack to perform obstacle avoidance.<\/jats:p>","DOI":"10.1007\/s12652-021-03286-7","type":"journal-article","created":{"date-parts":[[2021,5,3]],"date-time":"2021-05-03T11:02:57Z","timestamp":1620039777000},"page":"223-235","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Augmenting robot intelligence via EEG signals to avoid trajectory planning mistakes of a smart wheelchair"],"prefix":"10.1007","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6827-6204","authenticated-orcid":false,"given":"Francesco","family":"Ferracuti","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alessandro","family":"Freddi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sabrina","family":"Iarlori","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sauro","family":"Longhi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea","family":"Monteri\u00f9","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Camillo","family":"Porcaro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,5,3]]},"reference":[{"key":"3286_CR1","doi-asserted-by":"crossref","unstructured":"Alzahab NA, Apollonio L, Di Iorio A, Alshalak M, Iarlori S, Ferracuti F, Monteri\u00f9 A, Porcaro C (2021) Hybrid deep learning (hDL)-based brain-computer interface (BCI) systems: a systematic review. Brain Sci 11(1)","DOI":"10.3390\/brainsci11010075"},{"key":"3286_CR2","doi-asserted-by":"crossref","unstructured":"Behncke J, Schirrmeister RT, Burgard W, Ball T (2018) The signature of robot action success in EEG signals of a human observer: Decoding and visualization using deep convolutional neural networks. In: 2018 6th International conference on brain-computer interface (BCI), pp 1\u20136","DOI":"10.1109\/IWW-BCI.2018.8311531"},{"key":"3286_CR3","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1631\/jzus.2005.A0110","volume":"6","author":"A Bonci","year":"2005","unstructured":"Bonci A, Longhi S, Monteri\u00f9 A, Vaccarini M (2005) Navigation system for a smart wheelchair. J Zhejiang Univ Sci A 6:110\u2013117","journal-title":"J Zhejiang Univ Sci A"},{"key":"3286_CR4","doi-asserted-by":"crossref","unstructured":"Cavanini L, Cimini G, Ferracuti F, Freddi A, Ippoliti G, Monteri\u00f9 A, Verdini F (2017) A QR-code localization system for mobile robots: application to smart wheelchairs. In: 2017 European conference on mobile robots (ECMR), pp 1\u20136","DOI":"10.1109\/ECMR.2017.8098667"},{"issue":"4","key":"3286_CR5","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1109\/TNSRE.2010.2053387","volume":"18","author":"R Chavarriaga","year":"2010","unstructured":"Chavarriaga R, Millan JDR (2010) Learning from EEG error-related potentials in noninvasive brain-computer interfaces. IEEE Trans Neural Syst Rehabil Eng 18(4):381\u2013388","journal-title":"IEEE Trans Neural Syst Rehabil Eng"},{"key":"3286_CR6","doi-asserted-by":"publisher","first-page":"777","DOI":"10.1007\/978-1-4020-8387-7_134","volume-title":"Advances in cognitive neurodynamics ICCN 2007","author":"R Chavarriaga","year":"2008","unstructured":"Chavarriaga R, Ferrez PW, Mill\u00e1n JdR (2008) To err is human: learning from error potentials in brain-computer interfaces. In: Wang R, Shen E, Gu F (eds) Advances in cognitive neurodynamics ICCN 2007. Springer, Dordrecht, pp 777\u2013782"},{"key":"3286_CR7","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1007\/978-3-030-63107-9_16","volume-title":"Ambient assisted living","author":"L Ciabattoni","year":"2021","unstructured":"Ciabattoni L, Ferracuti F, Freddi A, Iarlori S, Longhi S, Monteri\u00f9 A (2021) Human-in-the-loop approach to safe navigation of a smart wheelchair via brain computer interface. In: Monteri\u00f9 A, Freddi A, Longhi S (eds) Ambient assisted living. Springer, Cham, pp 197\u2013209"},{"key":"3286_CR8","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/S0301-0511(99)00031-9","volume":"51","author":"M Falkenstein","year":"2000","unstructured":"Falkenstein M, Hoormann J, Christ S, Hohnsbein J (2000) ERP components on reaction errors and their functional significance: a tutorial. Biol Psychol 51:87\u2013107","journal-title":"Biol Psychol"},{"key":"3286_CR9","doi-asserted-by":"crossref","unstructured":"Ferracuti F, Freddi A, Iarlori S, Longhi S, Peretti P (2013) Auditory paradigm for a P300 BCI system using spatial hearing. In: 2013 IEEE\/RSJ international conference on intelligent robots and systems, pp 871\u2013876","DOI":"10.1109\/IROS.2013.6696453"},{"key":"3286_CR10","doi-asserted-by":"publisher","first-page":"105419","DOI":"10.1016\/j.cmpb.2020.105419","volume":"191","author":"F Ferracuti","year":"2020","unstructured":"Ferracuti F, Casadei V, Marcantoni I, Iarlori S, Burattini L, Monteri\u00f9 A, Porcaro C (2020) A functional source separation algorithm to enhance error-related potentials monitoring in noninvasive brain-computer interface. Comput Methods Progr Biomed 191:105419","journal-title":"Comput Methods Progr Biomed"},{"key":"3286_CR11","doi-asserted-by":"crossref","unstructured":"Foresi G, Freddi A, Iarlori S, Monteri\u00f9 A, Ortenzi D, Proietti\u00a0Pagnotta D (2019) Human-robot cooperation via brain computer interface in assistive scenario. ser Lecture notes in electrical engineering, ambient assisted living: Italian Forum 2017, vol 540, pp 115\u2013131","DOI":"10.1007\/978-3-030-04672-9_8"},{"key":"3286_CR12","doi-asserted-by":"crossref","unstructured":"Gougeh RA, Rezaii TY, Farzamnia A (2021) An automatic driver assistant based on intention detecting using EEG signal. In: Md\u00a0Zain Z, Ahmad H, Pebrianti D, Mustafa M, Abdullah NRH, Samad R, Mat\u00a0Noh M (eds) Proceedings of the 11th national technical seminar on unmanned system technology 2019, Springer Singapore, Singapore, pp 617\u2013627","DOI":"10.1007\/978-981-15-5281-6_43"},{"issue":"1","key":"3286_CR13","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1093\/biostatistics\/kxj035","volume":"8","author":"Y Guo","year":"2006","unstructured":"Guo Y, Hastie T, Tibshirani R (2006) Regularized linear discriminant analysis and its application in microarrays. Biostatistics 8(1):86\u2013100","journal-title":"Biostatistics"},{"key":"3286_CR14","doi-asserted-by":"crossref","unstructured":"Haghani M, Bliemer MCJ, Farooq B, Kim I, Li Z, Oh C, Shahhoseini Z, MacDougall H (2020) Applications of brain imaging methods in driving behaviour research. 2007.09341","DOI":"10.1016\/j.aap.2021.106093"},{"issue":"5","key":"3286_CR15","doi-asserted-by":"publisher","first-page":"056001","DOI":"10.1088\/1741-2560\/8\/5\/056001","volume":"8","author":"S Haufe","year":"2011","unstructured":"Haufe S, Treder MS, Gugler MF, Sagebaum M, Curio G, Blankertz B (2011) EEG potentials predict upcoming emergency brakings during simulated driving. J Neural Eng 8(5):056001","journal-title":"J Neural Eng"},{"issue":"5","key":"3286_CR16","doi-asserted-by":"publisher","first-page":"056011","DOI":"10.1088\/1741-2560\/11\/5\/056011","volume":"11","author":"S Haufe","year":"2014","unstructured":"Haufe S, Kim J, Kim IH, Sonnleitner A, Schrauf M, Curio G, Blankertz B (2014) Electrophysiology-based detection of emergency braking intention in real-world driving. J Neural Eng 11(5):056011","journal-title":"J Neural Eng"},{"key":"3286_CR17","doi-asserted-by":"publisher","first-page":"29","DOI":"10.3389\/fninf.2018.00029","volume":"12","author":"LG Hern\u00e1ndez","year":"2018","unstructured":"Hern\u00e1ndez LG, Mozos OM, Ferr\u00e1ndez JM, Antelis JM (2018) EEG-based detection of braking intention under different car driving conditions. Front Neuroinform 12:29","journal-title":"Front Neuroinform"},{"key":"3286_CR19","doi-asserted-by":"crossref","unstructured":"Ippoliti G, Longhi S, Monteri\u00f9 (2005) Model-based sensor fault detection system for a smart wheelchair. In: IFAC proceedings, vol 38(1), 16th IFAC world congress, pp 269\u2013274","DOI":"10.3182\/20050703-6-CZ-1902.01847"},{"issue":"3","key":"3286_CR20","doi-asserted-by":"publisher","first-page":"614","DOI":"10.1109\/TRO.2009.2020347","volume":"25","author":"I Iturrate","year":"2009","unstructured":"Iturrate I, Antelis JM, Kubler A, Minguez J (2009) A noninvasive brain-actuated wheelchair based on a p300 neurophysiological protocol and automated navigation. IEEE Trans Rob 25(3):614\u2013627","journal-title":"IEEE Trans Rob"},{"key":"3286_CR21","doi-asserted-by":"crossref","unstructured":"Iturrate I, Montesano L (2010) Minguez J (2010) Single trial recognition of error-related potentials during observation of robot operation. In: Annual international conference of the IEEE engineering in medicine and biology, pp 4181\u20134184","DOI":"10.1109\/IEMBS.2010.5627380"},{"key":"3286_CR22","doi-asserted-by":"crossref","unstructured":"Iturrate I, Chavarriaga R, Montesano L, Minguez J (2012) Millan JdR (2012) Latency correction of error potentials between different experiments reduces calibration time for single-trial classification. In: Annual international conference of the IEEE engineering in medicine and biology society, pp 3288\u20133291","DOI":"10.1109\/EMBC.2012.6346667"},{"issue":"1","key":"3286_CR23","doi-asserted-by":"publisher","first-page":"486","DOI":"10.1152\/jn.00036.2017","volume":"118","author":"M Joch","year":"2017","unstructured":"Joch M, Hegele M, Maurer H, M\u00fcller H, Maurer LK (2017) Brain negativity as an indicator of predictive error processing: the contribution of visual action effect monitoring. J Neurophysiol 118(1):486\u2013495","journal-title":"J Neurophysiol"},{"issue":"6","key":"3286_CR24","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/12\/6\/066006","volume":"12","author":"Z Khaliliardali","year":"2015","unstructured":"Khaliliardali Z, Chavarriaga R, Gheorghe LA, del Mill\u00e1n JR (2015) Action prediction based on anticipatory brain potentials during simulated driving. J Neural Eng 12(6)","journal-title":"J Neural Eng"},{"key":"3286_CR25","doi-asserted-by":"crossref","unstructured":"Khaliliardali Z, Chavarriaga R, Zhang H, Gheorghe LA, Perdikis S, Mill\u00e1n JDR (2019) Real-time detection of driver\u2019s movement intention in response to traffic lights. bioRxiv","DOI":"10.1101\/443390"},{"issue":"1","key":"3286_CR18","doi-asserted-by":"publisher","first-page":"016001","DOI":"10.1088\/1741-2560\/12\/1\/016001","volume":"12","author":"Il-Hwa Kim","year":"2014","unstructured":"Kim Il-Hwa, Kim Jeong-Woo, Haufe Stefan, Lee Seong-Whan (2014) Detection of braking intention in diverse situations during simulated driving based on EEG feature combination. J Neural Eng 12(1):016001","journal-title":"J Neural Eng"},{"key":"3286_CR26","doi-asserted-by":"publisher","first-page":"142451","DOI":"10.1109\/ACCESS.2019.2944067","volume":"7","author":"A Kumar","year":"2019","unstructured":"Kumar A, Gao L, Pirogova E, Fang Q (2019) A review of error-related potential-based brain-computer interfaces for motor impaired people. IEEE Access 7:142451\u2013142466","journal-title":"IEEE Access"},{"key":"3286_CR27","doi-asserted-by":"crossref","unstructured":"Lee S, Kim J, Lee S (2017) Detecting driver\u2019s braking intention using recurrent convolutional neural networks based EEG analysis. In: 2017 4th IAPR Asian conference on pattern recognition (ACPR), pp 840\u2013845","DOI":"10.1109\/ACPR.2017.86"},{"key":"3286_CR28","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1162\/neco.1992.4.3.415","volume":"4","author":"DJ MacKay","year":"1991","unstructured":"MacKay DJ (1991) Bayesian interpolation. Neural Comput 4:415\u2013447","journal-title":"Neural Comput"},{"key":"3286_CR29","first-page":"1","volume":"2017","author":"X Mao","year":"2017","unstructured":"Mao X, Li M, Li W, Niu L, Xian B, Zeng M, Chen G (2017) Review article progress in EEG-based brain robot interaction systems. Comput Intell Neurosci 2017:1\u201325","journal-title":"Comput Intell Neurosci"},{"key":"3286_CR30","doi-asserted-by":"crossref","unstructured":"Nguyen TH, Chung WY (2019) Detection of driver braking intention using EEG signals during simulated driving. Sensors 19(13)","DOI":"10.3390\/s19132863"},{"key":"3286_CR31","doi-asserted-by":"crossref","unstructured":"Nordlund P, Gustafsson F (2001) Sequential Monte Carlo filtering techniques applied to integrated navigation systems. In: Proceedings of the 2001 American control conference. (Cat. No.01CH37148), vol\u00a06, pp 4375\u20134380","DOI":"10.1109\/ACC.2001.945666"},{"issue":"2","key":"3286_CR32","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1109\/TRO.2004.838008","volume":"21","author":"P Ogren","year":"2005","unstructured":"Ogren P, Leonard NE (2005) A convergent dynamic window approach to obstacle avoidance. IEEE Trans Rob 21(2):188\u2013195","journal-title":"IEEE Trans Rob"},{"key":"3286_CR33","doi-asserted-by":"crossref","unstructured":"Omedes J, Iturrate I, Chavarriaga R, Montesano L (2015) Asynchronous decoding of error potentials during the monitoring of a reaching task. In: 2015 IEEE international conference on systems, man, and cybernetics, pp 3116\u20133121","DOI":"10.1109\/SMC.2015.541"},{"key":"3286_CR34","doi-asserted-by":"publisher","first-page":"1246","DOI":"10.1016\/j.robot.2010.05.010","volume":"58","author":"X Perrin","year":"2010","unstructured":"Perrin X, Chavarriaga R, Colas F, Siegwart R, Millan JdR (2010) Brain-coupled interaction for semi-autonomous navigation of an assistive robot. Robot Autonom Syst 58:1246\u20131255","journal-title":"Robot Autonom Syst"},{"issue":"2","key":"3286_CR35","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1016\/j.jneumeth.2010.11.016","volume":"195","author":"G Pires","year":"2011","unstructured":"Pires G, Nunes U, Castelo-Branco M (2011) Statistical spatial filtering for a P300-based BCI: tests in able-bodied, and patients with cerebral palsy and amyotrophic lateral sclerosis. J Neurosci Methods 195(2):270\u2013281","journal-title":"J Neurosci Methods"},{"key":"3286_CR36","doi-asserted-by":"crossref","unstructured":"Salazar-Gomez AF, DelPreto J, Gil S, Guenther FH, Rus D (2017) Correcting robot mistakes in real time using EEG signals. In: 2017 IEEE international conference on robotics and automation (ICRA), pp 6570\u20136577","DOI":"10.1109\/ICRA.2017.7989777"},{"key":"3286_CR37","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-32552-1","volume-title":"Springer handbook of robotics","author":"B Siciliano","year":"2016","unstructured":"Siciliano B, Khatib O (2016) Springer handbook of robotics. Springer, Berlin"},{"key":"3286_CR38","doi-asserted-by":"crossref","unstructured":"Sp\u00fcler M, Niethammer C (2015) Error-related potentials during continuous feedback: using EEG to detect errors of different type and severity. Front Hum Neurosci 9","DOI":"10.3389\/fnhum.2015.00155"},{"key":"3286_CR39","doi-asserted-by":"crossref","unstructured":"Teng T, Bi L (2017) A novel EEG-based detection method of emergency situations for assistive vehicles. In: 2017 Seventh international conference on information science and technology (ICIST), pp 335\u2013339","DOI":"10.1109\/ICIST.2017.7926780"},{"key":"3286_CR40","doi-asserted-by":"crossref","unstructured":"Teng T, Bi L, Fan X (2015) Using EEG to recognize emergency situations for brain-controlled vehicles. In: 2015 IEEE intelligent vehicles symposium (IV), pp 1305\u20131309","DOI":"10.1109\/IVS.2015.7225896"},{"issue":"6","key":"3286_CR41","doi-asserted-by":"publisher","first-page":"1766","DOI":"10.1109\/TITS.2017.2740427","volume":"19","author":"T Teng","year":"2018","unstructured":"Teng T, Bi L, Liu Y (2018) EEG-based detection of driver emergency braking intention for brain-controlled vehicles. IEEE Trans Intell Transp Syst 19(6):1766\u20131773","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"3286_CR42","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1016\/j.brainres.2018.09.004","volume":"1716","author":"G Vecchiato","year":"2019","unstructured":"Vecchiato G, Vecchio MD, Ascari L, Antopolskiy S, Deon F, Kubin L, Ambeck-Madsen J, Rizzolatti G, Avanzini P (2019) Electroencephalographic time-frequency patterns of braking and acceleration movement preparation in car driving simulation. Brain Res 1716:16\u201326","journal-title":"Brain Res"},{"key":"3286_CR43","doi-asserted-by":"crossref","unstructured":"Wan EA, Van Der\u00a0Merwe R (2000) The unscented Kalman filter for nonlinear estimation. In: Proceedings of the IEEE 2000 adaptive systems for signal processing, communications, and control symposium (Cat. No. 00EX373), Ieee, pp 153\u2013158","DOI":"10.1109\/ASSPCC.2000.882463"},{"key":"3286_CR44","doi-asserted-by":"crossref","unstructured":"Zhang H, Chavarriaga R, Gheorghe L, Mill\u00e1n J (2013) Inferring driver\u2019s turning direction through detection of error related brain activity. In: 2013 35th Annual international conference of the IEEE engineering in medicine and biology society (EMBC), pp 2196\u20132199","DOI":"10.1109\/EMBC.2013.6609971"},{"issue":"6","key":"3286_CR45","doi-asserted-by":"publisher","first-page":"066028","DOI":"10.1088\/1741-2560\/12\/6\/066028","volume":"12","author":"H Zhang","year":"2015","unstructured":"Zhang H, Chavarriaga R, Khaliliardali Z, Gheorghe L, Iturrate I, Mill\u00e1n JdR (2015) EEG-based decoding of error-related brain activity in a real-world driving task. J Neural Eng 12(6):066028","journal-title":"J Neural Eng"}],"container-title":["Journal of Ambient Intelligence and Humanized Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12652-021-03286-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12652-021-03286-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12652-021-03286-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,13]],"date-time":"2023-01-13T18:20:21Z","timestamp":1673634021000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12652-021-03286-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,3]]},"references-count":45,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1]]}},"alternative-id":["3286"],"URL":"https:\/\/doi.org\/10.1007\/s12652-021-03286-7","relation":{},"ISSN":["1868-5137","1868-5145"],"issn-type":[{"value":"1868-5137","type":"print"},{"value":"1868-5145","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,3]]},"assertion":[{"value":"31 July 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 April 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 May 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}