{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T17:35:57Z","timestamp":1778866557440,"version":"3.51.4"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,6,17]],"date-time":"2020-06-17T00:00:00Z","timestamp":1592352000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,6,17]],"date-time":"2020-06-17T00:00:00Z","timestamp":1592352000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Open Access Publishing Fund of the University of Cagliari, with the funding of the Regione Autonoma della Sardegna - L.R. n. 7\/2007"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Hum. Cent. Comput. Inf. Sci."],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Unhealthy behaviors regarding nutrition are a global risk for health. Therefore, the healthiness of an individual\u2019s nutrition should be monitored in the medium and long term. A powerful tool for monitoring nutrition is a food diary; i.e., a daily list of food taken by the individual, together with portion information. Unfortunately, frail people such as the elderly have a hard time filling food diaries on a continuous basis due to forgetfulness or physical issues. Existing solutions based on mobile apps also require user\u2019s effort and are rarely used in the long term, especially by elderly people. For these reasons, in this paper we propose a novel architecture to automatically recognize the preparation of food at home in a privacy-preserving and unobtrusive way, by means of air quality data acquired from a commercial sensor. In particular, we devised statistical features to represent the trend of several air parameters, and a deep neural network for recognizing cooking activities based on those data. We collected a large corpus of annotated sensor data gathered over a period of 8 months from different individuals in different homes, and performed extensive experiments. Moreover, we developed an initial prototype of an interactive system for acquiring food information from the user when a cooking activity is detected by the neural network. To the best of our knowledge, this is the first work that adopts air quality sensor data for cooking activity recognition.<\/jats:p>","DOI":"10.1186\/s13673-020-00235-9","type":"journal-article","created":{"date-parts":[[2020,6,17]],"date-time":"2020-06-17T15:04:09Z","timestamp":1592406249000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Recognition of cooking activities through air quality sensor data for supporting food journaling"],"prefix":"10.1186","volume":"10","author":[{"given":"Federica","family":"Gerina","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Silvia M.","family":"Massa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francesca","family":"Moi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Diego","family":"Reforgiato Recupero","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0695-2040","authenticated-orcid":false,"given":"Daniele","family":"Riboni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,6,17]]},"reference":[{"key":"235_CR1","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1016\/j.atmosenv.2013.01.061","volume":"71","author":"L Abdullahi","year":"2013","unstructured":"Abdullahi L, Delgado-Saborit JM, Harrison R (2013) Emissions and indoor concentrations of particulate matter and its specific chemical components from cooking: a review. Atmos Environ 71:260\u2013294. https:\/\/doi.org\/10.1016\/j.atmosenv.2013.01.061","journal-title":"Atmos Environ"},{"key":"235_CR2","doi-asserted-by":"crossref","unstructured":"Achananuparp P, Lim E, Abhishek V (2018) Does journaling encourage healthier choices? Analyzing healthy eating behaviors of food journalers. In: Kostkova P. Grasso F, Castillo C, Mejova Y, Bosman A, Edelstein M (eds) Proceedings of the 2018 international conference on digital health, ACM, pp 35\u201344","DOI":"10.1145\/3194658.3194663"},{"key":"235_CR3","doi-asserted-by":"crossref","unstructured":"Amft O, St\u00e4ger M, Lukowicz P, Tr\u00f6ster G (2005) Analysis of chewing sounds for dietary monitoring. In: UbiComp 2005: ubiquitous computing, 7th international conference, Lecture Notes in Computer Science, vol 3660, Springer, Berlin, pp 56\u201372","DOI":"10.1007\/11551201_4"},{"key":"235_CR4","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1038\/sj.ejcn.1602182","volume":"59","author":"L Bouwman","year":"2005","unstructured":"Bouwman L, Hiddink GJ, Koelen MA, Korthals M, van\u2019t Veer P, van Woerkum C, Personalized nutrition communication through ict application (2005) Personalized nutrition communication through ict application: how to overcome the gap between potential effectiveness and reality. Eur J Clin Nutr 59:108\u2013116","journal-title":"Eur J Clin Nutr"},{"issue":"3","key":"235_CR5","first-page":"1","volume":"8","author":"V Brunoand","year":"2017","unstructured":"Brunoand V, Resende S, Juan C (2017) A survey on automated food monitoring and dietary management systems. J Health Med Inform 8(3):1\u201315","journal-title":"J Health Med Inform"},{"key":"235_CR6","doi-asserted-by":"crossref","unstructured":"Casas J, Mugellini E, Khaled OA (2018) Food diary coaching chatbot. In: Proceedings of the 2018 ACM international joint conference and 2018 international symposium on pervasive and ubiquitous computing and wearable computers, ACM, pp 1676\u20131680","DOI":"10.1145\/3267305.3274191"},{"key":"235_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ijhcs.2020.102410","volume":"139","author":"I Celino","year":"2020","unstructured":"Celino I, Calegari GR (2020) Submitting surveys via a conversational interface: an evaluation of user acceptance and approach effectiveness. Int J Hum Comput Stud 139:1\u201316","journal-title":"Int J Hum Comput Stud"},{"key":"235_CR8","doi-asserted-by":"crossref","unstructured":"Chi P, Chen J, Chu H, Lo J (2008) Enabling calorie-aware cooking in a smart kitchen. In: PERSUASIVE, Lecture Notes in Computer Science, vol 5033, Springer, Berlin, pp 116\u2013127","DOI":"10.1007\/978-3-540-68504-3_11"},{"key":"235_CR9","doi-asserted-by":"crossref","unstructured":"Cordeiro F, Bales E, Cherry E, Fogarty J (2015) Rethinking the mobile food journal: Exploring opportunities for lightweight photo-based capture. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems (CHI), ACM, pp 3207\u20133216","DOI":"10.1145\/2702123.2702154"},{"key":"235_CR10","doi-asserted-by":"crossref","unstructured":"Cordeiro F, Epstein DA, Thomaz E, Bales E, Jagannathan AK, Abowd GD, Fogarty J (2015) Barriers and negative nudges: Exploring challenges in food journaling. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems (CHI 2015), ACM, pp 1159\u20131162","DOI":"10.1145\/2702123.2702155"},{"issue":"5","key":"235_CR11","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1177\/1357633X15572203","volume":"21","author":"KN DiFilippo","year":"2015","unstructured":"DiFilippo KN, Huang WH, Andrade JE, Chapman-Novakofski KM (2015) The use of mobile apps to improve nutrition outcomes: a systematic literature review. J Telemed Telecare 21(5):243\u2013253","journal-title":"J Telemed Telecare"},{"issue":"1","key":"235_CR12","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1007\/BF02288569","volume":"6","author":"JP Guilford","year":"1941","unstructured":"Guilford JP (1941) The phi coefficient and chi square as indices of item validity. Psychometrika 6(1):11\u201319","journal-title":"Psychometrika"},{"issue":"1","key":"235_CR13","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1145\/1656274.1656278","volume":"11","author":"MA Hall","year":"2009","unstructured":"Hall MA, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The WEKA data mining software: an update. SIGKDD Explor 11(1):10\u201318","journal-title":"SIGKDD Explor"},{"key":"235_CR14","doi-asserted-by":"publisher","unstructured":"Hameed I (2016) Using natural language processing (nlp) for designing socially intelligent robots. In: Conference: 2016 joint IEEE international conference on development and learning and epigenetic robotics (ICDL-EpiRob), pp 268\u2013269. https:\/\/doi.org\/10.1109\/DEVLRN.2016.7846830","DOI":"10.1109\/DEVLRN.2016.7846830"},{"key":"235_CR15","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1016\/j.amepre.2008.04.013","volume":"35","author":"JF Hollis","year":"2008","unstructured":"Hollis JF, Gullion CM, Stevens VJ, Brantley PJ, Appel LJ, Ard JD, Champagne CM, Dalcin A, Erlinger TP, Funk K, Laferriere D, Lin PH, Loria CM, Samuel-Hodge C, Vollmer WM, Svetkey LP (2008) Weight loss during the intensive intervention phase of the weight-loss maintenance trial. Am J Prev Med 35:118\u2013126","journal-title":"Am J Prev Med"},{"key":"235_CR16","doi-asserted-by":"publisher","unstructured":"Kazakos E, Nagrani A, Zisserman A, Damen D (2019) Epic-fusion: Audio-visual temporal binding for egocentric action recognition. In: 2019 IEEE\/CVF international conference on computer vision, IEEE, New York, pp 5491\u20135500. https:\/\/doi.org\/10.1109\/ICCV.2019.00559.","DOI":"10.1109\/ICCV.2019.00559"},{"issue":"9","key":"235_CR17","doi-asserted-by":"publisher","first-page":"1591","DOI":"10.1016\/j.jand.2018.05.021","volume":"118","author":"SM Krebs-Smith","year":"2018","unstructured":"Krebs-Smith SM, Pannucci TE, Subar AF, Kirkpatrick SI, Lerman JL, Tooze JA, Wilson MM, Reedy J (2018) Update of the healthy eating index: Hei-2015. J Acad Nutr Diet 118(9):1591\u20131602","journal-title":"J Acad Nutr Diet"},{"key":"235_CR18","doi-asserted-by":"crossref","unstructured":"Liu S, Qi L, Qin H, Shi J, Jia J (2018) Path aggregation network for instance segmentation. In: 2018 IEEE\/CVF conference on computer vision and pattern recognition, pp 8759\u20138768","DOI":"10.1109\/CVPR.2018.00913"},{"key":"235_CR19","doi-asserted-by":"crossref","unstructured":"Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, Berg AC (2016) Ssd: single shot multibox detector. In: Proceedings of the European conference on computer vision (ECCV) (2016). arXiv:1512.02325","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"235_CR20","doi-asserted-by":"publisher","first-page":"114:1","DOI":"10.1145\/3274383","volume":"2","author":"K Lukoff","year":"2018","unstructured":"Lukoff K, Li T, Zhuang Y, Lim BY (2018) Tablechat: mobile food journaling to facilitate family support for healthy eating. Proc ACM Hum Comput Interact 2:114:1\u2013114:28","journal-title":"Proc ACM Hum Comput Interact"},{"key":"235_CR21","doi-asserted-by":"crossref","unstructured":"Mamykina L, Mynatt ED, Kaufman DR (2006) Investigating health management practices of individuals with diabetes. In: Proceedings of the 2006 conference on human factors in computing systems (CHI), ACM, pp 927\u2013936","DOI":"10.1145\/1124772.1124910"},{"key":"235_CR22","doi-asserted-by":"crossref","unstructured":"Mankoff J, Hsieh G, Hung HC, Lee S, Nitao E (2002) Using low-cost sensing to support nutritional awareness. In: UbiComp 2002: ubiquitous computing, 4th international conference, Lecture Notes in Computer Science, vol 2498, Springer, Berlin, pp 371\u2013376","DOI":"10.1007\/3-540-45809-3_29"},{"key":"235_CR23","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1159\/000391884","volume":"13","author":"JW Marr","year":"1971","unstructured":"Marr JW (1971) Individual dietary surveys: purposes and methods. World Rev Nutr Diet 13:105\u2013164","journal-title":"World Rev Nutr Diet"},{"key":"235_CR24","doi-asserted-by":"publisher","first-page":"5687","DOI":"10.24963\/ijcai.2018\/810","volume":"2018","author":"C Matuszek","year":"2018","unstructured":"Matuszek C (2018) Grounded language learning: where robotics and nlp meet. Proc IJCAI 2018:5687\u20135691. https:\/\/doi.org\/10.24963\/ijcai.2018\/810","journal-title":"Proc IJCAI"},{"issue":"2","key":"235_CR25","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1093\/tbm\/ibx019","volume":"8","author":"S Michie","year":"2018","unstructured":"Michie S, West R, Sheals K, Godinho CA (2018) Evaluating the effectiveness of behavior change techniques in health-related behavior: a scoping review of methods used. Transl Behav Med 8(2):212\u2013224","journal-title":"Transl Behav Med"},{"key":"235_CR26","doi-asserted-by":"crossref","unstructured":"Oh H, Nguyen J, Soundararajan S, Jain R (2018) Multimodal food journaling. In: Boll S, Jain R, O\u2019Connor NE, McDaniel TL, Meyer J (eds) Proceedings of the 3rd international workshop on multimedia for personal health and health care, ACM, pp 39\u201347","DOI":"10.1145\/3264996.3265000"},{"issue":"2","key":"235_CR27","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1007\/s42486-018-00004-9","volume":"1","author":"D Riboni","year":"2019","unstructured":"Riboni D (2019) Opportunistic pervasive computing: adaptive context recognition and interfaces. CCF Trans Pervasive Comput Interact 1(2):125\u2013139","journal-title":"CCF Trans Pervasive Comput Interact"},{"key":"235_CR28","doi-asserted-by":"crossref","unstructured":"Rohrbach M, Amin S, Andriluka M, Schiele B (2012) A database for fine grained activity detection of cooking activities. In: IEEE conference on computer vision and pattern recognition, IEEE Computer Society, pp 1194\u20131201","DOI":"10.1109\/CVPR.2012.6247801"},{"issue":"6","key":"235_CR29","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1007\/s40519-018-0562-6","volume":"23","author":"KA Romano","year":"2018","unstructured":"Romano KA, Becker MAS, Colgary CD, Magnuson A (2018) Helpful or harmful? the comparative value of self-weighing and calorie counting versus intuitive eating on the eating disorder symptomology of college students. Eating Weight Disord Stud Anorexia Bulimia Obes 23(6):841\u2013848","journal-title":"Eating Weight Disord Stud Anorexia Bulimia Obes"},{"key":"235_CR30","doi-asserted-by":"publisher","first-page":"103320","DOI":"10.1016\/j.robot.2019.103320","volume":"123","author":"RA Saeed","year":"2020","unstructured":"Saeed RA, Recupero DR, Remagnino P (2020) A boundary node method for path planning of mobile robots. Robot Auton Syst 123:103320","journal-title":"Robot Auton Syst"},{"key":"235_CR31","doi-asserted-by":"crossref","unstructured":"Sen S, Subbaraju V, Misra A, Balan RK, Lee Y (2018) Annapurna: building a real-world smartwatch-based automated food journal. In: 19th IEEE international symposium on \u201cA World of Wireless, Mobile and Multimedia Networks\u201d, IEEE Computer Society, pp 1\u20136","DOI":"10.1109\/WoWMoM.2018.8449755"},{"key":"235_CR32","doi-asserted-by":"publisher","unstructured":"Wang G, Cheng S, Lang JL, Wen W, Wang X, Yao S (2016) Characterization of volatile organic compounds from different cooking emissions. Atmos Environ 145 https:\/\/doi.org\/10.1016\/j.atmosenv.2016.09.037","DOI":"10.1016\/j.atmosenv.2016.09.037"},{"key":"235_CR33","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1111\/j.1365-2648.2006.04089.x","volume":"58","author":"MH Wilde","year":"2007","unstructured":"Wilde MH, Garvin S (2007) A concept analysis of self-monitoring. J Adv Nurs 58:339\u2013350","journal-title":"J Adv Nurs"},{"key":"235_CR34","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.ijmedinf.2018.03.012","volume":"114","author":"GA Wildenbos","year":"2018","unstructured":"Wildenbos GA, Peute LWP, Jaspers MWM (2018) Aging barriers influencing mobile health usability for older adults: a literature based framework (MOLD-US). Int J Med Inform 114:66\u201375","journal-title":"Int J Med Inform"},{"key":"235_CR35","doi-asserted-by":"crossref","unstructured":"Woznowski P, Tonkin E, Laskowski P, Twomey N, Yordanova K, Burrows A (2017) Talk, text or tag? The development of a self-annotation app for activity recognition in smart environments. In: IEEE international conference on pervasive computing and communications workshops, IEEE, New York, pp 123\u2013128","DOI":"10.1109\/PERCOMW.2017.7917544"},{"issue":"3","key":"235_CR36","doi-asserted-by":"publisher","first-page":"646","DOI":"10.3390\/s19030646","volume":"19","author":"K Yordanova","year":"2019","unstructured":"Yordanova K, L\u00fcdtke S, Whitehouse S, Kr\u00fcger F, Paiement A, Mirmehdi M, Craddock I, Kirste T (2019) Analysing cooking behaviour in home settings: towards health monitoring. Sensors 19(3):646","journal-title":"Sensors"},{"key":"235_CR37","doi-asserted-by":"crossref","unstructured":"Yordanova K, Whitehouse S, Paiement A, Mirmehdi M, Kirste T, Craddock I (2017) What\u2019s cooking and why? behaviour recognition during unscripted cooking tasks for health monitoring. In: IEEE international conference on pervasive computing and communications workshops, IEEE, New York, pp 18\u201321","DOI":"10.1109\/PERCOMW.2017.7917511"},{"issue":"4","key":"235_CR38","doi-asserted-by":"publisher","first-page":"756","DOI":"10.1109\/JSTSP.2010.2051471","volume":"4","author":"F Zhu","year":"2010","unstructured":"Zhu F, Bosch M, Woo I, Kim S, Boushey CJ, Ebert DS, Delp EJ (2010) The use of mobile devices in aiding dietary assessment and evaluation. J Sel Topics Signal Process 4(4):756\u2013766","journal-title":"J Sel Topics Signal Process"},{"issue":"4","key":"235_CR39","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1109\/MIS.2015.57","volume":"30","author":"N Zhu","year":"2015","unstructured":"Zhu N, Diethe T, Camplani M, Tao L, Burrows A, Twomey N, Kaleshi D, Mirmehdi M, Flach PA, Craddock I (2015) Bridging e-health and the internet of things: the SPHERE project. IEEE Intell Syst 30(4):39\u201346","journal-title":"IEEE Intell Syst"}],"container-title":["Human-centric Computing and Information Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13673-020-00235-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13673-020-00235-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13673-020-00235-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T12:17:18Z","timestamp":1627647438000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s13673-020-00235-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,17]]},"references-count":39,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["235"],"URL":"https:\/\/doi.org\/10.1186\/s13673-020-00235-9","relation":{},"ISSN":["2192-1962"],"issn-type":[{"value":"2192-1962","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,17]]},"assertion":[{"value":"19 July 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 May 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 June 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"27"}}