{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,27]],"date-time":"2025-08-27T15:55:00Z","timestamp":1756310100682,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":41,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,18]]},"DOI":"10.1145\/3462244.3481000","type":"proceedings-article","created":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T14:41:47Z","timestamp":1634308907000},"page":"92-102","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Am I Allergic to This? Assisting Sight Impaired People in the Kitchen"],"prefix":"10.1145","author":[{"given":"Elisa","family":"Ramil Brick","sequence":"first","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}]},{"given":"Vanesa","family":"Caballero Alonso","sequence":"additional","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}]},{"given":"Conor","family":"O'Brien","sequence":"additional","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}]},{"given":"Sheron","family":"Tong","sequence":"additional","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}]},{"given":"Emilie","family":"Tavernier","sequence":"additional","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}]},{"given":"Amit","family":"Parekh","sequence":"additional","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}]},{"given":"Angus","family":"Addlesee","sequence":"additional","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}]},{"given":"Oliver","family":"Lemon","sequence":"additional","affiliation":[{"name":"Heriot-Watt University, United Kingdom"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.279"},{"key":"e_1_3_2_2_2_1","unstructured":"Nilavra Bhattacharya and Danna Gurari. 2019. VizWiz Dataset Browser: A Tool for Visualizing Machine Learning Datasets. arXiv preprint arXiv:1912.09336(2019).  Nilavra Bhattacharya and Danna Gurari. 2019. VizWiz Dataset Browser: A Tool for Visualizing Machine Learning Datasets. arXiv preprint arXiv:1912.09336(2019)."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866029.1866080"},{"key":"e_1_3_2_2_4_1","volume-title":"Scene Text Visual Question Answering. In 2019 IEEE\/CVF International Conference on Computer Vision (ICCV). 4290\u20134300","author":"Biten Ali\u00a0Furkan","year":"2019","unstructured":"Ali\u00a0Furkan Biten , Rub\u00e8n Tito , Andr\u00e9s Mafla , Lluis Gomez , Mar\u00e7al Rusi\u00f1ol , C.V. Jawahar , Ernest Valveny , and Dimosthenis Karatzas . 2019 . Scene Text Visual Question Answering. In 2019 IEEE\/CVF International Conference on Computer Vision (ICCV). 4290\u20134300 . https:\/\/doi.org\/10.1109\/ICCV.2019.00439 Ali\u00a0Furkan Biten, Rub\u00e8n Tito, Andr\u00e9s Mafla, Lluis Gomez, Mar\u00e7al Rusi\u00f1ol, C.V. Jawahar, Ernest Valveny, and Dimosthenis Karatzas. 2019. Scene Text Visual Question Answering. In 2019 IEEE\/CVF International Conference on Computer Vision (ICCV). 4290\u20134300. https:\/\/doi.org\/10.1109\/ICCV.2019.00439"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29364-1_13"},{"key":"e_1_3_2_2_6_1","volume-title":"Diet: Lightweight language understanding for dialogue systems. arXiv preprint arXiv:2004.09936(2020).","author":"Bunk Tanja","year":"2020","unstructured":"Tanja Bunk , Daksh Varshneya , Vladimir Vlasov , and Alan Nichol . 2020 . Diet: Lightweight language understanding for dialogue systems. arXiv preprint arXiv:2004.09936(2020). Tanja Bunk, Daksh Varshneya, Vladimir Vlasov, and Alan Nichol. 2020. Diet: Lightweight language understanding for dialogue systems. arXiv preprint arXiv:2004.09936(2020)."},{"key":"e_1_3_2_2_7_1","volume-title":"GDPR: an impediment to research?Irish journal of medical science 188, 4","author":"Clarke Niamh","year":"2019","unstructured":"Niamh Clarke , Gillian Vale , Emer\u00a0 P Reeves , Mary Kirwan , David Smith , Michael Farrell , Gerard Hurl , and Noel\u00a0 G McElvaney . 2019. GDPR: an impediment to research?Irish journal of medical science 188, 4 ( 2019 ), 1129\u20131135. Niamh Clarke, Gillian Vale, Emer\u00a0P Reeves, Mary Kirwan, David Smith, Michael Farrell, Gerard Hurl, and Noel\u00a0G McElvaney. 2019. GDPR: an impediment to research?Irish journal of medical science 188, 4 (2019), 1129\u20131135."},{"key":"e_1_3_2_2_8_1","unstructured":"European Commission. 2020. Data protection. https:\/\/ec.europa.eu\/info\/law\/law-topic\/data-protection_en  European Commission. 2020. Data protection. https:\/\/ec.europa.eu\/info\/law\/law-topic\/data-protection_en"},{"key":"e_1_3_2_2_9_1","unstructured":"European Commission. 2020. White Paper on Artificial Intelligence: a European approach to excellence and trust. https:\/\/ec.europa.eu\/info\/publications\/white-paper-artificial-intelligence-european-approach-excellence-and-trust-en  European Commission. 2020. White Paper on Artificial Intelligence: a European approach to excellence and trust. https:\/\/ec.europa.eu\/info\/publications\/white-paper-artificial-intelligence-european-approach-excellence-and-trust-en"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2019.06.009"},{"key":"e_1_3_2_2_11_1","unstructured":"Lance\u00a0B Eliot. 2019. Human In-The-Loop Vs. Out-of-The-Loop in AI Systems: The Case of AI Self-Driving Cars. https:\/\/www.aitrends.com\/ai-insider\/human-in-the-loop-vs-out-of-the-loop-in-ai-systems-the-case-of-ai-self-driving-cars\/  Lance\u00a0B Eliot. 2019. Human In-The-Loop Vs. Out-of-The-Loop in AI Systems: The Case of AI Self-Driving Cars. https:\/\/www.aitrends.com\/ai-insider\/human-in-the-loop-vs-out-of-the-loop-in-ai-systems-the-case-of-ai-self-driving-cars\/"},{"key":"e_1_3_2_2_12_1","volume-title":"VizWiz Grand Challenge Workshop at CVPR 2020 - Panel Discussion with Blind Technology Experts. https:\/\/www.youtube.com\/watch?v=f613diLbVAc","author":"Fleet Chancey","year":"2020","unstructured":"Chancey Fleet , Cynthia Bennett , and Venkatesh Potluri . 2020 . VizWiz Grand Challenge Workshop at CVPR 2020 - Panel Discussion with Blind Technology Experts. https:\/\/www.youtube.com\/watch?v=f613diLbVAc Chancey Fleet, Cynthia Bennett, and Venkatesh Potluri. 2020. VizWiz Grand Challenge Workshop at CVPR 2020 - Panel Discussion with Blind Technology Experts. https:\/\/www.youtube.com\/watch?v=f613diLbVAc"},{"key":"e_1_3_2_2_13_1","volume-title":"ICDAR 2019 Competition on Scene Text Visual Question Answering. In 2019 International Conference on Document Analysis and Recognition (ICDAR). 1563\u20131570","author":"Furkan\u00a0Biten Ali","year":"2019","unstructured":"Ali Furkan\u00a0Biten , Rub\u00e8n Tito , Andr\u00e9s Mafla , Lluis Gomez , Mar\u00e7al Rusi\u00f1ol , Minesh Mathew , C.V. Jawahar , Ernest Valveny , and Dimosthenis Karatzas . 2019 . ICDAR 2019 Competition on Scene Text Visual Question Answering. In 2019 International Conference on Document Analysis and Recognition (ICDAR). 1563\u20131570 . https:\/\/doi.org\/10.1109\/ICDAR.2019.00251 Ali Furkan\u00a0Biten, Rub\u00e8n Tito, Andr\u00e9s Mafla, Lluis Gomez, Mar\u00e7al Rusi\u00f1ol, Minesh Mathew, C.V. Jawahar, Ernest Valveny, and Dimosthenis Karatzas. 2019. ICDAR 2019 Competition on Scene Text Visual Question Answering. In 2019 International Conference on Document Analysis and Recognition (ICDAR). 1563\u20131570. https:\/\/doi.org\/10.1109\/ICDAR.2019.00251"},{"key":"e_1_3_2_2_14_1","unstructured":"Haoyuan Gao Junhua Mao Jie Zhou Zhiheng Huang Lei Wang and Wei Xu. 2015. Are you talking to a machine? dataset and methods for multilingual image question answering. arXiv preprint arXiv:1505.05612(2015).  Haoyuan Gao Junhua Mao Jie Zhou Zhiheng Huang Lei Wang and Wei Xu. 2015. Are you talking to a machine? dataset and methods for multilingual image question answering. arXiv preprint arXiv:1505.05612(2015)."},{"key":"e_1_3_2_2_15_1","volume-title":"Asian Conference on Machine Learning. PMLR, 17\u201332","author":"Glasmachers Tobias","year":"2017","unstructured":"Tobias Glasmachers . 2017 . Limits of end-to-end learning . In Asian Conference on Machine Learning. PMLR, 17\u201332 . Tobias Glasmachers. 2017. Limits of end-to-end learning. In Asian Conference on Machine Learning. PMLR, 17\u201332."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.5465\/annals.2018.0057"},{"key":"e_1_3_2_2_17_1","unstructured":"UK Government. 2021. Food labelling and packaging - GOV.UK. https:\/\/www.gov.uk\/food-labelling-and-packaging  UK Government. 2021. Food labelling and packaging - GOV.UK. https:\/\/www.gov.uk\/food-labelling-and-packaging"},{"key":"e_1_3_2_2_18_1","volume-title":"Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering. In Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Goyal Yash","year":"2017","unstructured":"Yash Goyal , Tejas Khot , Douglas Summers-Stay , Dhruv Batra , and Devi Parikh . 2017 . Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering. In Conference on Computer Vision and Pattern Recognition (CVPR). Yash Goyal, Tejas Khot, Douglas Summers-Stay, Dhruv Batra, and Devi Parikh. 2017. Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering. In Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00380"},{"key":"e_1_3_2_2_20_1","unstructured":"[\n  20\n  ]  Rishabh Jain and Deshraj Yadav.[n.d.]. https:\/\/vqa.cloudcv.org\/  [20] Rishabh Jain and Deshraj Yadav.[n.d.]. https:\/\/vqa.cloudcv.org\/"},{"key":"e_1_3_2_2_21_1","unstructured":"Jason\u00a0C Jay. 2018. Foodways of the Visually-Impaired: Traversing the Blind Kitchen.  Jason\u00a0C Jay. 2018. Foodways of the Visually-Impaired: Traversing the Blind Kitchen."},{"key":"e_1_3_2_2_22_1","volume-title":"Pythia v0.1: the Winning Entry to the VQA Challenge","author":"Jiang Yu","year":"2018","unstructured":"Yu Jiang , Vivek Natarajan , Xinlei Chen , Marcus Rohrbach , Dhruv Batra , and Devi Parikh . 2018. Pythia v0.1: the Winning Entry to the VQA Challenge 2018 . arXiv (jul 2018), 4\u20136. arxiv:1807.09956http:\/\/arxiv.org\/abs\/1807.09956 Yu Jiang, Vivek Natarajan, Xinlei Chen, Marcus Rohrbach, Dhruv Batra, and Devi Parikh. 2018. Pythia v0.1: the Winning Entry to the VQA Challenge 2018. arXiv (jul 2018), 4\u20136. arxiv:1807.09956http:\/\/arxiv.org\/abs\/1807.09956"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-016-0981-7"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_2_2_25_1","unstructured":"Mateusz Malinowski and Mario Fritz. 2014. A multi-world approach to question answering about real-world scenes based on uncertain input. arXiv preprint arXiv:1410.0210(2014).  Mateusz Malinowski and Mario Fritz. 2014. A multi-world approach to question answering about real-world scenes based on uncertain input. arXiv preprint arXiv:1410.0210(2014)."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2019.00156"},{"key":"e_1_3_2_2_27_1","unstructured":"Fausto Morales 2015. keras-ocr. https:\/\/github.com\/faustomorales\/keras-ocr.git  Fausto Morales 2015. keras-ocr. https:\/\/github.com\/faustomorales\/keras-ocr.git"},{"key":"e_1_3_2_2_28_1","unstructured":"NHS. 2018. Blindness and vision loss. https:\/\/www.nhs.uk\/conditions\/vision-loss\/  NHS. 2018. Blindness and vision loss. https:\/\/www.nhs.uk\/conditions\/vision-loss\/"},{"volume-title":"Usability Engineering","author":"Nielsen Jakob","key":"e_1_3_2_2_29_1","unstructured":"Jakob Nielsen . 1993. Usability Engineering . Academic Press Limited , Chapter\u00a05. Jakob Nielsen. 1993. Usability Engineering. Academic Press Limited, Chapter\u00a05."},{"key":"e_1_3_2_2_30_1","unstructured":"Rasa Technologies. 2021. Testing Your Assistant. https:\/\/rasa.com\/docs\/rasa\/testing-your-assistant\/#interpreting-the-output  Rasa Technologies. 2021. Testing Your Assistant. https:\/\/rasa.com\/docs\/rasa\/testing-your-assistant\/#interpreting-the-output"},{"key":"e_1_3_2_2_31_1","unstructured":"RNIB. 2021. Welcome to RNIB. https:\/\/www.rnib.org.uk\/?gclid=EAIaIQobChMIzaWQ_rDV7wIVVO3tCh2KnQdZEAAYASAAEgLZbPD_BwE  RNIB. 2021. Welcome to RNIB. https:\/\/www.rnib.org.uk\/?gclid=EAIaIQobChMIzaWQ_rDV7wIVVO3tCh2KnQdZEAAYASAAEgLZbPD_BwE"},{"key":"e_1_3_2_2_32_1","unstructured":"Felp Roza. 2020. End-to-end learning the (almost) every purpose ML method. https:\/\/towardsdatascience.com\/e2e-the-every-purpose-ml-method-5d4f20dafee4  Felp Roza. 2020. End-to-end learning the (almost) every purpose ML method. https:\/\/towardsdatascience.com\/e2e-the-every-purpose-ml-method-5d4f20dafee4"},{"volume-title":"Explainable AI: interpreting, explaining and visualizing deep learning. Vol.\u00a011700","author":"Samek Wojciech","key":"e_1_3_2_2_33_1","unstructured":"Wojciech Samek , Gr\u00e9goire Montavon , Andrea Vedaldi , Lars\u00a0Kai Hansen , and Klaus-Robert M\u00fcller . 2019. Explainable AI: interpreting, explaining and visualizing deep learning. Vol.\u00a011700 . Springer Nature . Wojciech Samek, Gr\u00e9goire Montavon, Andrea Vedaldi, Lars\u00a0Kai Hansen, and Klaus-Robert M\u00fcller. 2019. Explainable AI: interpreting, explaining and visualizing deep learning. Vol.\u00a011700. Springer Nature."},{"key":"e_1_3_2_2_34_1","unstructured":"Sight Scotland. 2021. Sight Scotland. Educating & Supporting People With Vision Loss. https:\/\/sightscotland.org.uk  Sight Scotland. 2021. Sight Scotland. Educating & Supporting People With Vision Loss. https:\/\/sightscotland.org.uk"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"crossref","unstructured":"Amanpreet Singh Vivek Natarajan Meet Shah Yu Jiang Xinlei Chen Dhruv Batra Devi Parikh and Marcus Rohrbach. 2019. Towards vqa models that can read. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 8317\u20138326.  Amanpreet Singh Vivek Natarajan Meet Shah Yu Jiang Xinlei Chen Dhruv Batra Devi Parikh and Marcus Rohrbach. 2019. Towards vqa models that can read. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 8317\u20138326.","DOI":"10.1109\/CVPR.2019.00851"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.5555\/1304596.1304846"},{"key":"e_1_3_2_2_37_1","unstructured":"Elin Vinka. 2020. Microservices - why use RabbitMQ?https:\/\/www.cloudamqp.com\/blog\/why-use-rabbitmq-in-a-microservice-architecture.html  Elin Vinka. 2020. Microservices - why use RabbitMQ?https:\/\/www.cloudamqp.com\/blog\/why-use-rabbitmq-in-a-microservice-architecture.html"},{"key":"e_1_3_2_2_38_1","unstructured":"VizWiz. 2021. Algorithms to assist people who are blind. https:\/\/vizwiz.org\/  VizWiz. 2021. Algorithms to assist people who are blind. https:\/\/vizwiz.org\/"},{"key":"e_1_3_2_2_39_1","unstructured":"WHO. 2012. Global data on visual impairment. https:\/\/www.who.int\/blindness\/publications\/globaldata\/en\/  WHO. 2012. Global data on visual impairment. https:\/\/www.who.int\/blindness\/publications\/globaldata\/en\/"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1111\/ijcs.12041"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.540"}],"event":{"name":"ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Montr\u00e9al QC Canada","acronym":"ICMI '21"},"container-title":["Proceedings of the 2021 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3481000","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3462244.3481000","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:19:01Z","timestamp":1750191541000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3481000"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,18]]},"references-count":41,"alternative-id":["10.1145\/3462244.3481000","10.1145\/3462244"],"URL":"https:\/\/doi.org\/10.1145\/3462244.3481000","relation":{},"subject":[],"published":{"date-parts":[[2021,10,18]]},"assertion":[{"value":"2021-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}