{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T02:22:55Z","timestamp":1780366975017,"version":"3.54.1"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"1","funder":[{"name":"JST","award":["JPMJCR19A1"],"award-info":[{"award-number":["JPMJCR19A1"]}]},{"name":"JSPS KAKENHI","award":["JP23K16980"],"award-info":[{"award-number":["JP23K16980"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2026,1,31]]},"abstract":"<jats:p>Reflecting on memories has a positive effect on mental health. For robots that interact with older adults, interactions that look back on memories are also an important application area. Despite the importance of such reminiscence, no study has simultaneously addressed methods to both facilitate robots conversing about users\u2019 memories and generate content from those memories. In this article, we propose TRAVOT, a system that explores the events behind travel photos through conversation and generates travel memoirs with such photos. TRAVOT uses a large language model (LLM) for flexible information collection. Moreover, it can deepen the conversation topic to obtain a more profound story from the user via a topic control mechanism with Meta-LLM. This not only elicits information that cannot be obtained from the photos based on a prepared list of questions but also allows for deepening the discussion by generating additional questions. In addition, it can eliminate redundant questions that result from naive use of an LLM by applying matching judgment with certain required questions. We conducted a user experiment to evaluate TRAVOT\u2019s effectiveness, and we found that the participants could recall more interesting and unusual things that happened during their trips when they had conversations with TRAVOT. The users could also reminisce about their trips when they read the travel memoirs generated by TRAVOT. In addition, TRAVOT increased the amount of information contained in the conversations and travel memoirs.<\/jats:p>","DOI":"10.1145\/3762674","type":"journal-article","created":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T16:28:21Z","timestamp":1755880101000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Conversational Robot System for Travel Memoir Generation"],"prefix":"10.1145","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3020-9473","authenticated-orcid":false,"given":"Kaon","family":"Shimoyama","sequence":"first","affiliation":[{"name":"Keio University, Yokohama, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5569-3356","authenticated-orcid":false,"given":"Kohei","family":"Okuoka","sequence":"additional","affiliation":[{"name":"Keio University, Yokohama, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8441-8815","authenticated-orcid":false,"given":"Mitsuhiko","family":"Kimoto","sequence":"additional","affiliation":[{"name":"Meiji University, Kawasaki, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2825-1560","authenticated-orcid":false,"given":"Michita","family":"Imai","sequence":"additional","affiliation":[{"name":"Keio University, Yokohama, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,10,28]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3610978.3641112"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.279"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-008-0001-3\">10.1007\/s12369-008-0001-3\">10.1007\/s12369-008-0001-3"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-21616-9_58"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-013-0650-6\">10.1007\/s00779-013-0650-6\">10.1007\/s00779-013-0650-6"},{"key":"e_1_3_1_7_2","unstructured":"Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell et al. 2020. Language models are few-shot learners. arXiv:2005.14165. Retrieved from https:\/\/arxiv.org\/abs\/2005.14165"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/CTS.2014.6867537"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781315784250-7"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-022-01699-5\">10.1007\/s00779-022-01699-5\">10.1007\/s00779-022-01699-5"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.maturitas.2012.04.008\">10.1016\/j.maturitas.2012.04.008\">10.1016\/j.maturitas.2012.04.008"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.121"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3640794.3665551"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.475"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.findings-acl.212\">10.18653\/v1\/2024.findings-acl.212\">10.18653\/v1\/2024.findings-acl.212"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.14236\/ewic\/HCI2011.78"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643834.3660685"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1163\/016918609X12518783330289\">10.1163\/016918609X12518783330289\">10.1163\/016918609X12518783330289"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/lra.2024.3360020\">10.1109\/lra.2024.3360020\">10.1109\/lra.2024.3360020"},{"key":"e_1_3_1_20_2","doi-asserted-by":"crossref","unstructured":"Aiko Ichikura Kento Kawaharazuka Yoshiki Obinata Kei Okada and Masayuki Inaba. 2023. A method for selecting scenes and emotion-based descriptions for a robot\u2019s diary. arXiv:2309.01951. Retrieved from https:\/\/arxiv.org\/abs\/2309.01951","DOI":"10.1109\/RO-MAN57019.2023.10309432"},{"key":"e_1_3_1_21_2","doi-asserted-by":"crossref","unstructured":"Aiko Ichikura Kento Kawaharazuka Yoshiki Obinata Koki Shinjo Kei Okada and Masayuki Inaba. 2023. Automatic diary generation system including information on joint experiences between humans and robots. arXiv:2309.01948. Retrieved from https:\/\/arxiv.org\/abs\/2309.01948","DOI":"10.1007\/978-3-031-44981-9_33"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.123\">10.18653\/v1\/2023.findings-emnlp.123\">10.18653\/v1\/2023.findings-emnlp.123"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2021.704236\">10.3389\/fpsyg.2021.704236\">10.3389\/fpsyg.2021.704236"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.494"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3434074.3447138"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.83"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-020-01364-9"},{"key":"e_1_3_1_28_2","volume-title":"Proceedings of the 38th International Conference on Neural Information Processing Systems (NIPS \u201924)","author":"Lin Sheng-Chieh","year":"2025","unstructured":"Sheng-Chieh Lin, Luyu Gao, Barlas Oguz, Wenhan Xiong, Jimmy Lin, Wen-Tau Yih, and Xilun Chen. 2025. FLAME: Factuality-aware alignment for large language models. In Proceedings of the 38th International Conference on Neural Information Processing Systems (NIPS \u201924). Curran Associates Inc., Red Hook, NY, Article 3671, 27 pages."},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2002.1048001"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2214285119"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00191"},{"issue":"2","key":"e_1_3_1_32_2","first-page":"181","article-title":"Asynchronous communication based on conversation for long-term relationship between older adult and robot","volume":"61","author":"Matsumoto Takahiro","year":"2020","unstructured":"Takahiro Matsumoto, Narimune Matsumura, Tomoki Watanabe, and Imai Michita. 2020. Asynchronous communication based on conversation for long-term relationship between older adult and robot. IPSJ Journal 61, 2 (Feb. 2020), 181\u2013199. Retrieved from https:\/\/cir.nii.ac.jp\/crid\/1050846637596336128","journal-title":"IPSJ Journal"},{"key":"e_1_3_1_33_2","first-page":"447","volume-title":"In Proceedings of the 2012 7th ACM\/IEEE International Conference on Human-Robot Interaction (HRI)","author":"Matsumoto Takahiro","year":"2012","unstructured":"Takahiro Matsumoto, Satoru Satake, Takayuki Kanda, Michita Imai, and Norihiro Hagita. 2012. Do you remember that shop?\u2014Computational model of spatial memory for shopping companion robots. In Proceedings of the 2012 7th ACM\/IEEE International Conference on Human-Robot Interaction (HRI), 447\u2013454."},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.ijcnlp-main.17"},{"issue":"2","key":"e_1_3_1_35_2","first-page":"141","article-title":"AMICSUS: A multimodal dialogue system for elderly care","volume":"68","author":"Mizuno Junta","year":"2022","unstructured":"Junta Mizuno and Yoshihiko Asano. 2022. AMICSUS: A multimodal dialogue system for elderly care. Journal of NICT 68, 2 (Dec. 2022), 141\u2013149.","journal-title":"Journal of NICT"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/ECMR.2019.8870919"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1170"},{"key":"e_1_3_1_38_2","unstructured":"mozilla. Web Speech API. Retrieved from https:\/\/developer.mozilla.org\/en-US\/docs\/Web\/API\/Web_Speech_API"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","unstructured":"NLP Connect. 2022. vit-gpt2-image-captioning (Revision 0e334c7). DOI: 10.57967\/hf\/0222","DOI":"10.57967\/hf\/0222"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/1734454.1734532"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2769493.2769521"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-4555-4_5"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/2037676.2037684"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/2324796.2324810"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jamda.2013.02.007"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3610978.3640752"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2015.7333648"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/IECON.2015.7392652"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3527188.3561931"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3382988"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2014.09.028"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-017-0093"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2017\/385"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-018-1110-0"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467831"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298935"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3610978.3640562"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0144686X09990328"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.concog.2019.03.002"},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.CD001120.pub3"},{"key":"e_1_3_1_61_2","unstructured":"YAMAHA. 2019. YVC-330. Retrieved from https:\/\/www.yamaha.com\/en\/about\/experience\/innovation-road\/collection\/detail\/9029\/"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA46639.2022.9812360"},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/SMC.2018.00637"},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2020.3034494"},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-94301-5_21"},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00697"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01329"},{"key":"e_1_3_1_68_2","unstructured":"Deyao Zhu Jun Chen Kilichbek Haydarov Xiaoqian Shen Wenxuan Zhang and Mohamed Elhoseiny. 2023. ChatGPT asks BLIP-2 answers: Automatic questioning towards enriched visual descriptions. arXiv:2303.06594. Retrieved from https:\/\/arxiv.org\/abs\/2303.06594"},{"key":"e_1_3_1_69_2","doi-asserted-by":"publisher","DOI":"10.1080\/09658211.2014.882955"},{"key":"e_1_3_1_70_2","unstructured":"SoftBank. Robot SoftBank. Retrieved August 30 2025 from https:\/\/www.softbank.jp\/en\/robot\/"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3762674","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T15:16:35Z","timestamp":1761750995000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3762674"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,28]]},"references-count":69,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1,31]]}},"alternative-id":["10.1145\/3762674"],"URL":"https:\/\/doi.org\/10.1145\/3762674","relation":{},"ISSN":["2573-9522"],"issn-type":[{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,28]]},"assertion":[{"value":"2024-02-07","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-30","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-28","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}