{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,4,11]],"date-time":"2025-04-11T17:45:19Z","timestamp":1744393519924,"version":"3.37.3"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"24","license":[{"start":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T00:00:00Z","timestamp":1690848000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T00:00:00Z","timestamp":1690848000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Science Foundation Ireland Centre for Research Training","award":["18\/CRT\/6223"],"award-info":[{"award-number":["18\/CRT\/6223"]}]},{"DOI":"10.13039\/501100021525","name":"Insight SFI Research Centre for Data Analytics","doi-asserted-by":"publisher","award":["SFI\/12\/RC\/2289\u02d9P2"],"award-info":[{"award-number":["SFI\/12\/RC\/2289\u02d9P2"]}],"id":[{"id":"10.13039\/501100021525","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100014826","name":"ADAPT - Centre for Digital Content Technology","doi-asserted-by":"publisher","award":["SFI\/13\/RC\/2106\u02d9P2"],"award-info":[{"award-number":["SFI\/13\/RC\/2106\u02d9P2"]}],"id":[{"id":"10.13039\/501100014826","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002081","name":"Irish Research Council","doi-asserted-by":"crossref","award":["GOIPG\/2016\/741"],"award-info":[{"award-number":["GOIPG\/2016\/741"]}],"id":[{"id":"10.13039\/501100002081","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001638","name":"Dublin City University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001638","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2023,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Lifelogging was introduced as the process of passively capturing personal daily events via wearable devices. It ultimately creates a visual diary encoding every aspect of one\u2019s life with the aim of future sharing or recollecting. In this paper, we present LifeSeeker, a lifelog image retrieval system participating in the Lifelog Search Challenge (LSC) for 3 years, since 2019. Our objective is to support users to seek specific life moments using a combination of textual descriptions, spatial relationships, location information, and image similarities. In addition to the LSC challenge results, a further experiment was conducted in order to evaluate the power retrieval of our system on both expert and novice users. This experiment informed us about the effectiveness of the user\u2019s interaction with the system when involving non-experts.<\/jats:p>","DOI":"10.1007\/s11042-023-15317-w","type":"journal-article","created":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T08:02:29Z","timestamp":1690876949000},"page":"37855-37876","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["LifeSeeker: an interactive concept-based retrieval system for lifelog data"],"prefix":"10.1007","volume":"82","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1356-9434","authenticated-orcid":false,"given":"Thao-Nhu","family":"Nguyen","sequence":"first","affiliation":[]},{"given":"Tu-Khiem","family":"Le","sequence":"additional","affiliation":[]},{"given":"Van-Tu","family":"Ninh","sequence":"additional","affiliation":[]},{"given":"Annalina","family":"Caputo","sequence":"additional","affiliation":[]},{"given":"Graham","family":"Healy","sequence":"additional","affiliation":[]},{"given":"Sin\u00e9ad","family":"Smyth","sequence":"additional","affiliation":[]},{"given":"Minh-Triet","family":"Tran","sequence":"additional","affiliation":[]},{"given":"Nguyen Thanh","family":"Binh","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,8,1]]},"reference":[{"key":"15317_CR1","doi-asserted-by":"publisher","unstructured":"Alam N, Graham Y, Gurrin C (2021) Memento: a prototype lifelog search engine for lsc\u201921. In: Proceedings of the 4th annual on lifelog search challenge LSC \u201921. Association for Computing Machinery, New York, pp 53\u201358. https:\/\/doi.org\/10.1145\/3463948.3469069","DOI":"10.1145\/3463948.3469069"},{"key":"15317_CR2","doi-asserted-by":"publisher","unstructured":"Alateeq A, Roantree M, Gurrin C (2021) Voxento 2.0: a prototype voice-controlled interactive search engine for lifelogs. In: Proceedings of the 4th annual on lifelog search challenge LSC \u201921. Association for Computing Machinery, New York, pp 65\u201370. https:\/\/doi.org\/10.1145\/3463948.3469071","DOI":"10.1145\/3463948.3469071"},{"key":"15317_CR3","doi-asserted-by":"crossref","unstructured":"Anderson P, He X, Buehler C, Teney D, Johnson M, Gould S, Zhang L (2018) Bottom-up and top-down attention for image captioning and visual question answering. In: CVPR","DOI":"10.1109\/CVPR.2018.00636"},{"key":"15317_CR4","doi-asserted-by":"crossref","unstructured":"Bay H, Tuytelaars T, Gool L V (2006) Surf: speeded up robust features. In: European conference on computer vision. Springer, pp 404\u2013417","DOI":"10.1007\/11744023_32"},{"key":"15317_CR5","unstructured":"Dang-Nguyen D-T, Piras L, Riegler M, Zhou L, Lux M, Gurrin C (2018) Overview of imagecleflifelog 2018: daily living understanding and lifelog moment retrieval.. In: CLEF (working notes)"},{"key":"15317_CR6","unstructured":"Dang Nguyen D T, Piras L, Riegler M, Zhou L, Lux M, Tran M T, Le T-K, Ninh V-T, Gurrin C (2019) Overview of imagecleflifelog 2019: solve my life puzzle and lifelog moment retrieval. CEUR Workshop proceedings"},{"key":"15317_CR7","unstructured":"Gurrin C, Joho H, Hopfgartner F, Zhou L, Ninh T, Le T-K, Albatal R, Dang-Nguyen D-T, Healy G (2019) Overview of the ntcir-14 lifelog-3 task"},{"key":"15317_CR8","doi-asserted-by":"crossref","unstructured":"Gurrin C, Joho H, Hopfgartner F, Zhou L, Albatal R (2016) Ntcir lifelog: the first test collection for lifelog research, pp 705\u2013708","DOI":"10.1145\/2911451.2914680"},{"key":"15317_CR9","doi-asserted-by":"publisher","unstructured":"Gurrin C, J\u00f3nsson Bjorn THor, Sch\u00f6ffmann K, Dang-Nguyen D-T, Loko\u010d J, Tran M-T, H\u00fcrst W, Rossetto L, Healy G (2021) Introduction to the fourth annual lifelog search challenge, lsc\u201921. Association for Computing Machinery, New York. https:\/\/doi.org\/10.1145\/3460426.3470945","DOI":"10.1145\/3460426.3470945"},{"key":"15317_CR10","doi-asserted-by":"publisher","unstructured":"Gurrin C, Le T-K, Ninh V-T, Dang-Nguyen D-T, J\u00f3nsson Bjorn THor, Loko\u010d J, H\u00fcrst W, Tran M-T, Sch\u00f6ffmann K (2020) Introduction to the third annual lifelog search challenge (lsc\u201920). In: Proceedings of the 2020 international conference on multimedia retrieval. Association for Computing Machinery, New York, pp 584\u2013585. https:\/\/doi.org\/10.1145\/3372278.3388043","DOI":"10.1145\/3372278.3388043"},{"key":"15317_CR11","doi-asserted-by":"publisher","unstructured":"Gurrin C, Schoeffmann K, Joho H, Leibetseder A, Zhou L, Duane A, Dang Nguyen D T, Riegler M, Piras L, Tran M-T, Loko\u010d? J, H\u00fcrst W (2019) [invited papers] comparing approaches to interactive lifelog search at the lifelog search challenge (lsc2018). ITE Trans Media Technol Applic 7:46\u201359. https:\/\/doi.org\/10.3169\/mta.7.46","DOI":"10.3169\/mta.7.46"},{"issue":"1","key":"15317_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/1500000033","volume":"8","author":"C Gurrin","year":"2014","unstructured":"Gurrin C, Smeaton A F, Doherty A R (2014) Lifelogging: personal big data. Found Trends Inf Retr 8(1):1\u2013125. https:\/\/doi.org\/10.1561\/1500000033","journal-title":"Found Trends Inf Retr"},{"key":"15317_CR13","doi-asserted-by":"publisher","unstructured":"Heller S, Gasser R, Parian-Scherb M, Popovic S, Rossetto L, Sauter L, Spiess F, Schuldt H (2021) Interactive multimodal lifelog retrieval with vitrivr at lsc 2021. In: Proceedings of the 4th annual on lifelog search challenge LSC \u201921. Association for Computing Machinery, New York, pp 35\u201339. https:\/\/doi.org\/10.1145\/3463948.3469062","DOI":"10.1145\/3463948.3469062"},{"issue":"1","key":"15317_CR14","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1007\/s11263-016-0981-7","volume":"123","author":"R Krishna","year":"2017","unstructured":"Krishna R, Zhu Y, Groth O, Johnson J, Hata K, Kravitz J, Chen S, Kalantidis Y, Li L-J, Shamma D A et al (2017) Visual genome: connecting language and vision using crowdsourced dense image annotations. Int J Comput Vis 123(1):32\u201373","journal-title":"Int J Comput Vis"},{"key":"15317_CR15","doi-asserted-by":"publisher","unstructured":"Le T-K, Ninh V-T, Dang-Nguyen D-T, Tran M-T, Zhou L, Redondo P, Smyth S, Gurrin C (2019) Lifeseeker: interactive lifelog search engine at lsc 2019. LSC \u201919. Association for Computing Machinery, New York, NY, USA, pp 37\u201340. https:\/\/doi.org\/10.1145\/3326460.3329162","DOI":"10.1145\/3326460.3329162"},{"key":"15317_CR16","doi-asserted-by":"publisher","unstructured":"Le T-K, Ninh V-T, Tran M-T, Nguyen T-A, Nguyen H-D, Zhou L, Healy G, Gurrin C (2020) Lifeseeker 2.0: interactive lifelog search engine at lsc 2020. In: Proceedings of the third annual workshop on lifelog search challenge. Association for Computing Machinery, New York, pp 57\u201362. https:\/\/doi.org\/10.1145\/3379172.3391724","DOI":"10.1145\/3379172.3391724"},{"key":"15317_CR17","doi-asserted-by":"crossref","unstructured":"Lin T-Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Doll\u00e1r P, Zitnick C L (2014) Microsoft coco: common objects in context. In: European conference on computer vision. Springer, pp 740\u2013755","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"15317_CR18","doi-asserted-by":"publisher","unstructured":"Loko\u010d J, Mejzlik F, Vesel\u00fd P, Sou\u010dek T (2021) Enhanced somhunter for known-item search in lifelog data. In: Proceedings of the 4th annual on lifelog search challenge LSC \u201921. Association for Computing Machinery, New York, pp 71\u201373. https:\/\/doi.org\/10.1145\/3463948.3469074","DOI":"10.1145\/3463948.3469074"},{"issue":"2","key":"15317_CR19","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","volume":"60","author":"DG Lowe","year":"2004","unstructured":"Lowe D G (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91\u2013110","journal-title":"Int J Comput Vis"},{"key":"15317_CR20","doi-asserted-by":"publisher","unstructured":"Nguyen T-N, Le T-K, Ninh V-T, Tran M-T, Thanh Binh N, Healy G, Caputo A, Gurrin C (2021) Lifeseeker 3.0: an interactive lifelog search engine for lsc\u201921. In: Proceedings of the 4th annual on lifelog search challenge LSC \u201921. Association for Computing Machinery, New York, NY, USA, pp 41\u201346. https:\/\/doi.org\/10.1145\/3463948.3469065","DOI":"10.1145\/3463948.3469065"},{"key":"15317_CR21","unstructured":"Ninh V-T, Le T-K, Zhou L, Piras L, Riegler M A, Halvorsen P, Lux M, Tran M-T, Gurrin C, Dang Nguyen D T (2020) Overview of imageclef lifelog 2020: lifelog moment retrieval and sport performance lifelog"},{"key":"15317_CR22","unstructured":"Radford A, Kim J W, Hallacy C, Ramesh A, Goh G, Agarwal S, Sastry G, Askell A, Mishkin P, Clark J, Krueger G, Sutskever I (2021) Learning transferable visual models from natural language supervision. arXiv:https:\/\/arxiv.org\/abs\/2103.00020"},{"key":"15317_CR23","doi-asserted-by":"publisher","unstructured":"Rossetto L, Baumgartner M, Gasser R, Heitz L, Wang R, Bernstein A (2021) Exploring graph-querying approaches in lifegraph. In: Proceedings of the 4th annual on lifelog search challenge LSC \u201921. Association for Computing Machinery, New York, NY, USA, pp 7\u201310. https:\/\/doi.org\/10.1145\/3463948.3469068","DOI":"10.1145\/3463948.3469068"},{"key":"15317_CR24","doi-asserted-by":"crossref","unstructured":"Rublee E, Rabaud V, Konolige K, Bradski G (2011) Orb: an efficient alternative to sift or surf. In: 2011 International conference on computer vision. IEEE, pp 2564\u20132571","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"15317_CR25","doi-asserted-by":"crossref","unstructured":"Sculley D (2010) Web-scale k-means clustering. In: Proceedings of the 19th international conference on World wide web, pp 1177\u20131178","DOI":"10.1145\/1772690.1772862"},{"key":"15317_CR26","doi-asserted-by":"publisher","unstructured":"Spiess F, Gasser R, Heller S, Rossetto L, Sauter L, van Zanten M, Schuldt H (2021) Exploring intuitive lifelog retrieval and interaction modes in virtual reality with vitrivr-vr. In: Proceedings of the 4th annual on lifelog search challenge LSC \u201921. Association for Computing Machinery, New York, pp 17\u201322. https:\/\/doi.org\/10.1145\/3463948.3469061","DOI":"10.1145\/3463948.3469061"},{"key":"15317_CR27","doi-asserted-by":"publisher","unstructured":"Tran L-D, Nguyen M-D, Thanh Binh N, Lee H, Gurrin C (2021) Mysc\u00e9al 2.0: a revised experimental interactive lifelog retrieval system for lsc\u201921. In: Proceedings of the 4th annual on lifelog search challenge. LSC \u201921. Association for Computing Machinery, New York, pp 11\u201316. https:\/\/doi.org\/10.1145\/3463948.3469064","DOI":"10.1145\/3463948.3469064"},{"key":"15317_CR28","doi-asserted-by":"crossref","unstructured":"Wang C-Y, Bochkovskiy A, Liao H-Y M (2021) Scaled-YOLOv4: Scaling cross stage partial network. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR), pp 13029\u201313038","DOI":"10.1109\/CVPR46437.2021.01283"},{"key":"15317_CR29","doi-asserted-by":"crossref","unstructured":"Zhou B, Lapedriza A, Khosla A, Oliva A, Torralba A (2017) Places: a 10 million image database for scene recognition. IEEE Trans Pattern Anal Mach Intell","DOI":"10.1167\/17.10.296"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-15317-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-023-15317-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-15317-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,3]],"date-time":"2023-10-03T09:33:58Z","timestamp":1696325638000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-023-15317-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,1]]},"references-count":29,"journal-issue":{"issue":"24","published-print":{"date-parts":[[2023,10]]}},"alternative-id":["15317"],"URL":"https:\/\/doi.org\/10.1007\/s11042-023-15317-w","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"type":"print","value":"1380-7501"},{"type":"electronic","value":"1573-7721"}],"subject":[],"published":{"date-parts":[[2023,8,1]]},"assertion":[{"value":"7 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 December 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 April 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 August 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflict of Interests"}}]}}