{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T06:20:14Z","timestamp":1775283614768,"version":"3.50.1"},"reference-count":8,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2011,7,1]],"date-time":"2011-07-01T00:00:00Z","timestamp":1309478400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100002924","name":"Federaci\u00f3n Espa\u00f1ola de Enfermedades Raras","doi-asserted-by":"publisher","award":["POSC\/339\/1.3\/C\/NAC, UMIC and FCCN"],"award-info":[{"award-number":["POSC\/339\/1.3\/C\/NAC, UMIC and FCCN"]}],"id":[{"id":"10.13039\/501100002924","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["PTDC\/EIA\/73614\/2006SFRH\/BD\/45480\/2008"],"award-info":[{"award-number":["PTDC\/EIA\/73614\/2006SFRH\/BD\/45480\/2008"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGSPATIAL Special"],"published-print":{"date-parts":[[2011,7]]},"abstract":"<jats:p>In GIR, as a research field branching from IR, initial evaluation initiatives were unsurprisingly inspired from established IR evaluation models. The GeoCLEF evaluation [6], which I will look into in some detail below, follows such a model. While this model suits the goal of a generic evaluation for all types of GIR systems, other evaluation initiatives forked so that particularly geographic challenges of the task could be more thoroughly focused on. NTCIR [7], with its GeoTime task, looked to include time expressions and had a topic set that resembles more questions that stir up the focus from retrieval, and more on reasoning.<\/jats:p>","DOI":"10.1145\/2047296.2047307","type":"journal-article","created":{"date-parts":[[2011,10,18]],"date-time":"2011-10-18T13:01:58Z","timestamp":1318942918000},"page":"46-53","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Evaluating Geographic Information Retrieval"],"prefix":"10.1145","volume":"3","author":[{"given":"Nuno","family":"Cardoso","sequence":"first","affiliation":[{"name":"University of Lisbon"}]}],"member":"320","published-online":{"date-parts":[[2011,7]]},"reference":[{"key":"e_1_2_1_2_1","first-page":"722","volume-title":"Karl Aberer, Key-Sun Choi, Natasha Noy, Dean Allemang, Kyung-Il Lee, Lyndon Nixon, Jennifer Golbeck, Peter Mika, Diana Maynard, Riichiro Mizoguchi, Guus Schreiber, and Philippe Cudr\u00e9-Mauroux","author":"Auer S\u00f6ren","year":"2007","unstructured":"S\u00f6ren Auer , Christian Bizer , Georgi Kobilarov , Jens Lehmann , Richard Cyganiak , and Zachary Ives . DBpedia: A Nucleus for a Web of Open Data . In Karl Aberer, Key-Sun Choi, Natasha Noy, Dean Allemang, Kyung-Il Lee, Lyndon Nixon, Jennifer Golbeck, Peter Mika, Diana Maynard, Riichiro Mizoguchi, Guus Schreiber, and Philippe Cudr\u00e9-Mauroux , editors, 6th International Semantic Web Conference, 2nd Asian Semantic Web Conference, ISWC 2007 + ASWC 2007, Busan, Korea, November 11--15, 2007, Proceedings, number 4825 in LNCS, pages 722 -- 735 . Springer , 2007. S\u00f6ren Auer, Christian Bizer, Georgi Kobilarov, Jens Lehmann, Richard Cyganiak, and Zachary Ives. DBpedia: A Nucleus for a Web of Open Data. In Karl Aberer, Key-Sun Choi, Natasha Noy, Dean Allemang, Kyung-Il Lee, Lyndon Nixon, Jennifer Golbeck, Peter Mika, Diana Maynard, Riichiro Mizoguchi, Guus Schreiber, and Philippe Cudr\u00e9-Mauroux, editors, 6th International Semantic Web Conference, 2nd Asian Semantic Web Conference, ISWC 2007 + ASWC 2007, Busan, Korea, November 11--15, 2007, Proceedings, number 4825 in LNCS, pages 722--735. Springer, 2007."},{"key":"e_1_2_1_4_1","volume-title":"Linguateca","author":"Cardoso Nuno","year":"2009","unstructured":"Nuno Cardoso . REMBRANDT - Reconhecimento de Entidades Mencionadas Ba seado em Rela\u00e7\u00f5es e An\u00e1lise Detalhada do Texto. In Cristina Mota and Diana Santos, editors, Desafios na avalia\u00e7\u00e3o conjunta do reconhecimento de entidades mencion adas: O Segundo HAREM . Linguateca , 2009 . in Portuguese. Nuno Cardoso. REMBRANDT - Reconhecimento de Entidades Mencionadas Ba seado em Rela\u00e7\u00f5es e An\u00e1lise Detalhada do Texto. In Cristina Mota and Diana Santos, editors, Desafios na avalia\u00e7\u00e3o conjunta do reconhecimento de entidades mencion adas: O Segundo HAREM. Linguateca, 2009. in Portuguese."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/11878773_101"},{"key":"e_1_2_1_7_1","volume-title":"Tetsuya Sakai. NTCIR-GeoTime Overview: Evaluating Geographic and Temporal Search. In Working Notes of the 8th NTCIR Workshop","author":"Gey Fredric","year":"2010","unstructured":"Fredric Gey , Ray Larson , Noriko Kando , Jorge Machado , and Tetsuya Sakai. NTCIR-GeoTime Overview: Evaluating Geographic and Temporal Search. In Working Notes of the 8th NTCIR Workshop , Tokyo, Japan, June 15--18 2010 . Fredric Gey, Ray Larson, Noriko Kando, Jorge Machado, and Tetsuya Sakai. NTCIR-GeoTime Overview: Evaluating Geographic and Temporal Search. In Working Notes of the 8th NTCIR Workshop, Tokyo, Japan, June 15--18 2010."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.1164"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 7th conference on International Language Resources and Evaluation (LREC'10)","author":"Santos Diana","year":"2010","unstructured":"Diana Santos , Lu\u00eds Miguel Cabral , Corina Forascu , Pamela Forner , Fredric Gey , Katrin Lamm , Thomas Mandl , Petya Osenova , Anselmo Pe\u00f1a , \u00c1lvaro Rodrigo , Julia Schulz , Yvonne Skalban , and Erik Tjong Kim Sang . Gikiclef : Crosscultural issues in multilingual information access. In Nicoletta Calzolari, Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Mike Rosner, and Daniel Tapias, editors , Proceedings of the 7th conference on International Language Resources and Evaluation (LREC'10) . European Language Resources Association (ELRA), La Valletta, Malta , May 2010 . Diana Santos, Lu\u00eds Miguel Cabral, Corina Forascu, Pamela Forner, Fredric Gey, Katrin Lamm, Thomas Mandl, Petya Osenova, Anselmo Pe\u00f1a, \u00c1lvaro Rodrigo, Julia Schulz, Yvonne Skalban, and Erik Tjong Kim Sang. Gikiclef: Crosscultural issues in multilingual information access. In Nicoletta Calzolari, Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Mike Rosner, and Daniel Tapias, editors, Proceedings of the 7th conference on International Language Resources and Evaluation (LREC'10). European Language Resources Association (ELRA), La Valletta, Malta, May 2010."},{"key":"e_1_2_1_13_1","volume-title":"TREC: Experiment and Evaluation in Information Retrieval","author":"Voorhees Ellen M.","year":"2005","unstructured":"Ellen M. Voorhees and Donna K. Harman , editors . TREC: Experiment and Evaluation in Information Retrieval . MIT Press , Cambridge, Massachusetts, USA , 2005 . Ellen M. Voorhees and Donna K. Harman, editors. TREC: Experiment and Evaluation in Information Retrieval. MIT Press, Cambridge, Massachusetts, USA, 2005."},{"key":"e_1_2_1_14_1","volume-title":"http:\/\/developer.yahoo.com\/geo\/geoplanet\/guide\/concepts.html","author":"Concepts Key","year":"2011","unstructured":"Yahoo! GeoPlanet#8482; Key Concepts . http:\/\/developer.yahoo.com\/geo\/geoplanet\/guide\/concepts.html , 2011 . accessed on June 2011. Yahoo! GeoPlanet#8482;Key Concepts. http:\/\/developer.yahoo.com\/geo\/geoplanet\/guide\/concepts.html, 2011. accessed on June 2011."}],"container-title":["SIGSPATIAL Special"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2047296.2047307","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2047296.2047307","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T09:54:13Z","timestamp":1750240453000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2047296.2047307"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,7]]},"references-count":8,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2011,7]]}},"alternative-id":["10.1145\/2047296.2047307"],"URL":"https:\/\/doi.org\/10.1145\/2047296.2047307","relation":{},"ISSN":["1946-7729"],"issn-type":[{"value":"1946-7729","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,7]]},"assertion":[{"value":"2011-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}