{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:21:40Z","timestamp":1776108100051,"version":"3.50.1"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2008,7,1]],"date-time":"2008-07-01T00:00:00Z","timestamp":1214870400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004966","name":"Fifth Framework Programme","doi-asserted-by":"publisher","award":["HPMT-CT-2001-00326"],"award-info":[{"award-number":["HPMT-CT-2001-00326"]}],"id":[{"id":"10.13039\/501100004966","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Comput. Entertain."],"published-print":{"date-parts":[[2008,7]]},"abstract":"<jats:p>This article presents the results of the evaluation study of the Augmented Representation of Cultural Objects (ARCO) system which provides software and interface tools to museum curators for the development of virtual museum exhibitions for the World Wide Web or for information kiosks. The aim of the current research is to investigate how a virtual museum system is coping with the demands of museum curators, to examine the needs of virtual museum visitors, and to provide a set of criteria and guidelines for defining effective evaluation of such systems. Evaluation methods such as heuristic evaluation and walkthroughs were employed in the study in order to assess various components and interfaces of the system.<\/jats:p>","DOI":"10.1145\/1371216.1371226","type":"journal-article","created":{"date-parts":[[2008,8,5]],"date-time":"2008-08-05T13:35:10Z","timestamp":1217943310000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["The evaluation of ARCO"],"prefix":"10.1145","volume":"6","author":[{"given":"Styliani","family":"Sylaiou","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"M.","family":"Economou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A.","family":"Karoulis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"M.","family":"White","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2008,7]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"ARCO Evaluation Report. 2004. Assessment and Evaluation report on the ARCO system and its components. Retrieved July 1 2007: http:\/\/www.arco-web.org\/TextVersion\/Documents\/Deliverables\/Arco-D16-R-1.0-170904.pdf  ARCO Evaluation Report. 2004. Assessment and Evaluation report on the ARCO system and its components. Retrieved July 1 2007: http:\/\/www.arco-web.org\/TextVersion\/Documents\/Deliverables\/Arco-D16-R-1.0-170904.pdf"},{"key":"e_1_2_1_2_1","volume-title":"Budapest: Archaeolingua.","author":"Arnold D.","year":"2007"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.920621"},{"key":"e_1_2_1_4_1","volume-title":"Washington, DC: AAM.","author":"Borun M.","year":"1999"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4379(00)00015-6"},{"key":"e_1_2_1_6_1","unstructured":"CIDOC Multimedia Working Group. 1997. Multimedia Evaluation Criteria. (Chair: J. Trant). Retrieved July I 2007: http:\/\/www.archimuse.com\/papers\/cidoc\/cidoc.mmwg.eval.crit.html  CIDOC Multimedia Working Group. 1997. Multimedia Evaluation Criteria. (Chair: J. Trant). Retrieved July I 2007: http:\/\/www.archimuse.com\/papers\/cidoc\/cidoc.mmwg.eval.crit.html"},{"key":"e_1_2_1_7_1","unstructured":"Di Bias N. Guermand M. P. Orsini C. and P. Paolini. 2002. Evaluating the Features of Museum Websites (The Bologna Report). Retrieved July 1 2007: http:\/\/www.archimuse.com\/mw2002\/papers\/diblas\/diblas.html  Di Bias N. Guermand M. P. Orsini C. and P. Paolini. 2002. Evaluating the Features of Museum Websites (The Bologna Report). Retrieved July 1 2007: http:\/\/www.archimuse.com\/mw2002\/papers\/diblas\/diblas.html"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of CAA (Computer Applications and Quantitative Methods in Archaeology) (pp. 200--203)","author":"Di Blas N."},{"key":"e_1_2_1_9_1","unstructured":"Dumas J. F. and J. C. Redish. 1999. A practical guide to usability testing. Portland Intellect Ltd.   Dumas J. F. and J. C. Redish. 1999. A practical guide to usability testing. Portland Intellect Ltd."},{"key":"e_1_2_1_10_1","unstructured":"Economou M. 2002. XII: Assessment of Projects by User Evaluation. In Guide to Good Practice in Digital Representation and Management of Cultural Heritage Material' by the National Initiative for a Networked Cultural Heritage USA. Retrieved January 22 2006 on the World Wide Web: http:\/\/www.nvu.edu\/its\/humanities\/ninchguide\/  Economou M. 2002. XII: Assessment of Projects by User Evaluation. In Guide to Good Practice in Digital Representation and Management of Cultural Heritage Material ' by the National Initiative for a Networked Cultural Heritage USA. Retrieved January 22 2006 on the World Wide Web: http:\/\/www.nvu.edu\/its\/humanities\/ninchguide\/"},{"key":"e_1_2_1_11_1","volume-title":"Work: Cooperative Design of Computer Systems.","author":"Greenbaum J.","year":"1991"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/1525822X05279903"},{"key":"e_1_2_1_13_1","unstructured":"Hein G. E. 1998. Learning in the museum. London: Routledge.  Hein G. E. 1998. Learning in the museum. London: Routledge."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1080\/135272500363715"},{"key":"e_1_2_1_15_1","unstructured":"Hoptman G. H. 1992. The Virtual Museum and Related Epistemological Concerns. Sociomedia. Multimedia Hypermedia and the Social Construction of Knowledge: 141--159.  Hoptman G. H. 1992. The Virtual Museum and Related Epistemological Concerns. Sociomedia. Multimedia Hypermedia and the Social Construction of Knowledge: 141--159."},{"key":"e_1_2_1_16_1","unstructured":"IBM a User-Centered Design principles. Retrieved July 1 2007: http:\/\/www-03.ibm.com\/easy\/page\/13  IBM a User-Centered Design principles. Retrieved July 1 2007: http:\/\/www-03.ibm.com\/easy\/page\/13"},{"key":"e_1_2_1_17_1","unstructured":"IBM b Design basics. Retrieved July 1 2007: http:\/\/www-03.ibm.com\/easy\/page\/6  IBM b Design basics. Retrieved July 1 2007: http:\/\/www-03.ibm.com\/easy\/page\/6"},{"key":"e_1_2_1_18_1","unstructured":"ICOM\/CIDOC. Multimedia Working Group. 1996. Introduction to Multimedia in Museums. Retrieved July 1 2007: http:\/\/www.willpowerinfo.myby.co.uk\/cidoc\/introtomultimediamuseums.pdf  ICOM\/CIDOC. Multimedia Working Group. 1996. Introduction to Multimedia in Museums. Retrieved July 1 2007: http:\/\/www.willpowerinfo.myby.co.uk\/cidoc\/introtomultimediamuseums.pdf"},{"key":"e_1_2_1_19_1","unstructured":"ISO (International Organization for Standardization) 1998. ISO 9241: Ergonomic requirements for office work with visual display terminals (VDTs).  ISO (International Organization for Standardization) 1998. ISO 9241: Ergonomic requirements for office work with visual display terminals (VDTs)."},{"key":"e_1_2_1_20_1","unstructured":"Jones J. and M. Christal. 2002. The Future of Virtual Museums: On-Line Immersive 3D Environments. Created Realities Group white paper. Retrieved July 1 2007: http:\/\/created-realities.com\/pdf\/Virtual_Museums.pdf  Jones J. and M. Christal. 2002. The Future of Virtual Museums: On-Line Immersive 3D Environments. Created Realities Group white paper. Retrieved July 1 2007: http:\/\/created-realities.com\/pdf\/Virtual_Museums.pdf"},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of Lanugage Resources and Evaluation (LREC) 2004","author":"Karasimos A."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/142750.142873"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/1156068.1156199"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/1413852.1413856"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/2384368.2384375"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/97243.97279"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/2384368.2384375"},{"issue":"2","key":"e_1_2_1_28_1","first-page":"32","article-title":"The Cost of Collecting","volume":"89","author":"Lord G. D.","year":"1989","journal-title":"Museums Journal"},{"key":"e_1_2_1_29_1","volume-title":"London: HMSO.","author":"Lord G. D.","year":"1989"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1031570.1031574"},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Monopoli M and Nicholas D. 2001. 'A user evaluation of subject based information gateways: A case study ADAM' Aslib Proceedings Vol 53 (1) January 2001: 39--52.  Monopoli M and Nicholas D. 2001. 'A user evaluation of subject based information gateways: A case study ADAM' Aslib Proceedings Vol 53 (1) January 2001: 39--52.","DOI":"10.1108\/EUM0000000007036"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of Dublin Core Conference (DC2003)","author":"Mourkoussis N.","year":"2003"},{"key":"e_1_2_1_33_1","volume-title":"Hillsdale NJ: Lawrence Erlbaum.","author":"Namioka A.","year":"1993"},{"key":"e_1_2_1_34_1","volume-title":"Lord, G. D. and Lord, B. (Eds) The Manual of Museum Planning.","author":"Nicks J.","edition":"2"},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Nielsen J. 1993. Usability Engineering New York NY: Academic Press Inc.   Nielsen J. 1993. Usability Engineering New York NY: Academic Press Inc.","DOI":"10.1016\/B978-0-08-052029-2.50007-3"},{"key":"e_1_2_1_36_1","volume-title":"Hillsdale, NJ: Lawrence Erlbaum.","author":"Norman D. A.","year":"1986"},{"key":"e_1_2_1_37_1","unstructured":"Pearce S. M. 1992. Museums Objects and Collections: A Cultural Study. Leicester and London: Leicester University Press.  Pearce S. M. 1992. Museums Objects and Collections: A Cultural Study. Leicester and London: Leicester University Press."},{"key":"e_1_2_1_38_1","unstructured":"Preece J. Roger Y. Sharp H. Beyon D. Holland S. and Carey I. (1994). Human Computer Interaction. Wokingham UK: Addison Wesley.   Preece J. Roger Y. Sharp H. Beyon D. Holland S. and Carey I. (1994). Human Computer Interaction. Wokingham UK: Addison Wesley."},{"key":"e_1_2_1_39_1","volume-title":"Interaction Design: Beyond Human-Computer Interaction.","author":"Preece J.","year":"2002"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1525\/aa.1986.88.2.02a00020"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/1525822X02239569"},{"key":"e_1_2_1_42_1","volume-title":"68th IFLA Council and General Conference August 18--24, 2002","author":"Scali G.","year":"2007"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/WSE.2005.1"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 10th International Conference on Virtual Systems and Multimedia, Hybrid Realities-Digital Partners, Explorations in Art, Heritage, Science and the Human Factor (VSMM04)","author":"Sylaiou S.","year":"2004"},{"key":"e_1_2_1_45_1","unstructured":"Treinen H. 1996. Ausstellungen und Kommunikationstheorie. In Haus der Geschichte der Bundesrepublik Deutschland (Hrsg.) Museen und ihre Besucher Berlin: Argon.  Treinen H. 1996. Ausstellungen und Kommunikationstheorie. In Haus der Geschichte der Bundesrepublik Deutschland (Hrsg.) Museen und ihre Besucher Berlin: Argon."},{"key":"e_1_2_1_46_1","unstructured":"Tsapatori M. 2003. ORION Research Roadmap Evaluation and Assessment Object Rich Information Network (ORION) Deliverable 8. Retrieved July 1 2007: http:\/\/www.orionnet.org\/Admin\/LibraryLoc\/file28.pdf  Tsapatori M. 2003. ORION Research Roadmap Evaluation and Assessment Object Rich Information Network (ORION) Deliverable 8. Retrieved July 1 2007: http:\/\/www.orionnet.org\/Admin\/LibraryLoc\/file28.pdf"},{"key":"e_1_2_1_47_1","unstructured":"Vergo P. (ed.) 1989. The New Museology. London: Reaktion Books.  Vergo P. (ed.) 1989. The New Museology. London: Reaktion Books."},{"key":"e_1_2_1_48_1","unstructured":"Virtual Showcases. 2004. Evaluation Report. Retrieved July 1 2007: http:\/\/www.virtualshowcases.com\/Technical\/Deliverables.asp  Virtual Showcases. 2004. Evaluation Report. Retrieved July 1 2007: http:\/\/www.virtualshowcases.com\/Technical\/Deliverables.asp"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-73078-1_50"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/1009379.1009660"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/985040.985060"},{"issue":"1","key":"e_1_2_1_52_1","first-page":"39","article-title":"A naturalistic view of evaluation","volume":"58","author":"Wolf R. L.","year":"1980","journal-title":"Museum News"}],"container-title":["Computers in Entertainment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1371216.1371226","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1371216.1371226","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:56:20Z","timestamp":1750254980000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1371216.1371226"}},"subtitle":["a lesson in curatorial competence and intuition with new technology"],"short-title":[],"issued":{"date-parts":[[2008,7]]},"references-count":52,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2008,7]]}},"alternative-id":["10.1145\/1371216.1371226"],"URL":"https:\/\/doi.org\/10.1145\/1371216.1371226","relation":{},"ISSN":["1544-3574"],"issn-type":[{"value":"1544-3574","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,7]]},"assertion":[{"value":"2007-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}