{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:25:56Z","timestamp":1750307156384,"version":"3.41.0"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2012,5,1]],"date-time":"2012-05-01T00:00:00Z","timestamp":1335830400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004963","name":"Seventh Framework Programme","doi-asserted-by":"publisher","award":["ICT-269940\/TIMBUS"],"award-info":[{"award-number":["ICT-269940\/TIMBUS"]}],"id":[{"id":"10.13039\/501100004963","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004965","name":"Sixth Framework Programme","doi-asserted-by":"publisher","award":["IST-033789\/PLANETS"],"award-info":[{"award-number":["IST-033789\/PLANETS"]}],"id":[{"id":"10.13039\/501100004965","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2012,5]]},"abstract":"<jats:p>Accessible emulation is often the method of choice for maintaining digital objects, specifically complex ones such as applications, business processes, or electronic art. However, validating the emulator\u2019s ability to faithfully reproduce the original behavior of digital objects is complicated.<\/jats:p>\n          <jats:p>This article presents an evaluation framework and a set of tests that allow assessment of the degree to which system emulation preserves original characteristics and thus significant properties of digital artifacts. The original system, hardware, and software properties are described. Identical environment is then recreated via emulation. Automated user input is used to eliminate potential confounders. The properties of a rendered form of the object are then extracted automatically or manually either in a target state, a series of states, or as a continuous stream. The concepts described in this article enable preservation planners to evaluate how emulation affects the behavior of digital objects compared to their behavior in the original environment. We also review how these principles can and should be applied to the evaluation of migration and other preservation strategies as a general principle of evaluating the invocation and faithful rendering of digital objects and systems. The article concludes with design requirements for emulators developed for digital preservation tasks.<\/jats:p>","DOI":"10.1145\/2180868.2180876","type":"journal-article","created":{"date-parts":[[2012,5,23]],"date-time":"2012-05-23T15:47:01Z","timestamp":1337788021000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["A Measurement Framework for Evaluating Emulators for Digital Preservation"],"prefix":"10.1145","volume":"30","author":[{"given":"Mark","family":"Guttenbrunner","sequence":"first","affiliation":[{"name":"Secure Business Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andreas","family":"Rauber","sequence":"additional","affiliation":[{"name":"Vienna University of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2012,5]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Aitken B. Helwig P. Jackson A. N. Lindley A. Nicchiarelli E. and Ross S. 2008. The planets testbed: Science for digital preservation. Code4Lib 3. Aitken B. Helwig P. Jackson A. N. Lindley A. Nicchiarelli E. and Ross S. 2008. The planets testbed: Science for digital preservation. Code4Lib 3 ."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21527"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1998076.1998089"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1378889.1378954"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1363686.1363786"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00799-009-0057-1"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1367080.1367086"},{"key":"e_1_2_1_8_1","unstructured":"Brown A. 2008. Automatic format identification using PRONOM and DROID. Digital Preservation Tech. paper 1. http:\/\/www.nationalarchives.gov.uk\/aboutapps\/fileformat\/pdf\/automatic_format_identification.pdf (Last accessed 2\/12). Brown A. 2008. Automatic format identification using PRONOM and DROID. Digital Preservation Tech. paper 1. http:\/\/www.nationalarchives.gov.uk\/aboutapps\/fileformat\/pdf\/automatic_format_identification.pdf (Last accessed 2\/12)."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/336512.336559"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00799-009-0051-7"},{"key":"e_1_2_1_11_1","unstructured":"Dumke R. 2003. Software Engineering-Eine Einf\u00fchrung f\u00fcr Informatiker und Ingenieure: Systeme Erfahrungen Methoden Tools. 4. Vieweg. Dumke R. 2003. Software Engineering-Eine Einf\u00fchrung f\u00fcr Informatiker und Ingenieure: Systeme Erfahrungen Methoden Tools. 4 . Vieweg."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45236-2_12"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1080343.1080346"},{"key":"e_1_2_1_14_1","first-page":"10","article-title":"Emulation as a digital preservation strategy","volume":"6","author":"Granger S.","year":"2000","unstructured":"Granger , S. 2000 . Emulation as a digital preservation strategy . D-Lib Mag. 6 , 10 . http:\/\/www.dlib.org\/dlib\/october00\/granger\/10granger.html. (Last accessed 2\/12). Granger, S. 2000. Emulation as a digital preservation strategy. D-Lib Mag. 6, 10. http:\/\/www.dlib.org\/dlib\/october00\/granger\/10granger.html. (Last accessed 2\/12).","journal-title":"D-Lib Mag."},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the Workshop on Data Analysis (WDA\u201909)","author":"Guttenbrunner M.","year":"2009","unstructured":"Guttenbrunner , M. 2009 . Challenges for the evaluation of emulation . In Proceedings of the Workshop on Data Analysis (WDA\u201909) . 29--35. Guttenbrunner, M. 2009. Challenges for the evaluation of emulation. In Proceedings of the Workshop on Data Analysis (WDA\u201909). 29--35."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.2218\/ijdc.v5i1.144"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Guttenbrunner M. Wieners J. Rauber A. and \n      Thaller M\n  . \n  2010\n  b. Same same but different - Comparing rendering environments for interactive digital objects. In EuroMed M. Ioannides D. W. Fellner A. Georgopoulos and D. G. Hadjimitsis Eds. Lecture Notes in Computer Science vol. \n  6436 Springer 140--152. Guttenbrunner M. Wieners J. Rauber A. and Thaller M. 2010b. Same same but different - Comparing rendering environments for interactive digital objects. In EuroMed M. Ioannides D. W. Fellner A. Georgopoulos and D. G. Hadjimitsis Eds. Lecture Notes in Computer Science vol. 6436 Springer 140--152.","DOI":"10.1007\/978-3-642-16873-4_11"},{"key":"e_1_2_1_18_1","first-page":"28","article-title":"The old version flickers more: Digital preservation from the user\u2019s perspective","volume":"69","author":"Hedstrom M.","year":"2006","unstructured":"Hedstrom , M. , Lee , C. , Olson , J. , and Lampe , C. 2006 . The old version flickers more: Digital preservation from the user\u2019s perspective . Amer. Archiv. 69 , 28 . Hedstrom, M., Lee, C., Olson, J., and Lampe, C. 2006. The old version flickers more: Digital preservation from the user\u2019s perspective. Amer. Archiv. 69, 28.","journal-title":"Amer. Archiv."},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the Annual Meeting of the American Institute for Conservation of Historic and Artistic Works. Electronic Media Group.","author":"Jones C.","year":"2004","unstructured":"Jones , C. 2004 . Seeing double: Emulation in theory and practice. The Erl King case study . In Proceedings of the Annual Meeting of the American Institute for Conservation of Historic and Artistic Works. Electronic Media Group. Jones, C. 2004. Seeing double: Emulation in theory and practice. The Erl King case study. In Proceedings of the Annual Meeting of the American Institute for Conservation of Historic and Artistic Works. Electronic Media Group."},{"key":"e_1_2_1_20_1","unstructured":"Kleiner K. 2001. I love space invaders. New Sci. 172 2313 46--8. Kleiner K. 2001. I love space invaders. New Sci. 172 2313 46--8."},{"key":"e_1_2_1_21_1","volume-title":"B: Formal Models and Semantics","author":"Lamport L.","year":"1990","unstructured":"Lamport , L. and Lynch , N . 1990 . Handbook of Theoretical Computer Science Vol . B: Formal Models and Semantics . Elsevier Science Publishers B.V. , 1157--1200. Lamport, L. and Lynch, N. 1990. Handbook of Theoretical Computer Science Vol. B: Formal Models and Semantics. Elsevier Science Publishers B.V., 1157--1200."},{"volume-title":"Real-Time Systems","author":"Liu J. W. S. W.","key":"e_1_2_1_22_1","unstructured":"Liu , J. W. S. W. 2000. Real-Time Systems . Prentice Hall PTR , Upper Saddle River, NJ. Liu, J. W. S. W. 2000. Real-Time Systems. Prentice Hall PTR, Upper Saddle River, NJ."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0099-1333(96)90006-3"},{"key":"e_1_2_1_24_1","unstructured":"Matthews B. McIlwrath B. Giaretta D. and Conway E. 2008. The significant properties of software: A study. JISC Study. http:\/\/www.jisc.ac.uk\/media\/documents\/programmes\/preservation\/spsoftware_report_redacted.pdf. (Last accessed 2\/12). Matthews B. McIlwrath B. Giaretta D. and Conway E. 2008. The significant properties of software: A study. JISC Study. http:\/\/www.jisc.ac.uk\/media\/documents\/programmes\/preservation\/spsoftware_report_redacted.pdf. (Last accessed 2\/12)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/11551362_24"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743546.1743566"},{"volume-title":"Avoiding Technological Quicksand: Finding a Viable Technical Foundation for Digital Preservation","author":"Rothenberg J.","key":"e_1_2_1_27_1","unstructured":"Rothenberg , J. 1999. Avoiding Technological Quicksand: Finding a Viable Technical Foundation for Digital Preservation . Council on Library and Information Resources . http:\/\/www.clir.org\/pubs\/reports\/rothenberg\/contents.html. (Last accessed 2\/12). Rothenberg, J. 1999. Avoiding Technological Quicksand: Finding a Viable Technical Foundation for Digital Preservation. Council on Library and Information Resources. http:\/\/www.clir.org\/pubs\/reports\/rothenberg\/contents.html. (Last accessed 2\/12)."},{"key":"e_1_2_1_28_1","volume-title":"Emulation: Context and current status. Tech. rep","author":"Slats J.","year":"2003","unstructured":"Slats , J. 2003 . Emulation: Context and current status. Tech. rep . http:\/\/www.nationaalarchief.nl\/kennisbank\/emulation-context-and-current-status-2003. (Last accessed 2\/12). Slats, J. 2003. Emulation: Context and current status. Tech. rep. http:\/\/www.nationaalarchief.nl\/kennisbank\/emulation-context-and-current-status-2003. (Last accessed 2\/12)."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1255175.1255181"},{"key":"e_1_2_1_30_1","unstructured":"Thaller M. 2008. Interaction testing benchmark deliverable PC\/2 - D6. Internal Deliverable EU Project Planets. http:\/\/planetarium.hki.uni-koeln.de\/planets_cms\/sites\/default\/files\/PC2D15_CIM.pdf (Last accessed 2\/12). Thaller M. 2008. Interaction testing benchmark deliverable PC\/2 - D6. Internal Deliverable EU Project Planets. http:\/\/planetarium.hki.uni-koeln.de\/planets_cms\/sites\/default\/files\/PC2D15_CIM.pdf (Last accessed 2\/12)."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.2218\/ijdc.v2i2.35"},{"volume-title":"Preservation requirements in a deposit system. IBM\/KB Long-Term Preservation Study Report Series Number 3","author":"van Diessen R. J.","key":"e_1_2_1_32_1","unstructured":"van Diessen , R. J. 2002. Preservation requirements in a deposit system. IBM\/KB Long-Term Preservation Study Report Series Number 3 Chapter 3. http:\/\/www.kb.nl\/hrd\/dd\/dd_onderzoek\/reports\/3-preservation.pdf ( Last accessed 2\/12). van Diessen, R. J. 2002. Preservation requirements in a deposit system. IBM\/KB Long-Term Preservation Study Report Series Number 3 Chapter 3. http:\/\/www.kb.nl\/hrd\/dd\/dd_onderzoek\/reports\/3-preservation.pdf (Last accessed 2\/12)."},{"volume-title":"Proceedings of the 5th International Conference on Preservation of Digital Objects (iPRES\u201908)","author":"von Suchodoletz D.","key":"e_1_2_1_33_1","unstructured":"von Suchodoletz , D. and van der Hoeven, J. 2008. Emulation: From digital artefact to remotely rendered environments . In Proceedings of the 5th International Conference on Preservation of Digital Objects (iPRES\u201908) . 93--97. von Suchodoletz, D. and van der Hoeven, J. 2008. Emulation: From digital artefact to remotely rendered environments. In Proceedings of the 5th International Conference on Preservation of Digital Objects (iPRES\u201908). 93--97."},{"volume-title":"Guidelines for the Preservation of the Digital Heritage","author":"Webb C.","key":"e_1_2_1_34_1","unstructured":"Webb , C. 2005. Guidelines for the Preservation of the Digital Heritage . Information Society Division United Nations Educational, Scientific and Cultural Organization (UNESCO) -- National Library of Australia . http:\/\/unesdoc.unesco.org\/images\/0013\/001300\/130071e.pdf. (Last accessed 2\/12). Webb, C. 2005. Guidelines for the Preservation of the Digital Heritage. Information Society Division United Nations Educational, Scientific and Cultural Organization (UNESCO) -- National Library of Australia. http:\/\/unesdoc.unesco.org\/images\/0013\/001300\/130071e.pdf. (Last accessed 2\/12)."}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2180868.2180876","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2180868.2180876","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T09:54:21Z","timestamp":1750240461000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2180868.2180876"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,5]]},"references-count":34,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2012,5]]}},"alternative-id":["10.1145\/2180868.2180876"],"URL":"https:\/\/doi.org\/10.1145\/2180868.2180876","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"type":"print","value":"1046-8188"},{"type":"electronic","value":"1558-2868"}],"subject":[],"published":{"date-parts":[[2012,5]]},"assertion":[{"value":"2011-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2012-05-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}