{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T18:39:59Z","timestamp":1787683199766,"version":"build-2784847793"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T00:00:00Z","timestamp":1634774400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T00:00:00Z","timestamp":1634774400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001821","name":"Vienna Science and Technology Fund","doi-asserted-by":"publisher","award":["ICT12-046"],"award-info":[{"award-number":["ICT12-046"]}],"id":[{"id":"10.13039\/501100001821","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Digit Libr"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Digital repositories rely on technical metadata to manage their objects. The output of characterization tools is aggregated and analyzed through content profiling. The accuracy and correctness of characterization tools vary; they frequently produce contradicting outputs, resulting in metadata conflicts. The resulting metadata conflicts limit scalable preservation risk assessment and repository management. This article presents and evaluates a rule-based approach to improving data quality in this scenario through expert-conducted conflict resolution. We characterize the data quality challenges and present a method for developing conflict resolution rules to improve data quality. We evaluate the method and the resulting data quality improvements in an experiment on a publicly available document collection. The results demonstrate that our approach enables the effective resolution of conflicts by producing rules that reduce the number of conflicts in the data set from 17 to 3%. This replicable method for presents a significant improvement in content profiling technology for digital repositories, since the enhanced data quality can improve risk assessment and preservation management in digital repository systems.<\/jats:p>","DOI":"10.1007\/s00799-021-00311-0","type":"journal-article","created":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T12:02:36Z","timestamp":1634817756000},"page":"365-383","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Improving data quality in large-scale repositories through conflict resolution"],"prefix":"10.1007","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6375-7973","authenticated-orcid":false,"given":"Artur","family":"Kulmukhametov","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Rauber","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christoph","family":"Becker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,10,21]]},"reference":[{"issue":"3","key":"311_CR1","doi-asserted-by":"publisher","first-page":"123","DOI":"10.2218\/ijdc.v4i3.122","volume":"4","author":"S Abrams","year":"2009","unstructured":"Abrams, S., Morrissey, S., Cramer, T.: What? So what: the next-generation JHOVE2 architecture for format-aware characterization. Int. J. Digit. Curation 4(3), 123\u2013136 (2009). https:\/\/doi.org\/10.2218\/ijdc.v4i3.122","journal-title":"Int. J. Digit. Curation"},{"key":"311_CR2","unstructured":"Arocena, P.C., Glavic, B., Mecca, G., Miller, R.J., Papotti, P., Santoro, D.: Benchmarking data curation systems. IEEE Data Eng. Bull. 39,(2016)"},{"key":"311_CR3","doi-asserted-by":"publisher","unstructured":"Batini, C., Scannapieco, M.: Data quality issues in data integration systems. In: Data and Information Quality, Data-Centric Systems and Applications, pp. 279\u2013307. Springer (2016). https:\/\/doi.org\/10.1007\/978-3-319-24106-7_10","DOI":"10.1007\/978-3-319-24106-7_10"},{"key":"311_CR4","doi-asserted-by":"publisher","unstructured":"Becker, C., Duretec, K.: Free benchmark corpora for preservation experiments: using model-driven engineering to generate data sets. In: Proceedings of the 13th ACM\/IEEE-CS Joint Conference on Digital Libraries, JCDL \u201913, pp. 349\u2013358. ACM, New York (2013). https:\/\/doi.org\/10.1145\/2467696.2467719","DOI":"10.1145\/2467696.2467719"},{"issue":"2","key":"311_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3012004","volume":"8","author":"C Becker","year":"2017","unstructured":"Becker, C., Duretec, K., Rauber, A.: The challenge of test data quality in data processing. J. Data Inf. Qual. 8(2), 1\u20134 (2017). https:\/\/doi.org\/10.1145\/3012004","journal-title":"J. Data Inf. Qual."},{"key":"311_CR6","doi-asserted-by":"publisher","unstructured":"Becker, C., Faria, L., Duretec, K.: Scalable decision support for digital preservation. OCLC Syst. Serv. Int. Digit. Libr. Perspect. 30(4), 249\u2013284 . https:\/\/doi.org\/10.1108\/OCLC-06-2014-0025","DOI":"10.1108\/OCLC-06-2014-0025"},{"issue":"1","key":"311_CR7","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1108\/OCLC-06-2014-0026","volume":"31","author":"C Becker","year":"2015","unstructured":"Becker, C., Faria, L., Duretec, K.: Scalable decision support for digital preservation: an assessment. OCLC Syst. Serv. Int. Digit. Libr. Perspect. 31(1), 11\u201334 (2015). https:\/\/doi.org\/10.1108\/OCLC-06-2014-0026","journal-title":"OCLC Syst. Serv. Int. Digit. Libr. Perspect."},{"key":"311_CR8","doi-asserted-by":"publisher","DOI":"10.2307\/2286300","volume-title":"Exploratory Data. Analysis Behavioral Science: Quantitative Methods","author":"JB Birch","year":"1978","unstructured":"Birch, J.B., Tukey, J.W.: Exploratory Data. Analysis Behavioral Science: Quantitative Methods. Addison-Wesley, Reading (1978). https:\/\/doi.org\/10.2307\/2286300"},{"issue":"1","key":"311_CR9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1456650.1456651","volume":"41","author":"J Bleiholder","year":"2008","unstructured":"Bleiholder, J., Naumann, F.: Data fusion. ACM Comput. Surv. 41(1), 1\u201341 (2008). https:\/\/doi.org\/10.1145\/1456650.1456651","journal-title":"ACM Comput. Surv."},{"issue":"2","key":"311_CR10","doi-asserted-by":"publisher","first-page":"3","DOI":"10.2218\/ijdc.v2i2.25","volume":"2","author":"T Brody","year":"2008","unstructured":"Brody, T., Carr, L., Hey, J.M.N., Brown, A., Hitchcock, S.: PRONOM-ROAR: adding format profiles to a repository registry to inform preservation services. Int. J. Digit. Curation 2(2), 3\u201319 (2008). https:\/\/doi.org\/10.2218\/ijdc.v2i2.25","journal-title":"Int. J. Digit. Curation"},{"key":"311_CR11","unstructured":"Cochrane, E.: Rendering matters. Report on the results of research into digital object rendering. Archives New Zealand (2012). http:\/\/archives.govt.nz\/rendering-matters-report-results-research-digital-object-rendering"},{"key":"311_CR12","doi-asserted-by":"crossref","unstructured":"Dong, X.L., Naumann, F.: Data fusion. Proc. VLDB Endow. 2(2), 1654\u20131655 (2009). (https:\/\/doi.org\/10.14778\/1687553.1687620)","DOI":"10.14778\/1687553.1687620"},{"key":"311_CR13","unstructured":"Duretec, K., Kulmukhametov, A., Rauber, A., Becker, C.: Benchmarks for digital preservation tools. In: Proceedings of the International Conference on Digital Preservation (IPRES 2015), Chapel Hill, NC, USA (2015)"},{"issue":"1","key":"311_CR14","doi-asserted-by":"publisher","first-page":"45","DOI":"10.2218\/ijdc.v6i1.171","volume":"6","author":"M Esteva","year":"2011","unstructured":"Esteva, M., Xu, W., Jain, S.D., Lee, J.L., Martin, W.K.: Assessing the preservation condition of large and heterogeneous electronic records collections with visualization. Int. J. Digit. Curation 6(1), 45\u201357 (2011). https:\/\/doi.org\/10.2218\/ijdc.v6i1.171","journal-title":"Int. J. Digit. Curation"},{"key":"311_CR15","doi-asserted-by":"crossref","unstructured":"Ferro, N., Silvello, G., Buelinckx, E., Doubrov, B., Fresa, A., Geber, M., Jadeglans, K., Justrell, B., Lemmens, B., Martinez, J., et\u00a0al.: Evaluation of conformance checkers for long-term preservation of multimedia documents. In: JCDL, pp. 145\u2013154 (2018)","DOI":"10.1145\/3197026.3197037"},{"key":"311_CR16","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1016\/j.diin.2012.05.002","volume":"9","author":"S Garfinkel","year":"2012","unstructured":"Garfinkel, S.: Lessons learned writing digital forensics tools and managing a 30tb digital evidence corpus. Digit. Investig. 9, 80\u201389 (2012). https:\/\/doi.org\/10.1016\/j.diin.2012.05.002","journal-title":"Digit. Investig."},{"key":"311_CR17","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1016\/j.diin.2009.06.016","volume":"6","author":"S Garfinkel","year":"2009","unstructured":"Garfinkel, S., Farrell, P., Roussev, V., Dinolt, G.: Bringing science to digital forensics with standardized forensic corpora. Digit. Investig. 6, 2\u201311 (2009)","journal-title":"Digit. Investig."},{"key":"311_CR18","unstructured":"Heslop, H., Davis, S., Wilson, A.: An approach to the preservation of digital records. Technical report (2002). http:\/\/trove.nla.gov.au\/version\/38579727"},{"key":"311_CR19","unstructured":"Holden, M.: Preserving the web archive for future generations. In: The Memory of the World in the Digital Age: Digitization and Preservation, pp. 783\u2013795. United Nations Educational, Scientific and Cultural Organization, Vancouver (2012)"},{"key":"311_CR20","unstructured":"Hutchins, M.: Testing Software Tools of Potential Interest for Digital Preservation Activities at the National Library of Australia. National Library of Australia, Staff Papers (2012)"},{"key":"311_CR21","unstructured":"van\u00a0der Knijff, J., Wilson, C.: Evaluation of characterisation tools. Part 1: Identification. $$\\{\\text{SCAPE}\\} \\{\\text{ Deliverable }\\}$$ 270137 (2011)"},{"key":"311_CR22","doi-asserted-by":"publisher","unstructured":"Kulmukhametov, A.: Experiment results on conflict resolution in digital preservation (2020). https:\/\/doi.org\/10.6084\/m9.figshare.5877153.v2","DOI":"10.6084\/m9.figshare.5877153.v2"},{"key":"311_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-3-319-12823-8-1","volume-title":"Content Profiling for Preservation: Improving Scale, Depth and Quality","author":"A Kulmukhametov","year":"2014","unstructured":"Kulmukhametov, A., Becker, C.: Content Profiling for Preservation: Improving Scale, Depth and Quality, pp. 1\u201311. Springer, Berlin (2014). https:\/\/doi.org\/10.1007\/978-3-319-12823-8-1"},{"key":"311_CR24","unstructured":"Kumaravel, H.V., Dearborn, C., Witt, M., Kuang, Y.: Measuring the Accuracy of file format identification tools. In: Proceedings of the 11th International Digital Curation Conference. DCC, Amsterdam (2016)"},{"key":"311_CR25","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1007\/s00799-007-0014-9","volume":"6","author":"D Lee","year":"2007","unstructured":"Lee, D.: Practical maintenance of evolving metadata for digital preservation: algorithmic solution and system support. Int. J. Digit. Libr. 6, 313\u2013326 (2007). https:\/\/doi.org\/10.1007\/s00799-007-0014-9","journal-title":"Int. J. Digit. Libr."},{"issue":"4","key":"311_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2107536.2107538","volume":"2","author":"H M\u00fcller","year":"2012","unstructured":"M\u00fcller, H., Freytag, J.C., Leser, U.: Improving data quality by source analysis. J. Data Inf. Qual. 2(4), 1\u201338 (2012). https:\/\/doi.org\/10.1145\/2107536.2107538","journal-title":"J. Data Inf. Qual."},{"key":"311_CR27","doi-asserted-by":"publisher","unstructured":"Naumann, F., H\u00e4ussler, M.: Declarative data merging with conflict resolution. In: Proceedings of the International Conference on Information Quality (IQ 2002), pp. 212\u2013224 (2002). https:\/\/doi.org\/10.18452\/9206","DOI":"10.18452\/9206"},{"key":"311_CR28","unstructured":"NDSA: 2015 National Agenda for Digital Stewardship. National Digital Stewardship Alliance (2014). http:\/\/hdl.loc.gov\/loc.gdc\/lcpub.2013655119.1"},{"key":"311_CR29","unstructured":"Reimer, N., Moldrup, P.: A case study: content profiling using C3PO. Technical report, SCAPE project (2013)"},{"key":"311_CR30","doi-asserted-by":"publisher","unstructured":"Shneiderman, B.: The eyes have it: a task by data type taxonomy for information visualizations. In: The Craft of Information Visualization, pp. 364\u2013371. Elsevier, Washington (2003). https:\/\/doi.org\/10.1016\/B978-155860915-0\/50046-9","DOI":"10.1016\/B978-155860915-0\/50046-9"},{"key":"311_CR31","unstructured":"Tarrant, D., Carr, L.: LDS3: applying digital preservation principals to linked data systems. In: Proceedings of the International Conference on Digital Preservation (IPRES) (2012)"},{"key":"311_CR32","unstructured":"Thibodeau, K.: Overview of technological approaches to digital preservation and challenges in coming years, pp. 4\u201331. Council on Library and Information Resources, Washington, DC (2002)"},{"key":"311_CR33","doi-asserted-by":"publisher","unstructured":"Xu, W., Esteva, M., Jain, S.D.: Visualizing personal digital collections. In: Hunter, J., Lagoze, C., Giles, C.L., Li, Y.F. (eds.) Proceedings of the 10th Annual Joint Conference on Digital Libraries - JCDL \u201910, p. 169. ACM Press, New York (2010). https:\/\/doi.org\/10.1145\/1816123.1816147","DOI":"10.1145\/1816123.1816147"},{"key":"311_CR34","doi-asserted-by":"publisher","unstructured":"Xu, W., Esteva, M., Jain, S.D., Jain, V.: Analysis of large digital collections with interactive visualization. In: Proceedings of the 2011 IEEE Conference on Visual Analytics Science and Technology (VAST), pp. 241\u2013250. IEEE (2011). https:\/\/doi.org\/10.1109\/VAST.2011.6102462","DOI":"10.1109\/VAST.2011.6102462"},{"issue":"2","key":"311_CR35","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1177\/1473871612473590","volume":"13","author":"W Xu","year":"2014","unstructured":"Xu, W., Esteva, M., Jain, S.D., Jain, V.: Interactive visualization for curatorial analysis of large digital collection. Inf. Vis. 13(2), 159\u2013183 (2014). https:\/\/doi.org\/10.1177\/1473871612473590","journal-title":"Inf. Vis."}],"container-title":["International Journal on Digital Libraries"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00799-021-00311-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00799-021-00311-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00799-021-00311-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,3]],"date-time":"2021-12-03T11:03:09Z","timestamp":1638529389000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00799-021-00311-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,21]]},"references-count":35,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["311"],"URL":"https:\/\/doi.org\/10.1007\/s00799-021-00311-0","relation":{},"ISSN":["1432-5012","1432-1300"],"issn-type":[{"value":"1432-5012","type":"print"},{"value":"1432-1300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,21]]},"assertion":[{"value":"27 January 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 October 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}