{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,17]],"date-time":"2026-01-17T07:18:06Z","timestamp":1768634286335,"version":"3.49.0"},"reference-count":59,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2018,3,8]],"date-time":"2018-03-08T00:00:00Z","timestamp":1520467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["ICER-1639759"],"award-info":[{"award-number":["ICER-1639759"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["ICER-1661918"],"award-info":[{"award-number":["ICER-1661918"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["ICER-1440327"],"award-info":[{"award-number":["ICER-1440327"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["ICER-1343816"],"award-info":[{"award-number":["ICER-1343816"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Science is conducted collaboratively, often requiring the sharing of knowledge about computational experiments. When experiments include only datasets, they can be shared using Uniform Resource Identifiers (URIs) or Digital Object Identifiers (DOIs). An experiment, however, seldom includes only datasets, but more often includes software, its past execution, provenance, and associated documentation. The Research Object has recently emerged as a comprehensive and systematic method for aggregation and identification of diverse elements of computational experiments. While a necessary method, mere aggregation is not sufficient for the sharing of computational experiments. Other users must be able to easily recompute on these shared research objects. Computational provenance is often the key to enable such reuse. In this paper, we show how reusable research objects can utilize provenance to correctly repeat a previous reference execution, to construct a subset of a research object for partial reuse, and to reuse existing contents of a research object for modified reuse. We describe two methods to summarize provenance that aid in understanding the contents and past executions of a research object. The first method obtains a process-view by collapsing low-level system information, and the second method obtains a summary graph by grouping related nodes and edges with the goal to obtain a graph view similar to application workflow. Through detailed experiments, we show the efficacy and efficiency of our algorithms.<\/jats:p>","DOI":"10.3390\/informatics5010014","type":"journal-article","created":{"date-parts":[[2018,3,8]],"date-time":"2018-03-08T12:07:33Z","timestamp":1520510853000},"page":"14","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Utilizing Provenance in Reusable Research Objects"],"prefix":"10.3390","volume":"5","author":[{"given":"Zhihao","family":"Yuan","sequence":"first","affiliation":[{"name":"School of Computing, DePaul University, Chicago, IL 60604, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dai Hai","family":"Ton That","sequence":"additional","affiliation":[{"name":"School of Computing, DePaul University, Chicago, IL 60604, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siddhant","family":"Kothari","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Chicago, Chicago, IL 60637, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabriel","family":"Fils","sequence":"additional","affiliation":[{"name":"School of Computing, DePaul University, Chicago, IL 60604, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tanu","family":"Malik","sequence":"additional","affiliation":[{"name":"School of Computing, DePaul University, Chicago, IL 60604, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,3,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.websem.2017.01.002","article-title":"Using ontologies for verification and validation of workflow-based experiments","volume":"43","author":"Miksa","year":"2017","journal-title":"Web Semant. Sci. Serv. Agents World Wide Web"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.websem.2015.01.003","article-title":"Using a suite of ontologies for preserving workflow-centric research objects","volume":"32","author":"Belhajjame","year":"2015","journal-title":"Web Semant. Sci. Serv. Agents World Wide Web"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Stodden, V., Leisch, F., and Peng, R.D. (2014). Implementing Reproducible Research, CRC Press.","DOI":"10.1201\/b16868"},{"key":"ref_4","unstructured":"Malik, T., Pham, Q., and Foster, I.T. (2014). SOLE: Towards Descriptive and Interactive Publications. Implementing Reproducible Research, Chapman & Hall\/CRC."},{"key":"ref_5","unstructured":"(2017, May 02). Figshare.com. Available online: https:\/\/figshare.com\/."},{"key":"ref_6","unstructured":"Soiland-Reyes, S., Gamble, M., and Haines, R. (2017, May 02). Research Object Bundle 1.0. Available online: https:\/\/researchobject.github.io\/specifications\/bundle\/."},{"key":"ref_7","unstructured":"Chirigati, F., Shasha, D., and Freire, J. (2013, January 2\u20133). ReproZip: Using Provenance to Support Computational Reproducibility. Proceedings of the 5th USENIX Conference on Theory and Practice of Provenance (TaPP\u201913), Lombard, IL, USA."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Janin, Y., Vincent, C., and Duraffort, R. (2014, January 9\u201311). CARE, the Comprehensive Archiver for Reproducible Execution. Proceedings of the 1st ACM SIGPLAN Workshop on Reproducible Research Methodologies and New Publication Models in Computer Engineering (TRUST), Edinburgh, UK.","DOI":"10.1145\/2618137.2618138"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ton That, D.H., Fils, G., Yuan, Z., and Malik, T. (2017, January 24\u201327). Sciunits: Reusable Research Objects. Proceedings of the IEEE eScience, Auckland, New Zealand.","DOI":"10.1109\/eScience.2017.51"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"De Roure, D. (2013, January 25). Towards Computational Research Objects. Proceedings of the ACM Workshop on Digital Preservation of Research Methods and Artefacts, Indianapolis, IN, USA.","DOI":"10.1145\/2499583.2499590"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"The Yale Law School Roundtable on Data and Code Sharing (2010). Reproducible Research. Comput. Sci. Eng., 12, 8\u201313. Available online: http:\/\/ieeexplore.ieee.org\/document\/5562471\/.","DOI":"10.1109\/MCSE.2010.113"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1016\/j.future.2011.08.004","article-title":"Why linked data is not enough for scientists","volume":"29","author":"Bechhofer","year":"2013","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_13","unstructured":"Corcho, O., Garijo Verdejo, D., Belhajjame, K., Zhao, J., Missier, P., Newman, D., Palma, R., Bechhofer, S., Garc\u00eda Cuesta, E., and Gomez-Perez, J.M. (2012, January 28). Workflow-centric research objects: First class citizens in scholarly discourse. Proceedings of the Workshop on the Semantic Publishing, (SePublica 2012) 9 th Extended Semantic Web Conference Hersonissos, Crete, Greece."},{"key":"ref_14","unstructured":"De Roure, D., Belhajjame, K., Missier, P., G\u00f3mez-P\u00e9rez, J.M., Palma, R., Ruiz, J.E., Hettne, K., Roos, M., Klyne, G., and Goble, C. (2011, January 1\u20134). Towards the Preservation of Scientific Workflows. Proceedings of the 8th International Conference on Preservation of Digital Objects (iPRES), Singapore."},{"key":"ref_15","first-page":"243180","article-title":"Towards reproducibility in scientific workflows: An infrastructure- based approach","volume":"2015","year":"2015","journal-title":"Sci. Program."},{"key":"ref_16","unstructured":"(2017, May 02). wf4ever\/ro-manager. Available online: https:\/\/github.com\/wf4ever\/ro-manager."},{"key":"ref_17","unstructured":"(2018, March 05). Standard OASIS. Available online: http:\/\/docs.oasis-open.org\/tosca\/TOSCA\/v1.0\/TOSCA-v1.0.html."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Qasha, R., Ca\u0142a, J., and Watson, P. (2016, January 23\u201327). A framework for scientific workflow reproducibility in the cloud. Proceedings of the 12th International Conference on IEEE e-Science, Baltimore, MD, USA.","DOI":"10.1109\/eScience.2016.7870888"},{"key":"ref_19","unstructured":"Guo, P.J., and Engler, D. (2011, January 15\u201317). CDE: Using System Call Interposition to Automatically Create Portable Software Packages. Proceedings of the USENIX Annual Technical Conference, Portland, OR, USA."},{"key":"ref_20","unstructured":"Guo, P.J. (2011, January 4\u20139). CDE: Run Any Linux Application On-demand without Installation. Proceedings of the LISA\u201911: 25th Large Installation System Administration Conference, Boston, MA, USA."},{"key":"ref_21","unstructured":"Pham, Q., Malik, T., and Foster, I. (2013, January 2\u20133). Using Provenance for Repeatability. Proceedings of the TaPP, Lombard, IL, USA."},{"key":"ref_22","unstructured":"Thain, D., Ivie, P., and Meng, H. (2015, January 2\u20136). Techniques for Preserving Scientific Software Executions: Preserve the Mess or Encourage Cleanliness?. Proceedings of the 12th International Conference on Digital Preservation (iPRES 2015), Chapel Hill, NC, USA."},{"key":"ref_23","unstructured":"(2017, May 02). Docker. Available online: https:\/\/www.docker.com\/."},{"key":"ref_24","unstructured":"(2017, May 02). Vagrant. Available online: https:\/\/www.vagrantup.com\/."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.jocs.2015.04.012","article-title":"An invariant framework for conducting reproducible computational science","volume":"9","author":"Meng","year":"2015","journal-title":"J. Comput. Sci."},{"key":"ref_26","unstructured":"(2017, September 10). The Sciunit. Available online: https:\/\/sciunit.run\/."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1145\/502059.502052","article-title":"A Low-bandwidth Network File System","volume":"Volume 35","author":"Muthitacharoen","year":"2001","journal-title":"ACM SIGOPS Operating Systems Review"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Murta, L., Braganholo, V., Chirigati, F., Koop, D., and Freire, J. (2014). noWorkflow: Capturing and analyzing provenance of scripts. International Provenance and Annotation Workshop, Springer.","DOI":"10.1007\/978-3-319-16462-5_6"},{"key":"ref_29","unstructured":"Muniswamy-Reddy, K.K., Holland, D.A., Braun, U., and Seltzer, M.I. (June, January 30). Provenance-aware storage systems. Proceedings of the General Track: USENIX Annual Technical Conference, Boston, MA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Gehani, A., and Tariq, D. (2012, January 3\u20137). SPADE: Support for provenance auditing in distributed environments. Proceedings of the 13th International Middleware Conference, Montreal, QC, Canada.","DOI":"10.1007\/978-3-642-35170-9_6"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Malik, T., Gehani, A., Tariq, D., and Zaffar, F. (2013). Sketching distributed data provenance. Data Provenance and Data Management in eScience, Springer.","DOI":"10.1007\/978-3-642-29931-5_4"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Pham, Q., Malik, T., Glavic, B., and Foster, I. (2015, January 13\u201317). LDV: Light-weight database virtualization. Proceedings of the 2015 IEEE 31st International Conference on Data Engineering (ICDE), Seoul, Korea.","DOI":"10.1109\/ICDE.2015.7113366"},{"key":"ref_33","unstructured":"Pham, Q. (2014). A Framework for Reproducible Computational Research. [Ph.D. Thesis, Department of Computer Science, University of Chicago]."},{"key":"ref_34","unstructured":"Dey, S., Belhajjame, K., Koop, D., Raul, M., and Lud\u00e4scher, B. (2015, January 8\u20139). Linking Prospective and Retrospective Provenance in Scripts. Proceedings of the 7th USENIX Conference on Theory and Practice of Provenance (TaPP\u201915), Edinburgh, Scotland."},{"key":"ref_35","first-page":"298","article-title":"YesWorkflow: A User-Oriented, Language-Independent Tool for Recovering Workflow Information from Scripts","volume":"10","author":"McPhillips","year":"2015","journal-title":"CoRR"},{"key":"ref_36","unstructured":"Macko, P., Margo, D., and Seltzer, M. (November, January 27). Local clustering in provenance graphs. Proceedings of the 22nd ACM international conference on Information & Knowledge Management (CIKM), San Francisco, CA, USA."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Tian, Y., Hankins, R.A., and Patel, J.M. (2008, January 9\u201312). Efficient Aggregation for Graph Summarization. Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data (SIGMOD \u201908), Vancouver, BC, Canada.","DOI":"10.1145\/1376616.1376675"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Cohen, S., Cohen-Boulakia, S., and Davidson, S. (2006). Towards a model of provenance and user views in scientific workflows. Data Integration in the Life Sciences, Springer.","DOI":"10.1007\/11799511_24"},{"key":"ref_39","first-page":"16","article-title":"SGProv: Summarization Mechanism for Multiple Provenance Graphs","volume":"5","author":"Mattoso","year":"2014","journal-title":"J. Inf. Data Manag."},{"key":"ref_40","unstructured":"City of Chicago (2017, May 05). Food Inspection Evaluation. Available online: https:\/\/chicago.github.io\/food-inspections-evaluation\/."},{"key":"ref_41","unstructured":"City of Chicago (2017, May 07). Chicago Data Portal. Available online: https:\/\/data.cityofchicago.org\/."},{"key":"ref_42","unstructured":"City of Chicago (2017, May 07). Food Inspection Evaluation Predictions-Source Code. Available online: https:\/\/github.com\/Chicago\/food-inspections-evaluation."},{"key":"ref_43","unstructured":"City of Chicago (2017, May 05). Food Inspection Evaluation. Available online: https:\/\/chicago.github.io\/food-inspections-evaluation\/predictions\/."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"R86","DOI":"10.1186\/gb-2010-11-8-r86","article-title":"Galaxy: A comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences","volume":"11","author":"Goecks","year":"2010","journal-title":"Genome Biol."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Hategan, M., Clifford, B., Foster, I., von Laszewski, G., Nefedova, V., Raicu, I., Stef-Praun, T., and Wilde, M. (2007, January 9\u201313). Swift: Fast, Reliable, Loosely Coupled Parallel Computation. Proceedings of the IEEE Congress on Services, Salt Lake City, UT, USA.","DOI":"10.1109\/SERVICES.2007.63"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Altintas, I., Barney, O., and Jaeger-Frank, E. (2006). Provenance Collection Support in the Kepler Scientific Workflow System. International Provenance and Annotation Workshop IPAW, Springer.","DOI":"10.1007\/11890850_14"},{"key":"ref_47","unstructured":"(2017, May 02). Hydroshare. Available online: https:\/\/www.hydroshare.org\/."},{"key":"ref_48","first-page":"45","article-title":"Practical Graph Isomorphism","volume":"30","author":"McKay","year":"1981","journal-title":"Congres. Numer."},{"key":"ref_49","unstructured":"McKay, B.D. (2017, September 10). The Page Nauty. Available online: http:\/\/users.cecs.anu.edu.au\/~bdm\/nauty\/."},{"key":"ref_50","unstructured":"Wolfram (2017, September 10). Find Graph Isomorphism. Available online: http:\/\/reference.wolfram.com\/language\/ref\/FindGraphIsomorphism.html."},{"key":"ref_51","unstructured":"Rabin, M.O. (1981). Fingerprinting by Random Polynomials, Center for Research in Computing Technology, Aiken Computation Lab., Harvard University."},{"key":"ref_52","unstructured":"(2017, May 02). Tensorflow. Available online: https:\/\/www.tensorflow.org\/."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.envsoft.2015.12.010","article-title":"Using a data grid to automate data preparation pipelines required for regional-scale hydrologic modeling","volume":"78","author":"Billah","year":"2016","journal-title":"Environ. Model. Softw."},{"key":"ref_54","unstructured":"Yuan, Z., Ton That, D.H., Kothari, S., Fils, G., and Malik, T. (2018, March 07). Sciunit Technical Report. Available online: https:\/\/sciunit.run\/papers\/DBGroup-TechReport-MDPI2018.pdf."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Freire, J., Bonnet, P., and Shasha, D. (2012, January 20\u201324). Computational Reproducibility: State-of-the-art, Challenges, and Database Research Opportunities. Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, Scottsdale, AZ, USA.","DOI":"10.1145\/2213836.2213908"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Stodden, V., Guo, P., and Ma, Z. (2013). Toward Reproducible Computational Research: An Empirical Analysis of Data and Code Policy Adoption by Journals. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0067111"},{"key":"ref_57","unstructured":"Penny, D. (2018, March 05). Nature Reproducibility Survey. Available online: https:\/\/figshare.com\/articles\/Nature_Reproducibility_survey\/3394951."},{"key":"ref_58","unstructured":"Malik, T. (2017, September 10). GeotrustHub. Available online: https:\/\/geotrusthub.org\/."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Diviacco, P., Leadbetter, A., and Glaves, H. (2017). Documenting Provenance for Reproducible Marine Ecosystem Assessment in Open Science. Oceanographic and Marine Cross-Domain Data Management for Sustainable Development, IGI Global. Chapter 5.","DOI":"10.4018\/978-1-5225-0700-0"}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/5\/1\/14\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:58:04Z","timestamp":1760194684000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/5\/1\/14"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3,8]]},"references-count":59,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,3]]}},"alternative-id":["informatics5010014"],"URL":"https:\/\/doi.org\/10.3390\/informatics5010014","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,3,8]]}}}