{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T13:23:17Z","timestamp":1777555397473,"version":"3.51.4"},"reference-count":46,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2021,10,13]],"date-time":"2021-10-13T00:00:00Z","timestamp":1634083200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Data Science"],"published-print":{"date-parts":[[2021,10,13]]},"abstract":"<jats:p>Experimenting with different models, documenting results and findings, and repeating these tasks are day-to-day activities for machine learning engineers and data scientists. There is a need to keep control of the machine-learning pipeline and its metadata. This allows users to iterate quickly through experiments and retrieve key findings and observations from historical activity. This is the need that Arangopipe serves. Arangopipe is an open-source tool that provides a data model that captures the essential components of any machine learning life cycle. Arangopipe provides an application programming interface that permits machine-learning engineers to record the details of the salient steps in building their machine learning models. The components of the data model and an overview of the application programming interface is provided. Illustrative examples of basic and advanced machine learning workflows are provided. Arangopipe is not only useful for users involved in developing machine learning models but also useful for users deploying and maintaining them.<\/jats:p>","DOI":"10.3233\/ds-210034","type":"journal-article","created":{"date-parts":[[2021,10,13]],"date-time":"2021-10-13T05:22:25Z","timestamp":1634102545000},"page":"85-99","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Arangopipe, a tool for machine learning meta-data management"],"prefix":"10.1177","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1552-382X","authenticated-orcid":false,"given":"J\u00f6rg","family":"Schad","sequence":"first","affiliation":[{"name":"ArangoDB, CA, USA. E-mail:\u00a0"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4865-7218","authenticated-orcid":false,"given":"Rajiv","family":"Sambasivan","sequence":"additional","affiliation":[{"name":"ArangoDB, CA, USA. E-mail:\u00a0"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4850-3101","authenticated-orcid":false,"given":"Christopher","family":"Woodward","sequence":"additional","affiliation":[{"name":"ArangoDB, CA, USA. E-mail:\u00a0"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2021,10,13]]},"reference":[{"key":"ref001","unstructured":"Airflow, https:\/\/airflow.apache.org\/docs\/apache-airflow\/stable\/concepts.html."},{"key":"ref002","unstructured":"Algorithmia, state of enterprise ML, a 2020 survey, https:\/\/info.algorithmia.com\/hubfs\/2019\/Whitepapers\/The-State-of-Enterprise-ML-2020\/Algorithmia_2020_State_of_Enterprise_ML.pdf."},{"key":"ref003","unstructured":"Anaconda, state of data science 2020, https:\/\/www.anaconda.com\/state-of-data-science-2020."},{"key":"ref004","unstructured":"AQL web interface, https:\/\/www.arangodb.com\/docs\/stable\/aql\/invocation-with-web-interface.html."},{"key":"ref005","unstructured":"Arango Query Language, https:\/\/www.arangodb.com\/docs\/stable\/aql\/."},{"key":"ref006","unstructured":"ArangoDB Networkx adapter, https:\/\/github.com\/arangoml\/networkx-adapter\/blob\/master\/examples\/IMDB_Networkx_Adapter.ipynb."},{"key":"ref007","unstructured":"Arangopipe, an overview, https:\/\/www.arangodb.com\/2021\/01\/arangoml-series-multi-model-collaboration\/."},{"key":"ref008","unstructured":"Arangopipe, a collaboration scenario, https:\/\/www.arangodb.com\/2021\/01\/arangoml-series-multi-model-collaboration\/."},{"key":"ref009","unstructured":"Arangopipe basic workflow, https:\/\/github.com\/arangoml\/arangopipe\/blob\/master\/examples\/Arangopipe_Feature_Examples.ipynb."},{"key":"ref010","unstructured":"Arangopipe build instructions, https:\/\/github.com\/arangoml\/arangopipe\/tree\/master\/documentation."},{"key":"ref011","unstructured":"Arangopipe ML Spec integration, https:\/\/github.com\/arangoml\/arangopipe\/blob\/master\/examples\/MLSpec_AP_Example.ipynb."},{"key":"ref012","unstructured":"Arangopipe model bias, https:\/\/colab.research.google.com\/github\/arangoml\/arangopipe\/blob\/master\/examples\/Arangopipe_Feature_Example_ext1.ipynb."},{"key":"ref013","unstructured":"Arangopipe project repository, https:\/\/github.com\/arangoml\/arangopipe\/blob\/master\/documentation\/README.md."},{"key":"ref014","unstructured":"Arangopipe project repository, https:\/\/github.com\/arangoml\/arangopipe\/tree\/master\/documentation."},{"key":"ref015","unstructured":"Arangopipe test cases, https:\/\/github.com\/arangoml\/arangopipe\/blob\/master\/arangopipe\/tests\/CItests\/arangopipe_testcases.py."},{"key":"ref016","unstructured":"Arangopipe test data generator, https:\/\/github.com\/arangoml\/arangopipe\/blob\/master\/arangopipe\/tests\/test_data_generator\/generate_model_data.py."},{"key":"ref017","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098021"},{"key":"ref018","unstructured":"X.\u00a0Bouthillier, C.\u00a0Laurent and P.\u00a0Vincent, Unreproducible research is reproducible, in: International Conference on Machine Learning, PMLR, 2019, pp.\u00a0725\u2013734, http:\/\/proceedings.mlr.press\/v97\/bouthillier19a.html."},{"key":"ref019","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2017.8258038"},{"key":"ref020","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"ref021","unstructured":"Calling R from Python, https:\/\/rstudio.github.io\/reticulate\/articles\/calling_python.html."},{"key":"ref022","unstructured":"CMU Statlib, http:\/\/lib.stat.cmu.edu\/datasets\/."},{"key":"ref023","unstructured":"Dataset Drift, https:\/\/colab.research.google.com\/github\/arangoml\/arangopipe\/blob\/master\/examples\/Arangopipe_Feature_ext2.ipynb."},{"key":"ref024","doi-asserted-by":"publisher","DOI":"10.1145\/2347736.2347755"},{"key":"ref025","unstructured":"Global survey: The state of AI in 2020, McKinsey, https:\/\/www.mckinsey.com\/business-functions\/mckinsey-analytics\/our-insights\/global-survey-the-state-of-ai-in-2020."},{"key":"ref026","unstructured":"Google Colab, https:\/\/colab.research.google.com\/notebooks\/."},{"key":"ref027","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2018.03.022"},{"key":"ref028","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939754"},{"key":"ref029","unstructured":"Hyper-parameter Optimization, https:\/\/colab.research.google.com\/github\/arangodb\/interactive_tutorials\/blob\/master\/notebooks\/ML_Collab_Article\/example_output\/ML_Collaboration_Hyperopt_Integration_output.ipynb."},{"key":"ref030","unstructured":"JSON pickle, https:\/\/jsonpickle.readthedocs.io\/en\/latest\/."},{"key":"ref031","unstructured":"Kaggle, state of data science and machine learning 2020, https:\/\/www.kaggle.com\/kaggle-survey-2020."},{"key":"ref032","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3340408"},{"key":"ref033","unstructured":"Luigi, https:\/\/luigi.readthedocs.io\/en\/stable\/execution_model.html."},{"key":"ref034","unstructured":"ML Spec, https:\/\/github.com\/mlspec\/MLSpec."},{"key":"ref035","unstructured":"ONNX, https:\/\/onnx.ai\/."},{"key":"ref036","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-7152(96)00140-X"},{"key":"ref037","first-page":"2825","volume":"12","author":"Pedregosa F.","year":"2011","journal-title":"the Journal of Machine Learning Research"},{"key":"ref038","unstructured":"Pytorch, https:\/\/pytorch.org\/."},{"issue":"4","key":"ref039","first-page":"5","volume":"41","author":"Schelter S.","year":"2018","journal-title":"IEEE Data Eng. Bull."},{"key":"ref040","unstructured":"S.\u00a0Schelter, J.H.\u00a0Boese, J.\u00a0Kirschnick, T.\u00a0Klein and S.\u00a0Seufert, Automatically tracking metadata and provenance of machine learning experiments, in: Machine Learning Systems Workshop at NIPS, 2017, pp.\u00a027\u201329, http:\/\/learningsys.org\/nips17\/assets\/papers\/paper_13.pdf."},{"key":"ref041","unstructured":"Tensorflow, https:\/\/www.tensorflow.org\/."},{"key":"ref042","unstructured":"Tensorflow data validation, https:\/\/colab.research.google.com\/github\/arangodb\/interactive_tutorials\/blob\/master\/notebooks\/ML_Collab_Article\/example_output\/Arangopipe_Generate_TF_Visualization_output.ipynb."},{"key":"ref043","unstructured":"J.\u00a0Tsay, T.\u00a0Mummert, N.\u00a0Bobroff, A.\u00a0Braz, P.\u00a0Westerink and M.\u00a0Hirzel, Runway: Machine learning model experiment management tool, in: Conference on Systems and Machine Learning (SysML), 2018, https:\/\/mlsys.org\/Conferences\/doc\/2018\/26.pdf."},{"key":"ref044","unstructured":"Using R with Arangopipe, https:\/\/github.com\/arangoml\/arangopipe\/blob\/master\/examples\/R_Example_Colab.ipynb."},{"issue":"4","key":"ref045","first-page":"16","volume":"41","author":"Vartak M.","year":"2018","journal-title":"IEEE Data Eng. Bull."},{"issue":"4","key":"ref046","first-page":"39","volume":"41","author":"Zaharia M.","year":"2018","journal-title":"IEEE Data Eng. Bull."}],"container-title":["Data Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/DS-210034","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/DS-210034","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/DS-210034","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T18:10:06Z","timestamp":1777399806000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/DS-210034"}},"subtitle":[],"editor":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5759-2655","authenticated-orcid":false,"given":"Brian","family":"Davis","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,10,13]]},"references-count":46,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,10,13]]}},"alternative-id":["10.3233\/DS-210034"],"URL":"https:\/\/doi.org\/10.3233\/ds-210034","relation":{},"ISSN":["2451-8484","2451-8492"],"issn-type":[{"value":"2451-8484","type":"print"},{"value":"2451-8492","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,13]]}}}