{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T01:55:40Z","timestamp":1787018140660,"version":"build-2736575974"},"reference-count":50,"publisher":"China Science Publishing & Media Ltd.","issue":"1","license":[{"start":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T00:00:00Z","timestamp":1677024000000},"content-version":"vor","delay-in-days":52,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,3,8]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:p>Implementations of metadata tend to favor centralized, static metadata. This depiction is at variance with the past decade of focus on big data, cloud native architectures and streaming platforms. Big data velocity can demand a correspondingly dynamic view of metadata. These trends, which include DevOps, CI\/CD, DataOps and data fabric, are surveyed. Several specific cloud native tools are reviewed and weaknesses in their current metadata use are identified. Implementations are suggested which better exploit capabilities of streaming platform paradigms, in which metadata is continuously collected in dynamic contexts. Future cloud native software features are identified which could enable streamed metadata to power real time data fusion or fine tune automated reasoning through real time ontology updates.<\/jats:p>","DOI":"10.1162\/dint_a_00193","type":"journal-article","created":{"date-parts":[[2023,2,21]],"date-time":"2023-02-21T20:04:35Z","timestamp":1677009875000},"page":"275-288","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":10,"title":["Continuous Metadata in Continuous Integration, Stream Processing and Enterprise DataOps"],"prefix":"10.3724","volume":"5","author":[{"given":"Mark","family":"Underwood","sequence":"first","affiliation":[{"name":"DataKitchen Headquarters, One Broadway, 14th Floor Cambridge, MA 02142, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2026","published-online":{"date-parts":[[2023,3,8]]},"reference":[{"key":"2023030820241958600_","first-page":"471","volume-title":"CI\/CD Pipelines Evolution and Restructuring: A Qualitative and Quantitative Study","author":"Zampetti","year":"2021"},{"key":"2023030820241958600_","article-title":"IEEE\/ISO 2675-2021 Standard for DevOps:Building Reliable and Secure Systems Including Application Build, Package, and Deployment","volume-title":"IEEE Stand","author":"IEEE","year":"2021"},{"key":"2023030820241958600_","first-page":"243","volume-title":"Microservice Architectures for Scalability, Agility and Reliability in E-Commerce","author":"Hasselbring","year":"2017"},{"key":"2023030820241958600_","volume-title":"What is the Plan-Do-Check-Act Cycle?","year":"2020"},{"key":"2023030820241958600_","volume-title":"The leading open source automation server","author":"LinuxFoundation. Jenkins","year":"2023"},{"key":"2023030820241958600_","article-title":"Business Process and Model Notation (BPMN)","volume-title":"OMB Standards and ISO\/IEC 19510","author":"OMG","year":"2013"},{"key":"2023030820241958600_","volume-title":"OMG. SysML | ISO\/IEC 19514:2017. OMG Standards.","year":"2017"},{"key":"2023030820241958600_","doi-asserted-by":"crossref","DOI":"10.1145\/3234152.3234164","volume-title":"Adopting Scaled Agile Framework (SAFe): A Multivocal Literature Review","author":"Putta","year":"2018"},{"key":"2023030820241958600_","first-page":"2190","volume-title":"Extending Kafka Streams for Complex Event Recognition","author":"Langhi","year":"2020"},{"key":"2023030820241958600_","first-page":"162","volume-title":"Guide to attribute based access control (abac) definition and considerations","author":"Hu","year":"2014"},{"key":"2023030820241958600_","first-page":"703","volume-title":"Fast Semantic Attribute-Role-Based Access Control (ARBAC) in a Collaborative Environment, pp","author":"Obrst","year":"2012"},{"key":"2023030820241958600_","volume-title":"How to Activate Metadata to Enable a Composable Data Fabric","author":"Beyer","year":"2020"},{"key":"2023030820241958600_","volume-title":"Document Your Dataset Using Apache Parquet Open Data Science Platform\u2014Part 2.3: Document Your Dataset Using Apache Parquet","author":"Kim","year":"2021"},{"key":"2023030820241958600_","volume-title":"VMware. Tanzu Application Service for VMs. Tanzu Docs.","year":"2021"},{"key":"2023030820241958600_","volume-title":"Apache Atlas. Classification Propagation. Apache Atlas Documentation.","year":"2019"},{"key":"2023030820241958600_","doi-asserted-by":"crossref","first-page":"28282","DOI":"10.1109\/ACCESS.2021.3058744","article-title":"Metadata-Driven Universal Real-Time Ocean Sound Measurement Architecture","volume":"9","author":"Mart\u00ednez","year":"2021","journal-title":"IEEE Access"},{"key":"2023030820241958600_","volume-title":"Automation for Everyone","author":"Red_Hat. Ansible","year":"2023"},{"key":"2023030820241958600_","first-page":"230","volume-title":"Abstractions of Abstractions: Metadata to Infrastructure-as-Code","author":"Deslauriers","year":"2022"},{"issue":"2","key":"2023030820241958600_","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1093\/comjnl\/27.2.97","article-title":"Literate Programming","volume":"27","author":"Knuth","year":"1984","journal-title":"Comput J"},{"key":"2023030820241958600_","volume-title":"Free software, open standards, and web services for interactive computing across all programming languages","author":"Project Jupyter. Jupyter","year":"2023"},{"key":"2023030820241958600_","first-page":"550","volume-title":"KGTorrent: A Dataset of Python Jupyter Notebooks from Kaggle","author":"Quaranta","year":"2021"},{"key":"2023030820241958600_","volume-title":"From Data to Metadata for Machine Learning Platforms","author":"Schad","year":"2020"},{"key":"2023030820241958600_","first-page":"162","volume-title":"XBRL Metadata Repository and Continuous Data Mining","author":"Pan","year":"2011"},{"key":"2023030820241958600_","volume-title":"The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling","author":"Kimball","year":"2013"},{"issue":"2","key":"2023030820241958600_","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1109\/TPDS.2019.2937492","article-title":"A Highly Reliable Metadata Service for Large-Scale Distributed File Systems","volume":"31","author":"Zhou","year":"2020","journal-title":"IEEE Trans Parallel Distrib Syst"},{"issue":"1","key":"2023030820241958600_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/pra2.2016.14505301072","article-title":"Software citation, reuse and metadata considerations: An exploratory study examining LAMMPS","volume":"53","author":"Li","year":"2016","journal-title":"Proc Assoc Inf Sci Technol"},{"key":"2023030820241958600_","first-page":"258","volume-title":"Provenance as a Service: A Data-centric Approach for Real-Time Monitoring","author":"Hammad","year":"2014"},{"key":"2023030820241958600_","first-page":"577","volume-title":"Event model to facilitate data sharing among services: Closing the gap between research and implementation","author":"Kotevska","year":"2016"},{"key":"2023030820241958600_","first-page":"87","volume-title":"The Rich Event Ontology","author":"Brown","year":"2017"},{"key":"2023030820241958600_","volume-title":"Decentralized, governed, data as a product","author":"Nexla. Build Your Data Mesh","year":"2021"},{"key":"2023030820241958600_","first-page":"805","volume-title":"Quality and Productivity Outcomes Relating to Continuous Integration in GitHub","author":"Vasilescu","year":"2015"},{"key":"2023030820241958600_","first-page":"299","article-title":"Using a Metadata Software Layer in Information Systems Integration","volume-title":"Advanced Information Systems Engineering","author":"Roantree","year":"2001"},{"issue":"5","key":"2023030820241958600_","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1177\/0306312711413314","article-title":"Science friction: Data, metadata, and collaboration","volume":"41","author":"Edwards","year":"2011","journal-title":"Soc Stud Sci"},{"key":"2023030820241958600_","article-title":"The Update Framework: Roles and Metadata","volume-title":"Cloud Native Computing Foundation","author":"TUF","year":"2021"},{"key":"2023030820241958600_","volume-title":"Enhancing workload observability using Amazon CloudWatch Embedded Metric Format","author":"Fischer","year":"2020"},{"key":"2023030820241958600_","volume-title":"Easily manage your data lake at scale using AWS Lake Formation Tag-based access control","author":"Shankar","year":"2021"},{"key":"2023030820241958600_","first-page":"349","volume-title":"OKG-Soft: An Open Knowledge Graph with Machine Readable Scientific Software Metadata","author":"Garijo","year":"2019"},{"key":"2023030820241958600_","volume-title":"Ontology Definition Metamodel (OMG) Version 1.1","author":"Object Management Group","year":"2014"},{"key":"2023030820241958600_","volume-title":"Mint: Model integration through knowledge-powered data and process composition","author":"Gil","year":"2018"},{"key":"2023030820241958600_","volume-title":"Model-Based Systems Engineering in SAFe","author":"ScaledAgileInc","year":"2021"},{"key":"2023030820241958600_","first-page":"70","volume-title":"Shepherding Metadata Through the Building Lifecycle","author":"Fierro","year":"2020"},{"key":"2023030820241958600_","doi-asserted-by":"crossref","first-page":"152","DOI":"10.3389\/fbuil.2020.558034","article-title":"Formalizing Tag-Based Metadata With the Brick Ontology","volume":"6","author":"Fierro","year":"2020","journal-title":"Front Built Environ"},{"key":"2023030820241958600_","volume-title":"Grafana Loki label best practices. Grafana Labs Documentation","author":"Grafana_Labs","year":"2021"},{"key":"2023030820241958600_","volume-title":"Easily manage your data lake at scale using AWS Lake Formation Tagbased access control","author":"Shankar","year":"2021"},{"key":"2023030820241958600_","volume-title":"IDE-Centered ABAC with Models and Ontologies for Safer DevOps","author":"Underwood","year":"2019"},{"issue":"2","key":"2023030820241958600_","doi-asserted-by":"crossref","first-page":"100028","DOI":"10.1016\/j.xgen.2021.100028","article-title":"The Data Use Ontology to streamline responsible access to human biomedical datasets","volume":"1","author":"Lawson","year":"2021","journal-title":"Cell Genomics"},{"key":"2023030820241958600_","volume-title":"How to Install the ELK Stack on Google Cloud Platform","author":"Hagerty","year":"2017"},{"key":"2023030820241958600_","first-page":"523","volume-title":"Technologies for Metadata and Ontology Storage","author":"Parmelee","year":"2014"},{"key":"2023030820241958600_","volume-title":"Netflix Data Mesh: Composable Data Processing","author":"Cunningham","year":"2020"},{"key":"2023030820241958600_","first-page":"80","article-title":"Semantic Context for Object Exchange","volume-title":"Workshop on Reasoning in Context for AI Applications AAAI-1999","author":"Obrst","year":"1999"}],"container-title":["Data Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/dint\/article-pdf\/5\/1\/275\/2074412\/dint_a_00193.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/dint\/article-pdf\/5\/1\/275\/2074412\/dint_a_00193.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,14]],"date-time":"2025-03-14T03:42:25Z","timestamp":1741923745000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.sciengine.com\/doi\/10.1162\/dint_a_00193"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":50,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3,8]]}},"URL":"https:\/\/doi.org\/10.1162\/dint_a_00193","relation":{},"ISSN":["2641-435X"],"issn-type":[{"value":"2641-435X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023]]},"published":{"date-parts":[[2023]]}}}