{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T02:23:24Z","timestamp":1773887004999,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":58,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,7,11]],"date-time":"2021-07-11T00:00:00Z","timestamp":1625961600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,7,11]]},"DOI":"10.1145\/3460319.3464796","type":"proceedings-article","created":{"date-parts":[[2021,7,8]],"date-time":"2021-07-08T22:18:43Z","timestamp":1625782723000},"page":"620-632","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Finding data compatibility bugs with JSON subschema checking"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5857-1864","authenticated-orcid":false,"given":"Andrew","family":"Habib","sequence":"first","affiliation":[{"name":"University of Luxembourg, Luxembourg"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Avraham","family":"Shinnar","sequence":"additional","affiliation":[{"name":"IBM Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Hirzel","sequence":"additional","affiliation":[{"name":"IBM Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1623-498X","authenticated-orcid":false,"given":"Michael","family":"Pradel","sequence":"additional","affiliation":[{"name":"University of Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,7,11]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"[n.d.]. Apache Avro. http:\/\/avro.apache.org\/  [n.d.]. Apache Avro. http:\/\/avro.apache.org\/"},{"key":"e_1_3_2_1_2_1","unstructured":"[n.d.]. The enterprise-grade event data collection platform. https:\/\/snowplowanalytics.com\/  [n.d.]. The enterprise-grade event data collection platform. https:\/\/snowplowanalytics.com\/"},{"key":"e_1_3_2_1_3_1","unstructured":"[n.d.]. Introducing SchemaVer for semantic versioning of schemas. https:\/\/snowplowanalytics.com\/blog\/2014\/05\/13\/introducing-schemaver-for-semantic-versioning-of-schemas\/  [n.d.]. Introducing SchemaVer for semantic versioning of schemas. https:\/\/snowplowanalytics.com\/blog\/2014\/05\/13\/introducing-schemaver-for-semantic-versioning-of-schemas\/"},{"key":"e_1_3_2_1_4_1","unstructured":"[n.d.]. Production-Grade Container Orchestration. https:\/\/kubernetes.io\/  [n.d.]. Production-Grade Container Orchestration. https:\/\/kubernetes.io\/"},{"key":"e_1_3_2_1_5_1","unstructured":"[n.d.]. Protocol Buffers. https:\/\/developers.google.com\/protocol-buffers  [n.d.]. Protocol Buffers. https:\/\/developers.google.com\/protocol-buffers"},{"key":"e_1_3_2_1_6_1","unstructured":"[n.d.]. Semantic Versioning 2.0.0. https:\/\/semver.org\/  [n.d.]. Semantic Versioning 2.0.0. https:\/\/semver.org\/"},{"key":"e_1_3_2_1_7_1","unstructured":"[n.d.]. Swagger\/OpenAPI Specification. https:\/\/swagger.io\/  [n.d.]. Swagger\/OpenAPI Specification. https:\/\/swagger.io\/"},{"key":"e_1_3_2_1_8_1","unstructured":"2011. jsonschema: Implementation of JSON Schema for Python. https:\/\/github.com\/Julian\/jsonschema  2011. jsonschema: Implementation of JSON Schema for Python. https:\/\/github.com\/Julian\/jsonschema"},{"key":"e_1_3_2_1_9_1","unstructured":"2012. greenery: Tools for parsing and manipulating regular expressions. https:\/\/github.com\/qntm\/greenery  2012. greenery: Tools for parsing and manipulating regular expressions. https:\/\/github.com\/qntm\/greenery"},{"key":"e_1_3_2_1_10_1","unstructured":"2012. JSON Schema Test Suite. https:\/\/github.com\/json-schema-org\/JSON-Schema-Test-Suite  2012. JSON Schema Test Suite. https:\/\/github.com\/json-schema-org\/JSON-Schema-Test-Suite"},{"key":"e_1_3_2_1_11_1","unstructured":"2013. jsonref: Library for automatic dereferencing of JSON Reference objects. https:\/\/github.com\/gazpachoking\/jsonref  2013. jsonref: Library for automatic dereferencing of JSON Reference objects. https:\/\/github.com\/gazpachoking\/jsonref"},{"key":"e_1_3_2_1_12_1","unstructured":"2015. Swagger::Diff. https:\/\/github.com\/civisanalytics\/swagger-diff  2015. Swagger::Diff. https:\/\/github.com\/civisanalytics\/swagger-diff"},{"key":"e_1_3_2_1_13_1","unstructured":"2015. The Washington Post ANS specification. https:\/\/github.com\/washingtonpost\/ans-schema  2015. The Washington Post ANS specification. https:\/\/github.com\/washingtonpost\/ans-schema"},{"key":"e_1_3_2_1_14_1","unstructured":"2017. JSON Schema Compare. https:\/\/github.com\/mokkabonna\/json-schema-compare  2017. JSON Schema Compare. https:\/\/github.com\/mokkabonna\/json-schema-compare"},{"key":"e_1_3_2_1_15_1","unstructured":"2017. JSON Schema Diff Validator. https:\/\/bitbucket.org\/atlassian\/json-schema-diff-validator  2017. JSON Schema Diff Validator. https:\/\/bitbucket.org\/atlassian\/json-schema-diff-validator"},{"key":"e_1_3_2_1_16_1","unstructured":"2019. Kubernetes JSON Schemas. https:\/\/github.com\/instrumenta\/kubernetes-json-schema  2019. Kubernetes JSON Schemas. https:\/\/github.com\/instrumenta\/kubernetes-json-schema"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/155183.155231"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1831708.1831738"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3122831.3122837"},{"key":"e_1_3_2_1_20_1","volume-title":"Carlo Sartiani, and Stefanie Scherzinger","author":"Baazizi Mohamed-Amine","year":"2020","unstructured":"Mohamed-Amine Baazizi , Dario Colazzo , Giorgio Ghelli , Carlo Sartiani, and Stefanie Scherzinger . 2020 . Not Elimination and Witness Generation for JSON Schema. In Conf\u00e9rence sur la Gestion de Donn\u00e9es (BDA) . arxiv:2104.14828 Mohamed-Amine Baazizi, Dario Colazzo, Giorgio Ghelli, Carlo Sartiani, and Stefanie Scherzinger. 2020. Not Elimination and Witness Generation for JSON Schema. In Conf\u00e9rence sur la Gestion de Donn\u00e9es (BDA). arxiv:2104.14828"},{"key":"e_1_3_2_1_21_1","volume-title":"Lale: Consistent Automated Machine Learning. In KDD Workshop on Automation in Machine Learning (AutoML@KDD). arxiv:2007","author":"Baudart Guillaume","year":"2020","unstructured":"Guillaume Baudart , Martin Hirzel , Kiran Kate , Parikshit Ram , and Avraham Shinnar . 2020 . Lale: Consistent Automated Machine Learning. In KDD Workshop on Automation in Machine Learning (AutoML@KDD). arxiv:2007 .01977 Guillaume Baudart, Martin Hirzel, Kiran Kate, Parikshit Ram, and Avraham Shinnar. 2020. Lale: Consistent Automated Machine Learning. In KDD Workshop on Automation in Machine Learning (AutoML@KDD). arxiv:2007.01977"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098021"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/944705.944711"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-44202-9_11"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3034786.3056120"},{"key":"e_1_3_2_1_26_1","volume-title":"Data Validation for Machine Learning. In Conference on Systems and Machine Learning (SysML). https:\/\/www.sysml.cc\/doc\/2019\/167","author":"Breck Eric","year":"2019","unstructured":"Eric Breck , Marty Zinkevich , Neoklis Polyzotis , Steven Whang , and Sudip Roy . 2019 . Data Validation for Machine Learning. In Conference on Systems and Machine Learning (SysML). https:\/\/www.sysml.cc\/doc\/2019\/167 .pdf Eric Breck, Marty Zinkevich, Neoklis Polyzotis, Steven Whang, and Sudip Roy. 2019. Data Validation for Machine Learning. In Conference on Systems and Machine Learning (SysML). https:\/\/www.sysml.cc\/doc\/2019\/167.pdf"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1069774.1069793"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267809.3267844"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2014.10.014"},{"key":"e_1_3_2_1_30_1","volume-title":"Infer: A tool to detect bugs in Java and C\/C++\/Objective-C code before it ships. https:\/\/fbinfer.com\/","year":"2015","unstructured":"Facebook. 2015 . Infer: A tool to detect bugs in Java and C\/C++\/Objective-C code before it ships. https:\/\/fbinfer.com\/ Facebook. 2015. Infer: A tool to detect bugs in Java and C\/C++\/Objective-C code before it ships. https:\/\/fbinfer.com\/"},{"key":"e_1_3_2_1_31_1","unstructured":"Francis Galiegue and Kris Zyp. 2013. JSON Schema draft 04. http:\/\/json-schema.org\/draft-04\/json-schema-validation.html  Francis Galiegue and Kris Zyp. 2013. JSON Schema draft 04. http:\/\/json-schema.org\/draft-04\/json-schema-validation.html"},{"key":"e_1_3_2_1_32_1","unstructured":"Google. 2015. Error Prone: static analysis tool for Java. http:\/\/errorprone.info\/  Google. 2015. Error Prone: static analysis tool for Java. http:\/\/errorprone.info\/"},{"key":"e_1_3_2_1_33_1","unstructured":"Andrew Habib Avraham Shinnar Martin Hirzel and Michael Pradel. 2019. Type Safety with JSON Subschema. arxiv:1911.12651  Andrew Habib Avraham Shinnar Martin Hirzel and Michael Pradel. 2019. Type Safety with JSON Subschema. arxiv:1911.12651"},{"key":"e_1_3_2_1_34_1","volume-title":"Fast and Precise Hybrid Type Inference for JavaScript. In Conference on Programming Language Design and Implementation (PLDI). 239\u2013250","author":"Hackett Brian","year":"2012","unstructured":"Brian Hackett and Shu-yu Guo. 2012 . Fast and Precise Hybrid Type Inference for JavaScript. In Conference on Programming Language Design and Implementation (PLDI). 239\u2013250 . Brian Hackett and Shu-yu Guo. 2012. Fast and Precise Hybrid Type Inference for JavaScript. In Conference on Programming Language Design and Implementation (PLDI). 239\u2013250."},{"key":"e_1_3_2_1_35_1","unstructured":"Petter Haggholm. 2019. is-json-schema-subset. https:\/\/github.com\/haggholm\/is-json-schema-subset  Petter Haggholm. 2019. is-json-schema-subset. https:\/\/github.com\/haggholm\/is-json-schema-subset"},{"key":"e_1_3_2_1_36_1","volume-title":"International Conference on Software Engineering (ICSE). 291\u2013301","author":"Hangal Sudheendra","unstructured":"Sudheendra Hangal and Monica S. Lam . 2002. Tracking down software bugs using automatic anomaly detection . In International Conference on Software Engineering (ICSE). 291\u2013301 . Sudheendra Hangal and Monica S. Lam. 2002. Tracking down software bugs using automatic anomaly detection. In International Conference on Software Engineering (ICSE). 291\u2013301."},{"key":"e_1_3_2_1_37_1","volume-title":"An n Log n Algorithm for Minimizing States in a Finite Automaton","author":"Hopcroft John E.","unstructured":"John E. Hopcroft . 1971. An n Log n Algorithm for Minimizing States in a Finite Automaton . Stanford, CA, USA . John E. Hopcroft. 1971. An n Log n Algorithm for Minimizing States in a Finite Automaton. Stanford, CA, USA."},{"key":"e_1_3_2_1_38_1","volume-title":"Ullman","author":"Hopcroft John E.","year":"2006","unstructured":"John E. Hopcroft , Rajeev Motwani , and Jeffrey D . Ullman . 2006 . Introduction to Automata Theory, Languages, and Computation (3rd Edition). Addison-Wesley Longman Publishing Co. , Inc., USA. isbn:0321455363 John E. Hopcroft, Rajeev Motwani, and Jeffrey D. Ullman. 2006. Introduction to Automata Theory, Languages, and Computation (3rd Edition). Addison-Wesley Longman Publishing Co., Inc., USA. isbn:0321455363"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/767193.767195"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1053468.1053470"},{"key":"e_1_3_2_1_41_1","unstructured":"S. C. Johnson. 1978. Lint a C Program Checker. Murray Hill: Bell Telephone Laboratories.  S. C. Johnson. 1978. Lint a C Program Checker. Murray Hill: Bell Telephone Laboratories."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS.2013.48"},{"key":"e_1_3_2_1_43_1","volume-title":"Building Microservices: Designing Fine Grained Systems. O\u2019Reilly.","author":"Newman Sam","year":"2015","unstructured":"Sam Newman . 2015 . Building Microservices: Designing Fine Grained Systems. O\u2019Reilly. Sam Newman. 2015. Building Microservices: Designing Fine Grained Systems. O\u2019Reilly."},{"key":"e_1_3_2_1_44_1","volume-title":"Feedback-Directed Random Test Generation. In International Conference on Software Engineering (ICSE). 75\u201384","author":"Pacheco Carlos","year":"2007","unstructured":"Carlos Pacheco , Shuvendu K. Lahiri , Michael D. Ernst , and Thomas Ball . 2007 . Feedback-Directed Random Test Generation. In International Conference on Software Engineering (ICSE). 75\u201384 . Carlos Pacheco, Shuvendu K. Lahiri, Michael D. Ernst, and Thomas Ball. 2007. Feedback-Directed Random Test Generation. In International Conference on Software Engineering (ICSE). 75\u201384."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/800237.807133"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883029"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAI.2016.0094"},{"key":"e_1_3_2_1_48_1","volume-title":"TypeDevil: Dynamic Type Inconsistency Analysis for JavaScript. In International Conference on Software Engineering (ICSE).","author":"Pradel Michael","year":"2015","unstructured":"Michael Pradel , Parker Schuh , and Koushik Sen . 2015 . TypeDevil: Dynamic Type Inconsistency Analysis for JavaScript. In International Conference on Software Engineering (ICSE). Michael Pradel, Parker Schuh, and Koushik Sen. 2015. TypeDevil: Dynamic Type Inconsistency Analysis for JavaScript. In International Conference on Software Engineering (ICSE)."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3426422.3426981"},{"key":"e_1_3_2_1_50_1","volume-title":"Wilson","author":"Redmond Eric","year":"2012","unstructured":"Eric Redmond and Jim R . Wilson . 2012 . Seven Databases in Seven Weeks. The Pragmatic Bookshelf . Eric Redmond and Jim R. Wilson. 2012. Seven Databases in Seven Weeks. The Pragmatic Bookshelf."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-38791-8_2"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.14778\/3229863.3229867"},{"key":"e_1_3_2_1_53_1","volume-title":"Combining Static and Dynamic Reasoning for Bug Detection. In International Conference on Tests and Proofs (TAP). 1\u201316","author":"Smaragdakis Yannis","year":"2007","unstructured":"Yannis Smaragdakis and Christoph Csallner . 2007 . Combining Static and Dynamic Reasoning for Bug Detection. In International Conference on Tests and Proofs (TAP). 1\u201316 . Yannis Smaragdakis and Christoph Csallner. 2007. Combining Static and Dynamic Reasoning for Bug Detection. In International Conference on Tests and Proofs (TAP). 1\u201316."},{"key":"e_1_3_2_1_54_1","volume-title":"James Max Kanter, and Kalyan Veeramachaneni","author":"Smith Micah J.","year":"2019","unstructured":"Micah J. Smith , Carles Sala , James Max Kanter, and Kalyan Veeramachaneni . 2019 . The Machine Learning Bazaar: Harnessing the ML Ecosystem for Effective System Development . arxiv:1905.08942 Micah J. Smith, Carles Sala, James Max Kanter, and Kalyan Veeramachaneni. 2019. The Machine Learning Bazaar: Harnessing the ML Ecosystem for Effective System Development. arxiv:1905.08942"},{"key":"e_1_3_2_1_55_1","unstructured":"Snowplow Analytics. 2014. Central repository for storing JSON Schemas Avros and Thrifts. https:\/\/github.com\/snowplow\/iglu-central  Snowplow Analytics. 2014. Central repository for storing JSON Schemas Avros and Thrifts. https:\/\/github.com\/snowplow\/iglu-central"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45089-0_20"},{"key":"e_1_3_2_1_57_1","volume-title":"Symposium on Operating Systems Design and Implementation (OSDI). 249\u2013265","author":"Yuan Ding","year":"2014","unstructured":"Ding Yuan , Yu Luo , Xin Zhuang , Guilherme Renna Rodrigues , Xu Zhao , Yongle Zhang , Pranay U Jain , and Michael Stumm . 2014 . Simple testing can prevent most critical failures: An analysis of production failures in distributed data-intensive systems . In Symposium on Operating Systems Design and Implementation (OSDI). 249\u2013265 . Ding Yuan, Yu Luo, Xin Zhuang, Guilherme Renna Rodrigues, Xu Zhao, Yongle Zhang, Pranay U Jain, and Michael Stumm. 2014. Simple testing can prevent most critical failures: An analysis of production failures in distributed data-intensive systems. In Symposium on Operating Systems Design and Implementation (OSDI). 249\u2013265."},{"key":"e_1_3_2_1_58_1","unstructured":"Kris Zyp. 2009. JSON Schema. http:\/\/json-schema.org\/  Kris Zyp. 2009. JSON Schema. http:\/\/json-schema.org\/"}],"event":{"name":"ISSTA '21: 30th ACM SIGSOFT International Symposium on Software Testing and Analysis","location":"Virtual Denmark","acronym":"ISSTA '21","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering"]},"container-title":["Proceedings of the 30th ACM SIGSOFT International Symposium on Software Testing and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460319.3464796","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3460319.3464796","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:31Z","timestamp":1750193311000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460319.3464796"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,11]]},"references-count":58,"alternative-id":["10.1145\/3460319.3464796","10.1145\/3460319"],"URL":"https:\/\/doi.org\/10.1145\/3460319.3464796","relation":{},"subject":[],"published":{"date-parts":[[2021,7,11]]},"assertion":[{"value":"2021-07-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}