{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T08:09:04Z","timestamp":1770883744371,"version":"3.50.1"},"reference-count":13,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2016,11,3]],"date-time":"2016-11-03T00:00:00Z","timestamp":1478131200000},"content-version":"vor","delay-in-days":792,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2015,1,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Motivation: The analysis of large biological datasets often requires complex processing pipelines that run for a long time on large computational infrastructures. We designed and implemented a simple script-like programming language with a clean and minimalist syntax to develop and manage pipeline execution and provide robustness to various types of software and hardware failures as well as portability.<\/jats:p>\n               <jats:p>Results: We introduce the BigDataScript (BDS) programming language for data processing pipelines, which improves abstraction from hardware resources and assists with robustness. Hardware abstraction allows BDS pipelines to run without modification on a wide range of computer architectures, from a small laptop to multi-core servers, server farms, clusters and clouds. BDS achieves robustness by incorporating the concepts of absolute serialization and lazy processing, thus allowing pipelines to recover from errors. By abstracting pipeline concepts at programming language level, BDS simplifies implementation, execution and management of complex bioinformatics pipelines, resulting in reduced development and debugging cycles as well as cleaner code.<\/jats:p>\n               <jats:p>Availability and implementation: BigDataScript is available under open-source license at http:\/\/pcingola.github.io\/BigDataScript .<\/jats:p>\n               <jats:p>Contact: \u00a0pablo.e.cingolani@gmail.com<\/jats:p>","DOI":"10.1093\/bioinformatics\/btu595","type":"journal-article","created":{"date-parts":[[2014,9,5]],"date-time":"2014-09-05T05:34:33Z","timestamp":1409895273000},"page":"10-16","source":"Crossref","is-referenced-by-count":33,"title":["BigDataScript: a scripting language for data pipelines"],"prefix":"10.1093","volume":"31","author":[{"given":"Pablo","family":"Cingolani","sequence":"first","affiliation":[{"name":"1 McGill University School of Computer Science, 3480 University Street, Montreal, Qu\u00e9bec H3A 0E9 and 2 McGill University and G\u00e9nome Qu\u00e9bec Innovation Centre, 740 Dr. Penfield Avenue, Montr\u00e9al, Qu\u00e9bec H3A 0G1, Canada"},{"name":"1 McGill University School of Computer Science, 3480 University Street, Montreal, Qu\u00e9bec H3A 0E9 and 2 McGill University and G\u00e9nome Qu\u00e9bec Innovation Centre, 740 Dr. Penfield Avenue, Montr\u00e9al, Qu\u00e9bec H3A 0G1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rob","family":"Sladek","sequence":"additional","affiliation":[{"name":"1 McGill University School of Computer Science, 3480 University Street, Montreal, Qu\u00e9bec H3A 0E9 and 2 McGill University and G\u00e9nome Qu\u00e9bec Innovation Centre, 740 Dr. Penfield Avenue, Montr\u00e9al, Qu\u00e9bec H3A 0G1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mathieu","family":"Blanchette","sequence":"additional","affiliation":[{"name":"1 McGill University School of Computer Science, 3480 University Street, Montreal, Qu\u00e9bec H3A 0E9 and 2 McGill University and G\u00e9nome Qu\u00e9bec Innovation Centre, 740 Dr. Penfield Avenue, Montr\u00e9al, Qu\u00e9bec H3A 0G1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2014,9,3]]},"reference":[{"key":"2023020116160339100_btu595-B1","article-title":"From FastQ data to high-confidence variant calls: the genome analysis toolkit best practices pipeline","author":"Auwera","year":"2013","journal-title":"Curr. Protoc. Bioinformatics"},{"key":"2023020116160339100_btu595-B2","doi-asserted-by":"crossref","first-page":"35","DOI":"10.3389\/fgene.2012.00035","article-title":"Using \n              Drosophila melanogaster\n               as a model for genotoxic chemical mutational studies with a new program, SnpSift","volume":"3","author":"Cingolani","year":"2012","journal-title":"Frontiers in genetics"},{"key":"2023020116160339100_btu595-B3","doi-asserted-by":"crossref","first-page":"80","DOI":"10.4161\/fly.19695","article-title":"A program for annotating and predicting the effects of single nucleotide polymorphisms, SnpEff: SNPs in the genome of \n              Drosophila melanogaster\n               strain w1118; iso-2; iso-3","volume":"6","author":"Cingolani","year":"2012","journal-title":"Fly"},{"key":"2023020116160339100_btu595-B4","first-page":"255","article-title":"Make\u2014a program for maintaining computer program","volume":"9","author":"Feldman","year":"1979","journal-title":"Software"},{"key":"2023020116160339100_btu595-B5","doi-asserted-by":"crossref","first-page":"2778","DOI":"10.1093\/bioinformatics\/btq524","article-title":"Ruffus: a lightweight python library for computational pipelines","volume":"26","author":"Goodstadt","year":"2010","journal-title":"Bioinformatics"},{"key":"2023020116160339100_btu595-B6","doi-asserted-by":"crossref","first-page":"2520","DOI":"10.1093\/bioinformatics\/bts480","article-title":"Snakemake\u2014a scalable bioinformatics workflow engine","volume":"28","author":"K\u00f6ster","year":"2012","journal-title":"Bioinformatics"},{"key":"2023020116160339100_btu595-B7","doi-asserted-by":"crossref","first-page":"1754","DOI":"10.1093\/bioinformatics\/btp324","article-title":"Fast and accurate short read alignment with Burrows\u2013Wheeler transform","volume":"25","author":"Li","year":"2009","journal-title":"Bioinformatics"},{"key":"2023020116160339100_btu595-B8","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1101\/gr.107524.110","article-title":"The genome analysis toolkit: a MapReduce framework for analyzing next-generation DNA sequencing data","volume":"20","author":"McKenna","year":"2010","journal-title":"Genome Res."},{"key":"2023020116160339100_btu595-B9","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1186\/1471-2105-14-201","article-title":"Bioinformatic pipelines in Python with Leaf","volume":"14","author":"Napolitano","year":"2013","journal-title":"BMC Bioinformatics"},{"key":"2023020116160339100_btu595-B10","volume-title":"The Definitive ANTLR Reference: Building Domain-specific Languages","author":"Parr","year":"2007"},{"key":"2023020116160339100_btu595-B11","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1007\/BF01019459","article-title":"The discoveries of continuations","volume":"6","author":"Reynolds","year":"1993","journal-title":"LISP Symbol. Comput."},{"key":"2023020116160339100_btu595-B12","doi-asserted-by":"crossref","first-page":"1525","DOI":"10.1093\/bioinformatics\/bts167","article-title":"Bpipe: a tool for running and managing bioinformatics pipelines","volume":"28","author":"Sadedin","year":"2012","journal-title":"Bioinformatics"},{"key":"2023020116160339100_btu595-B13","first-page":"E455","article-title":"Searching for missing heritability: designing rare variant association studies, \n              Proc","volume":"111","author":"Zuk","year":"2014","journal-title":"Natl Acad. Sci.s"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/31\/1\/10\/49012894\/bioinformatics_31_1_10.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/31\/1\/10\/49012894\/bioinformatics_31_1_10.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,2]],"date-time":"2023-02-02T00:26:27Z","timestamp":1675297587000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/31\/1\/10\/2365800"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,9,3]]},"references-count":13,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2015,1,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btu595","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2015,1,1]]},"published":{"date-parts":[[2014,9,3]]}}}