{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,26]],"date-time":"2026-08-26T08:05:43Z","timestamp":1787731543590,"version":"build-2784847793"},"reference-count":28,"publisher":"eLife Sciences Publications, Ltd","license":[{"start":{"date-parts":[[2022,5,19]],"date-time":"2022-05-19T00:00:00Z","timestamp":1652918400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2022,5,19]],"date-time":"2022-05-19T00:00:00Z","timestamp":1652918400000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2022,5,19]],"date-time":"2022-05-19T00:00:00Z","timestamp":1652918400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100004440","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["200205\/Z\/15\/Z"],"award-info":[{"award-number":["200205\/Z\/15\/Z"]}],"id":[{"id":"10.13039\/100004440","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000865","name":"Bill and Melinda Gates Foundation","doi-asserted-by":"publisher","award":["OPP1133541"],"award-info":[{"award-number":["OPP1133541"]}],"id":[{"id":"10.13039\/100000865","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004440","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["203141\/Z\/16\/Z"],"award-info":[{"award-number":["203141\/Z\/16\/Z"]}],"id":[{"id":"10.13039\/100004440","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["elifesciences.org"],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2022,5,15]]},"abstract":"<jats:p>Tuberculosis is a respiratory disease that is treatable with antibiotics. An increasing prevalence of resistance means that to ensure a good treatment outcome it is desirable to test the susceptibility of each infection to different antibiotics. Conventionally, this is done by culturing a clinical sample and then exposing aliquots to a panel of antibiotics, each being present at a pre-determined concentration, thereby determining if the sample isresistant or susceptible to each sample. The minimum inhibitory concentration (MIC) of a drug is the lowestconcentration that inhibits growth and is a more useful quantity but requires each sample to be tested at a range ofconcentrations for each drug. Using 96-well broth micro dilution plates with each well containing a lyophilised pre-determined amount of an antibiotic is a convenient and cost-effective way to measure the MICs of several drugs at once for a clinical sample. Although accurate, this is still an expensive and slow process that requires highly-skilled and experienced laboratory scientists. Here we show that, through the BashTheBug project hosted on the Zooniverse citizen science platform, a crowd of volunteers can reproducibly and accurately determine the MICs for 13 drugs and that simply taking the median or mode of 11\u201317 independent classifications is sufficient. There is therefore a potential role for crowds to support (but not supplant) the role of experts in antibiotic susceptibility testing.<\/jats:p>","DOI":"10.7554\/elife.75046","type":"journal-article","created":{"date-parts":[[2022,5,19]],"date-time":"2022-05-19T10:00:20Z","timestamp":1652954420000},"update-policy":"https:\/\/doi.org\/10.7554\/elife.75046","source":"Crossref","is-referenced-by-count":27,"title":["A crowd of BashTheBug volunteers reproducibly and accurately measure the minimum inhibitory concentrations of 13 antitubercular drugs from photographs of 96-well broth microdilution plates"],"prefix":"10.7554","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0912-4483","authenticated-orcid":true,"given":"Philip W","family":"Fowler","sequence":"first","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Nuffield Department of Medicine, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carla","family":"Wright","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Nuffield Department of Medicine, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Helen","family":"Spiers","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Zooniverse, Department of Physics, University of Oxford","place":["Oxford, United Kingdom"]},{"id":[{"id":"https:\/\/ror.org\/04tnbqb63","id-type":"ROR","asserted-by":"publisher"}],"name":"Electron Microscopy Science Technology Platform, The Francis Crick Institute","place":["London, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tingting","family":"Zhu","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Institute of Biomedical Engineering, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elisabeth ML","family":"Baeten","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Citizen Scientist, c\/o Zooniverse, Department of Physics, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah W","family":"Hoosdally","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Nuffield Department of Medicine, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9473-2215","authenticated-orcid":true,"given":"Ana L","family":"Gibertoni Cruz","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Nuffield Department of Medicine, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aysha","family":"Roohi","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Nuffield Department of Medicine, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samaneh","family":"Kouchaki","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Institute of Biomedical Engineering, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0421-9264","authenticated-orcid":true,"given":"Timothy M","family":"Walker","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Nuffield Department of Medicine, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Timothy EA","family":"Peto","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Nuffield Department of Medicine, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Grant","family":"Miller","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Zooniverse, Department of Physics, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chris","family":"Lintott","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Zooniverse, Department of Physics, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Clifton","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Institute of Biomedical Engineering, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0590-2850","authenticated-orcid":true,"given":"Derrick W","family":"Crook","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Nuffield Department of Medicine, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0412-8509","authenticated-orcid":true,"given":"A Sarah","family":"Walker","sequence":"additional","affiliation":[{"id":[{"id":"https:\/\/ror.org\/052gg0110","id-type":"ROR","asserted-by":"publisher"}],"name":"Nuffield Department of Medicine, University of Oxford","place":["Oxford, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"The Zooniverse Volunteer Community","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"The CRyPTIC Consortium","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"4374","published-online":{"date-parts":[[2022,5,19]]},"reference":[{"key":"bib1","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1109\/MCSE.2015.65","article-title":"Defining and Measuring Success in Online Citizen Science: A Case Study of Zooniverse Projects","volume":"17","author":"Cox","year":"2015","journal-title":"Computing in Science & Engineering"},{"key":"bib2","doi-asserted-by":"publisher","DOI":"10.1183\/13993003.00239-2022","article-title":"Epidemiological cutoff values for a 96-well broth microdilution plate for high-throughput research antibiotic susceptibility testing of M. tuberculosis","volume":"1949","author":"CRyPTIC Consortium","year":"2022","journal-title":"The European Respiratory Journal"},{"key":"bib3","article-title":"Help us fight antibiotic resistance","author":"Fowler","year":"2017","unstructured":"Fowler PW. 2017. Help us fight antibiotic resistance. https:\/\/bashthebug.net\/bashthebug-on-the-zooniverse\/ [Accessed June 10, 2022]."},{"key":"bib4","article-title":"pyniverse: a Python package to analyse classifications made by volunteers in a generic Zooniverse citizen science project","volume-title":"Github","author":"Fowler","year":"2018","unstructured":"Fowler PW. 2018a. pyniverse: a Python package to analyse classifications made by volunteers in a generic Zooniverse citizen science project. Github. ce066f5. https:\/\/github.com\/fowler-lab\/pyniverse."},{"key":"bib5","article-title":"bashthebug: a Python package to analyse the results of the Zooniverse volunteers for the BashTheBug citizen science project","volume-title":"Github","author":"Fowler","year":"2018","unstructured":"Fowler PW. 2018b. bashthebug: a Python package to analyse the results of the Zooniverse volunteers for the BashTheBug citizen science project. Github. 8b22907. https:\/\/github.com\/fowler-lab\/bashthebug."},{"key":"bib6","doi-asserted-by":"publisher","first-page":"1522","DOI":"10.1099\/mic.0.000733","article-title":"Automated detection of bacterial growth on 96-well plates for high-throughput drug susceptibility testing of Mycobacterium tuberculosis","volume":"164","author":"Fowler","year":"2018","journal-title":"Microbiology (Reading, England)"},{"key":"bib7","article-title":"bashthebug-consensus-dataset","volume-title":"Software Heritage","author":"Fowler Lab","year":"2022","unstructured":"Fowler Lab. 2022. bashthebug-consensus-dataset. Software Heritage. swh:1:rev:61ba253936f7ec33a785158ee48c84e63256cd8b. https:\/\/archive.softwareheritage.org\/swh:1:dir:c34c01c11f511481b3505e897bad80a091e9cf7a;origin=https:\/\/github.com\/fowler-lab\/bashthebug-consensus-dataset;visit=swh:1:snp:473a0168a5c1542beaf77d3a22fa8bdb8c841a41;anchor=swh:1:rev:61ba253936f7ec33a785158ee48c84e63256cd8b."},{"key":"bib8","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1038\/075450a0","article-title":"Vox populi","volume":"1949","author":"Galton","year":"1907","journal-title":"Nature"},{"key":"bib9","volume-title":"ISO 20776-2: Clinical laboratory testing and in vitro diagnostic test systems Technical report","author":"International Standards Organization","year":"2007","unstructured":"International Standards Organization. 2007. International Standards Organization. ISO 20776-2: Clinical laboratory testing and in vitro diagnostic test systems Technical report."},{"key":"bib10","volume-title":"Geometrei von K\u00a8unstlichem Feldmessen","author":"Koebel","year":"1563"},{"key":"bib11","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1099\/00207713-22-2-99","article-title":"Designation of Strain H37Rv as the Neotype of Mycobacterium tuberculosis","volume":"22","author":"Kubica","year":"1972","journal-title":"International Journal of Systematic Bacteriology"},{"key":"bib12","first-page":"256","article-title":"In 30th Annual Symposium on Foundations of Computer Science","author":"Littlestone","year":"1989","unstructured":"Littlestone N, Warmuth M. 1989. In 30th Annual Symposium on Foundations of Computer Science. IEEE."},{"key":"bib13","first-page":"51","article-title":"In Proceedings of the 9th Python in Science Conference","author":"McKinney","year":"2010","unstructured":"McKinney W. 2010. In Proceedings of the 9th Python in Science Conference. SciPy."},{"key":"bib14","article-title":"Panoptes CLI. A command-line interface for Panoptes, the API behind the Zooniverse","volume-title":"Github","author":"McMaster","year":"2021","unstructured":"McMaster A, Hutchings R, Allen C, Wolfenbarger Z, Dickinson H, Trouille L, Johnson C. 2021. Panoptes CLI. A command-line interface for Panoptes, the API behind the Zooniverse. Github. 2.0. https:\/\/github.com\/zooniverse\/panoptes-cli."},{"key":"bib15","volume-title":"Tackling Drug-Resistant Infections Globally: Final Report and Recommendations","author":"O\u2019Neill","year":"2016","unstructured":"O\u2019Neill J. 2016. Technical report. Tackling Drug-Resistant Infections Globally: Final Report and Recommendations."},{"key":"bib16","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1016\/S2213-2600(15)00466-X","article-title":"Rapid, comprehensive, and affordable mycobacterial diagnosis with whole-genome sequencing: a prospective study","volume":"4","author":"Pankhurst","year":"2016","journal-title":"The Lancet. Respiratory Medicine"},{"key":"bib17","article-title":"Antimicrobial Agents and Chemotherapy","volume":"62","author":"Rancoita","year":"2018","journal-title":"ASM Journals Logo"},{"key":"bib18","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1016\/j.cmi.2019.01.019","article-title":"Standards for MIC testing that apply to the majority of bacterial pathogens should also be enforced for Mycobacterium tuberculosis complex","volume":"25","author":"Sch\u00f6n","year":"2019","journal-title":"Clinical Microbiology and Infection"},{"key":"bib19","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.cmi.2020.10.019","article-title":"Antimicrobial susceptibility testing of Mycobacterium tuberculosis complex isolates \u2013 the EUCAST broth microdilution reference method for MIC determination","volume":"27","author":"Sch\u00f6n","year":"2020","journal-title":"Clinical Microbiology and Infection"},{"key":"bib20","doi-asserted-by":"publisher","DOI":"10.22323\/2.18010204","article-title":"Everyone counts? Design considerations in online citizen science","volume":"18","author":"Spiers","year":"2019","journal-title":"Journal of Science Communication"},{"key":"bib21","doi-asserted-by":"publisher","DOI":"10.1101\/2020.07.28.223024","article-title":"Citizen Science, Cells and CNNs \u2013 Deep Learning for Automatic Segmentation of the Nuclear Envelope in Electron Microscopy Data, Trained with Volunteer Segmentations","volume-title":"bioRxiv","author":"Spiers","year":"2020"},{"key":"bib22","doi-asserted-by":"publisher","DOI":"10.1101\/20210914460353","article-title":"A Crowd of BashTheBug Volunteers Reproducibly and Accurately Measure the Minimum Inhibitory Concentrations of 13 Antitubercular Drugs from Photographs of 96-Well Broth Microdilution Plates","volume-title":"bioRxiv","author":"The CRyPTIC Consortium","year":"2021"},{"key":"bib23","doi-asserted-by":"publisher","DOI":"10.1101\/20210914460274","article-title":"BashTheBug: A Crowd of Volunteers Reproducibly and Accurately Measure the Minimum Inhibitory Concentrations of 13 Antitubercular Drugs from Photographs of 96-Well Broth Microdilution Plates","volume-title":"bioRxiv","author":"The CRyPTIC Consortium","year":"2022"},{"key":"bib24","doi-asserted-by":"publisher","first-page":"1902","DOI":"10.1073\/pnas.1807190116","article-title":"Citizen science frontiers: Efficiency, engagement, and serendipitous discovery with human-machine systems","volume":"116","author":"Trouille","year":"2019","journal-title":"PNAS"},{"key":"bib25","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1016\/S1473-3099(17)30123-8","article-title":"Tuberculosis is changing","volume":"17","author":"Walker","year":"2017","journal-title":"The Lancet. Infectious Diseases"},{"key":"bib26","doi-asserted-by":"publisher","first-page":"e265","DOI":"10.1016\/S2666-5247(21)00301-3","article-title":"The 2021 WHO catalogue of Mycobacterium tuberculosis complex mutations associated with drug resistance: A genotypic analysis","volume":"3","author":"Walker","year":"2022","journal-title":"The Lancet. Microbe"},{"key":"bib27","volume-title":"Global Tuberculosis Report, Technical report","author":"World Health Organization","year":"2020","unstructured":"World Health Organization. 2020. WHO. Global Tuberculosis Report, Technical report."},{"key":"bib28","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1007\/s10439-013-0964-6","article-title":"Crowd-sourced annotation of ecg signals using contextual information","volume":"42","author":"Zhu","year":"2014","journal-title":"Annals of Biomedical Engineering"}],"container-title":["eLife"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/cdn.elifesciences.org\/articles\/75046\/elife-75046-v3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/cdn.elifesciences.org\/articles\/75046\/elife-75046-v3.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/elifesciences.org\/articles\/75046","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,11]],"date-time":"2023-10-11T21:11:57Z","timestamp":1697058717000},"score":1,"resource":{"primary":{"URL":"https:\/\/elifesciences.org\/articles\/75046"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,19]]},"references-count":28,"alternative-id":["10.7554\/eLife.75046"],"URL":"https:\/\/doi.org\/10.7554\/elife.75046","archive":["CLOCKSS"],"relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.07.20.453060","asserted-by":"subject"},{"id-type":"doi","id":"10.1101\/2021.07.20.453060","asserted-by":"object"}],"is-supplemented-by":[{"id-type":"accession","id":"consensus-dataset","asserted-by":"subject"}],"has-review":[{"id-type":"doi","id":"10.7554\/eLife.75046.sa2","asserted-by":"object"},{"id-type":"doi","id":"10.7554\/eLife.75046.sa0","asserted-by":"object"},{"id-type":"doi","id":"10.7554\/eLife.75046.sa1","asserted-by":"object"}]},"ISSN":["2050-084X"],"issn-type":[{"value":"2050-084X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,19]]},"assertion":[{"value":"single anonymised","name":"peer_review_transparency","label":"Peer review transparency","group":{"name":"peer_review_taxonomy"}},{"value":"other reviewer(s), editor","name":"peer_review_interaction","label":"Peer review interaction","group":{"name":"peer_review_taxonomy"}},{"value":"review summaries, review reports, author\/editor communication, reviewer identities reviewer opt in, editor identities","name":"peer_review_published","label":"Peer review published","group":{"name":"peer_review_taxonomy"}},{"value":"open (sign in with ORCID iD required)","name":"post_publication_commenting","label":"Post publication commenting","group":{"name":"post_publication_commenting"}}],"article-number":"e75046"}}