{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T06:05:52Z","timestamp":1790316352429,"version":"4.1.0"},"reference-count":150,"publisher":"AIP Publishing","issue":"14","funder":[{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-21-1-2151"],"award-info":[{"award-number":["N00014-21-1-2151"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-18-1-2659"],"award-info":[{"award-number":["N00014-18-1-2659"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DGE-1656518"],"award-info":[{"award-number":["DGE-1656518"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,4,14]]},"abstract":"<jats:p>Electronic structure theory, i.e., quantum chemistry, is the fundamental building block for many problems in computational chemistry. We present a new distributed computing framework (BigChem), which allows for an efficient solution of many quantum chemistry problems in parallel. BigChem is designed to be easily composable and leverages industry-standard middleware (e.g., Celery, RabbitMQ, and Redis) for distributed approaches to large scale problems. BigChem can harness any collection of worker nodes, including ones on cloud providers (such as AWS or Azure), local clusters, or supercomputer centers (and any mixture of these). BigChem builds upon MolSSI packages, such as QCEngine to standardize the operation of numerous computational chemistry programs, demonstrated here with Psi4, xtb, geomeTRIC, and TeraChem. BigChem delivers full utilization of compute resources at scale, offers a programable canvas for designing sophisticated quantum chemistry workflows, and is fault tolerant to node failures and network disruptions. We demonstrate linear scalability of BigChem running computational chemistry workloads on up to 125 GPUs. Finally, we present ChemCloud, a web API to BigChem and successor to TeraChem Cloud. ChemCloud delivers scalable and secure access to BigChem over the Internet.<\/jats:p>","DOI":"10.1063\/5.0190834","type":"journal-article","created":{"date-parts":[[2024,4,9]],"date-time":"2024-04-09T06:14:07Z","timestamp":1712643247000},"update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":16,"title":["Massively scalable workflows for quantum chemistry:\n                    <scp>BigChem<\/scp>\n                    and\n                    <scp>ChemCloud<\/scp>"],"prefix":"10.1063","volume":"160","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2834-318X","authenticated-orcid":false,"given":"Colton B.","family":"Hicks","sequence":"first","affiliation":[{"name":"Department of Chemistry and The PULSE Institute, Stanford University, Stanford, California 94305, USA and SLAC National Accelerator Laboratory , Menlo Park, California 94025, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4798-8947","authenticated-orcid":false,"given":"Todd J.","family":"Martinez","sequence":"additional","affiliation":[{"name":"Department of Chemistry and The PULSE Institute, Stanford University, Stanford, California 94305, USA and SLAC National Accelerator Laboratory , Menlo Park, California 94025, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"317","published-online":{"date-parts":[[2024,4,9]]},"reference":[{"key":"2024040910111673700_c1","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1016\/j.jphotochem.2006.12.008","article-title":"The on-the-fly surface-hopping program system Newton-X: Application to ab\u00a0initio simulation of the nonadiabatic photodynamics of benchmark systems","volume":"190","year":"2007","journal-title":"J. Photochem. Photobiol., A"},{"key":"2024040910111673700_c2","doi-asserted-by":"publisher","first-page":"10902","DOI":"10.1021\/jp508242j","article-title":"Interfacing the ab\u00a0initio multiple spawning method with electronic structure methods in GAMESS: Photodecay of trans-azomethane","volume":"118","year":"2014","journal-title":"J. Phys. Chem. A"},{"key":"2024040910111673700_c3","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.chemphys.2008.01.014","article-title":"Implementation of ab\u00a0initio multiple spawning in the MOLPRO quantum chemistry package","volume":"347","year":"2008","journal-title":"Chem. Phys."},{"key":"2024040910111673700_c4","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1016\/j.chemphys.2004.04.018","article-title":"Excited state direct dynamics of benzene with reparameterized multi-reference semiempirical configuration interaction methods","volume":"304","year":"2004","journal-title":"Chem. Phys."},{"key":"2024040910111673700_c5","doi-asserted-by":"publisher","first-page":"e26390","DOI":"10.1002\/qua.26390","article-title":"pysisyphus: Exploring potential energy surfaces in ground and excited states","volume":"121","year":"2021","journal-title":"Int. J. Quantum Chem."},{"key":"2024040910111673700_c6","doi-asserted-by":"publisher","first-page":"214108","DOI":"10.1063\/1.4952956","article-title":"Geometry optimization made simple with translation and rotation coordinates","volume":"144","year":"2016","journal-title":"J. Chem. Phys."},{"key":"2024040910111673700_c7","doi-asserted-by":"publisher","first-page":"5485","DOI":"10.1021\/acs.jctc.0c00575","article-title":"PySpawn: Software for nonadiabatic quantum molecular dynamics","volume":"16","year":"2020","journal-title":"J. Chem. Theory Comput."},{"key":"2024040910111673700_c8","doi-asserted-by":"publisher","first-page":"1230","DOI":"10.1002\/jcc.24312","article-title":"Cuby: An integrative framework for computational chemistry","volume":"37","year":"2016","journal-title":"J. Comput. Chem."},{"key":"2024040910111673700_c9","doi-asserted-by":"publisher","first-page":"e1554","DOI":"10.1002\/wcms.1554","article-title":"WebMO: Web-based computational chemistry calculations in education and research","volume":"12","year":"2022","journal-title":"Wiley Interdiscip. Rev.: Comput. Mol. Sci."},{"key":"2024040910111673700_c10","doi-asserted-by":"publisher","first-page":"273002","DOI":"10.1088\/1361-648x\/aa680e","article-title":"The atomic simulation environment\u2014A Python library for working with atoms","volume":"29","year":"2017","journal-title":"J. Phys.: Condens. Matter"},{"key":"2024040910111673700_c11","doi-asserted-by":"publisher","first-page":"839","DOI":"10.1002\/jcc.20823","article-title":"cclib: A library for package-independent computational chemistry algorithms","volume":"29","year":"2008","journal-title":"J. Comput. Chem."},{"key":"2024040910111673700_c12","doi-asserted-by":"publisher","first-page":"928","DOI":"10.1021\/ci990052b","article-title":"Chemical markup, XML, and the worldwide web. 1. Basic principles","volume":"39","year":"1999","journal-title":"J. Chem. Inf. Comput. Sci."},{"key":"2024040910111673700_c13","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1021\/ci050400b","article-title":"The Blue Obelisk\u2014interoperability in chemical informatics","volume":"46","year":"2006","journal-title":"J. Chem. Inf. Model."},{"key":"2024040910111673700_c14","unstructured":"See https:\/\/github.com\/MolSSI\/QCSchema for QCSchema; accessed 1 August 2023."},{"key":"2024040910111673700_c15","unstructured":"See https:\/\/github.com\/MolSSI\/QCElemental for QCElemental; accessed 1 August 2023."},{"key":"2024040910111673700_c16","doi-asserted-by":"publisher","first-page":"204801","DOI":"10.1063\/5.0059356","article-title":"Quantum chemistry common driver and databases (QCDB) and quantum chemistry engine (QCEngine): Automation and interoperability among computational chemistry programs","volume":"155","year":"2021","journal-title":"J. Chem. Phys."},{"key":"2024040910111673700_c17","doi-asserted-by":"publisher","first-page":"e1491","DOI":"10.1002\/wcms.1491","article-title":"The MolSSI QCArchive project: An open-source platform to compute, organize, and share quantum chemistry data","volume":"11","year":"2021","journal-title":"Wiley Interdiscip. Rev.: Comput. Mol. Sci."},{"key":"2024040910111673700_c18","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1146\/annurev-physchem-090419-051350","article-title":"Vibronic and environmental effects in simulations of optical spectroscopy","volume":"72","year":"2021","journal-title":"Annu. Rev. Phys. Chem."},{"key":"2024040910111673700_c19","doi-asserted-by":"publisher","first-page":"1237","DOI":"10.1007\/s00214-012-1237-4","article-title":"Spectrum simulation and decomposition with nuclear ensemble: Formal derivation and application to benzene, furan and 2-phenylfuran","volume":"131","year":"2012","journal-title":"Theor. Chem. Acc."},{"key":"2024040910111673700_c20","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1007\/0-306-46949-9","article-title":"Methods for finding saddle points and minimum energy paths","volume-title":"Theoretical Methods in Condensed Phase Chemistry","author":"Schwartz","year":"2002"},{"key":"2024040910111673700_c21","doi-asserted-by":"publisher","first-page":"9978","DOI":"10.1063\/1.1323224","article-title":"Improved tangent estimate in the nudged elastic band method for finding minimum energy paths and saddle points","volume":"113","year":"2000","journal-title":"J. Chem. Phys."},{"key":"2024040910111673700_c22","doi-asserted-by":"publisher","first-page":"052301","DOI":"10.1103\/physrevb.66.052301","article-title":"String method for the study of rare events","volume":"66","year":"2002","journal-title":"Phys. Rev. B"},{"key":"2024040910111673700_c23","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1007\/s00214-002-0421-3","article-title":"Exploring the quantum mechanical\/molecular mechanical replica path method: A pathway optimization of the chorismate to prephenate Claisen rearrangement catalyzed by chorismate mutase","volume":"109","year":"2003","journal-title":"Theor. Chem. Acc."},{"key":"2024040910111673700_c24","doi-asserted-by":"publisher","first-page":"7877","DOI":"10.1063\/1.1691018","article-title":"A growing string method for determining transition states: Comparison to the nudged elastic band and string methods","volume":"120","year":"2004","journal-title":"J. Chem. Phys."},{"key":"2024040910111673700_c25","doi-asserted-by":"publisher","first-page":"3749","DOI":"10.1021\/acs.accounts.1c00390","article-title":"Ab initio direct dynamics","volume":"54","year":"2021","journal-title":"Acc. Chem. Res."},{"key":"2024040910111673700_c26","doi-asserted-by":"publisher","first-page":"3305","DOI":"10.1021\/acs.chemrev.7b00423","article-title":"Ab initio nonadiabatic quantum molecular dynamics","volume":"118","year":"2018","journal-title":"Chem. Rev."},{"key":"2024040910111673700_c27","doi-asserted-by":"publisher","first-page":"604","DOI":"10.1002\/wcms.90","article-title":"Car-Parrinello molecular dynamics","volume":"2","year":"2012","journal-title":"Wiley Interdiscip. Rev.: Comput. Mol. Sci."},{"key":"2024040910111673700_c28","doi-asserted-by":"publisher","first-page":"074105","DOI":"10.1063\/1.3200904","article-title":"Nested Markov chain Monte Carlo sampling of a density functional theory potential: Equilibrium thermodynamics of dense fluid nitrogen","volume":"131","year":"2009","journal-title":"J. Chem. Phys."},{"key":"2024040910111673700_c29","unstructured":"See https:\/\/www.eyesopen.com\/orion for Orion, OpenEye Scientific; accessed 1 February 2024."},{"key":"2024040910111673700_c30","doi-asserted-by":"publisher","first-page":"W729","DOI":"10.1093\/nar\/gkl320","article-title":"Taverna: A tool for building and running workflows of services","volume":"34","year":"2006","journal-title":"Nucleic Acids Res."},{"key":"2024040910111673700_c31","doi-asserted-by":"publisher","first-page":"R86","DOI":"10.1186\/gb-2010-11-8-r86","article-title":"Galaxy: A comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences","volume":"11","year":"2010","journal-title":"Genome Biol."},{"key":"2024040910111673700_c32","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1038\/nbt.3820","article-title":"Nextflow enables reproducible computational workflows","volume":"35","year":"2017","journal-title":"Nat. Biotechnol."},{"key":"2024040910111673700_c33","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1016\/j.commatsci.2015.09.013","article-title":"AiiDA: Automated interactive infrastructure and database for computational science","volume":"111","year":"2016","journal-title":"Comput. Mater. Sci."},{"key":"2024040910111673700_c34","doi-asserted-by":"publisher","first-page":"3191","DOI":"10.1021\/acs.jcim.9b00384","article-title":"QMflows: A tool kit for interoperable parallel workflows in quantum chemistry","volume":"59","year":"2019","journal-title":"J. Chem. Inf. Model."},{"key":"2024040910111673700_c35","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1016\/j.commatsci.2012.02.005","article-title":"AFLOW: An automatic framework for high-throughput materials discovery","volume":"58","year":"2012","journal-title":"Comput. Mater. Sci."},{"key":"2024040910111673700_c36","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1016\/j.commatsci.2018.01.035","article-title":"Simple data and workflow management with the signac framework","volume":"146","year":"2018","journal-title":"Comput. Mater. Sci."},{"key":"2024040910111673700_c37","doi-asserted-by":"publisher","first-page":"5037","DOI":"10.1002\/cpe.3505","article-title":"FireWorks: A dynamic workflow system designed for high-throughput applications","volume":"27","year":"2015","journal-title":"Concurr. Comput.: Pract. Exper."},{"key":"2024040910111673700_c38","doi-asserted-by":"publisher","first-page":"e1006144","DOI":"10.1371\/journal.pcbi.1006144","article-title":"Cloud computing applications for biomedical science: A perspective","volume":"14","year":"2018","journal-title":"PLoS Comput. Biol."},{"key":"2024040910111673700_c39","doi-asserted-by":"publisher","first-page":"e1002147","DOI":"10.1371\/journal.pcbi.1002147","article-title":"Biomedical cloud computing with amazon web services","volume":"7","year":"2011","journal-title":"PLoS Comput. Biol."},{"key":"2024040910111673700_c40","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1186\/1471-2105-11-259","article-title":"Cloud computing for comparative genomics","volume":"11","year":"2010","journal-title":"BMC Bioinf."},{"key":"2024040910111673700_c41","doi-asserted-by":"publisher","first-page":"11779322211035921","DOI":"10.1177\/11779322211035921","article-title":"Cloud computing enabled big multi-omics data analytics","volume":"15","year":"2021","journal-title":"Bioinf. Biol. Insights"},{"key":"2024040910111673700_c42","doi-asserted-by":"publisher","first-page":"972","DOI":"10.1038\/nbt.2028","article-title":"Harnessing cloud computing with Galaxy cloud","volume":"29","year":"2011","journal-title":"Nat. Biotechnol."},{"key":"2024040910111673700_c43","doi-asserted-by":"publisher","first-page":"527","DOI":"10.4137\/ebo.s9946","article-title":"Cloud computing for comparative genomics with windows azure platform","volume":"8","year":"2012","journal-title":"Evol. Bioinf."},{"key":"2024040910111673700_c44","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1186\/gb-2010-11-5-207","article-title":"The case for cloud computing in genome informatics","volume":"11","year":"2010","journal-title":"Genome Biol."},{"key":"2024040910111673700_c45","doi-asserted-by":"publisher","first-page":"998","DOI":"10.1109\/tpds.2010.178","article-title":"Cloud technologies for bioinformatics applications","volume":"22","year":"2011","journal-title":"IEEE Trans. Parallel Distrub. Syst."},{"key":"2024040910111673700_c46","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1186\/1471-2105-13-42","article-title":"Cloud BioLinux: Pre-configured and on-demand bioinformatics computing for the genomics community","volume":"13","year":"2012","journal-title":"BMC Bioinf."},{"key":"2024040910111673700_c47","doi-asserted-by":"publisher","first-page":"1217","DOI":"10.2174\/138161212799436386","article-title":"From laptop to benchtop to bedside: Structure-based drug design on protein targets","volume":"18","year":"2012","journal-title":"Curr. Pharm. Des."},{"key":"2024040910111673700_c48","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1146\/annurev-physchem-061020-053438","article-title":"Interactive quantum chemistry enabled by machine learning, graphical processing units, and cloud computing","volume":"74","year":"2023","journal-title":"Annu. Rev. Phys. Chem."},{"key":"2024040910111673700_c49","doi-asserted-by":"publisher","first-page":"2126","DOI":"10.1021\/acs.jcim.9b01152","article-title":"TeraChem cloud: A high-performance computing service for scalable distributed GPU-accelerated electronic structure calculations","volume":"60","year":"2020","journal-title":"J. Chem. Inf. Model."},{"key":"2024040910111673700_c50","doi-asserted-by":"publisher","first-page":"926","DOI":"10.1002\/jcc.23882","article-title":"The performance of low-cost commercial cloud computing as an alternative in computational chemistry","volume":"36","year":"2015","journal-title":"J. Comput. Chem."},{"key":"2024040910111673700_c51","doi-asserted-by":"publisher","first-page":"623","DOI":"10.1146\/annurev.pc.45.100194.003203","article-title":"Ab initio molecular electronic structure on parallel computers","volume":"45","year":"1994","journal-title":"Annu. Rev. Phys. Chem."},{"key":"2024040910111673700_c52","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1002\/9780470125830.ch4","article-title":"High performance computing in computational chemistry: Methods and machines","volume":"6","year":"1995","journal-title":"Rev. Comput. Chem."},{"key":"2024040910111673700_c53","doi-asserted-by":"publisher","first-page":"490","DOI":"10.1016\/0009-2614(95)00654-m","article-title":"Pseudospectral correlation methods on distributed memory parallel architectures","volume":"241","year":"1995","journal-title":"Chem. Phys. Lett."},{"key":"2024040910111673700_c54","doi-asserted-by":"publisher","first-page":"2185","DOI":"10.1063\/1.452116","article-title":"Parallel algorithms for quantum chemistry. I. Integral transformations on a hypercube multiprocessor","volume":"86","year":"1987","journal-title":"J. Chem. Phys."},{"key":"2024040910111673700_c55","doi-asserted-by":"publisher","first-page":"5777","DOI":"10.1063\/1.455553","article-title":"A method for two-electron Gaussian integral and integral derivative evaluation using recurrence relations","volume":"89","year":"1988","journal-title":"J. Chem. Phys."},{"key":"2024040910111673700_c56","first-page":"63","article-title":"Chemical calculations on cray computers","volume-title":"Concurrent Computation in Chemical Calculations","author":"Wilson","year":"1989"},{"key":"2024040910111673700_c57","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1016\/s0010-4655(00)00062-x","article-title":"Multi-threading: A new dimension to massively parallel scientific computation","volume":"128","year":"2000","journal-title":"Comput. Phys. Commun."},{"key":"2024040910111673700_c58","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1016\/s0010-4655(00)00059-x","article-title":"Parallelization of SCF calculations within Q-Chem","volume":"128","year":"2000","journal-title":"Comput. Phys. Commun."},{"key":"2024040910111673700_c59","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1007\/bf01113269","article-title":"Parallel direct SCF for large-scale calculations","volume":"84","year":"1993","journal-title":"Theor. Chim. Acta"},{"key":"2024040910111673700_c60","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1007\/978-3-662-09638-3","article-title":"A parallel direct SCF method for large molecular systems","volume-title":"Quantum Mechanical Simulation Methods for Studying Biological Systems","author":"Bicout","year":"1996"},{"key":"2024040910111673700_c61","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1016\/j.parco.2008.01.009","article-title":"FPGA acceleration of a quantum Monte Carlo application","volume":"34","year":"2008","journal-title":"Parallel Comput."},{"key":"2024040910111673700_c62","doi-asserted-by":"publisher","first-page":"1230","DOI":"10.1021\/ct8001046","article-title":"Accelerating density functional calculations with graphics processing unit","volume":"4","year":"2008","journal-title":"J. Chem. Theory Comput."},{"key":"2024040910111673700_c63","doi-asserted-by":"publisher","first-page":"2049","DOI":"10.1021\/jp0776762","article-title":"Accelerating resolution-of-the-identity second-order M\u00f8ller\u2013Plesset quantum chemistry calculations with graphical processing units","volume":"112","year":"2008","journal-title":"J. Phys. Chem. A"},{"key":"2024040910111673700_c64","doi-asserted-by":"publisher","first-page":"222","DOI":"10.1021\/ct700268q","article-title":"Quantum chemistry on graphical processing units. 1. Strategies for two-electron integral evaluation","volume":"4","year":"2008","journal-title":"J. Chem. Theory Comput."},{"key":"2024040910111673700_c65","doi-asserted-by":"publisher","first-page":"1004","DOI":"10.1021\/ct800526s","article-title":"Quantum chemistry on graphical processing units. 2. Direct self-consistent-field implementation","volume":"5","year":"2009","journal-title":"J. Chem. Theory Comput."},{"key":"2024040910111673700_c66","doi-asserted-by":"publisher","first-page":"2619","DOI":"10.1021\/ct9003004","article-title":"Quantum chemistry on graphical processing units. 3. Analytical energy gradients, geometry optimization, and first principles molecular dynamics","volume":"5","year":"2009","journal-title":"J. Chem. Theory Comput."},{"key":"2024040910111673700_c67","doi-asserted-by":"publisher","first-page":"e1494","DOI":"10.1002\/wcms.1494","article-title":"TeraChem: A graphical processing unit-accelerated electronic structure package for large-scale ab\u00a0initio molecular dynamics","volume":"11","year":"2021","journal-title":"Wiley Interdiscip. Rev.: Comput. Mol. Sci."},{"key":"2024040910111673700_c68","first-page":"989","article-title":"Analysis of the basic implementation aspects of hardware-accelerated density functional theory calculations","volume":"29","year":"2010","journal-title":"Comput. Inform."},{"key":"2024040910111673700_c69","doi-asserted-by":"publisher","first-page":"3955","DOI":"10.1021\/acs.jctc.1c00145","article-title":"Harnessing the power of multi-GPU acceleration into the quantum interaction computational kernel program","volume":"17","year":"2021","journal-title":"J. Chem. Theory Comput."},{"key":"2024040910111673700_c70","doi-asserted-by":"publisher","first-page":"7486","DOI":"10.1021\/acs.jctc.1c00720","article-title":"Faster self-consistent field (SCF) calculations on GPU clusters","volume":"17","year":"2021","journal-title":"J. Chem. Theory Comput."},{"key":"2024040910111673700_c71","doi-asserted-by":"publisher","first-page":"4557","DOI":"10.1021\/acs.jpca.0c02249","article-title":"Novel computer architectures and quantum chemistry","volume":"124","year":"2020","journal-title":"J. Phys. Chem. A"},{"key":"2024040910111673700_c72","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1007\/bf01113281","article-title":"Network supercomputing: A distributed-concurrent direct SCF scheme","volume":"84","year":"1993","journal-title":"Theor. Chim. Acta"},{"key":"2024040910111673700_c73","doi-asserted-by":"publisher","first-page":"6896","DOI":"10.1039\/c002859b","article-title":"Utilizing high performance computing for chemistry: Parallel computational chemistry","volume":"12","year":"2010","journal-title":"Phys. Chem. Chem. Phys."},{"key":"2024040910111673700_c74","doi-asserted-by":"publisher","first-page":"1789","DOI":"10.1021\/jz200697c","article-title":"Charge transfer and polarization in solvated proteins from ab\u00a0initio molecular dynamics","volume":"2","year":"2011","journal-title":"J. Phys. Chem. Lett."},{"key":"2024040910111673700_c75","doi-asserted-by":"publisher","first-page":"14924","DOI":"10.1039\/c7cp00492c","article-title":"Atomistic non-adiabatic dynamics of the LH2 complex with a GPU-accelerated ab\u00a0initio exciton model","volume":"19","year":"2017","journal-title":"Phys. Chem. Chem. Phys."},{"key":"2024040910111673700_c76","doi-asserted-by":"publisher","first-page":"9","DOI":"10.7790\/ajtde.v2n3.47","article-title":"The digital universe: Rich data and the increasing value of the internet of things","volume":"2","year":"2014","journal-title":"Austr. J. Telecommun. Digital Econ."},{"key":"2024040910111673700_c77","first-page":"29","article-title":"The Google file system","year":"2003"},{"key":"2024040910111673700_c78","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1145\/1327452.1327492","article-title":"MapReduce: Simplified data processing on large clusters","volume":"51","year":"2008","journal-title":"Commun. ACM"},{"key":"2024040910111673700_c79","first-page":"1","article-title":"The Hadoop distributed file system","year":"2010"},{"key":"2024040910111673700_c80","year":"2015"},{"key":"2024040910111673700_c81","unstructured":"See https:\/\/aws.amazon.com\/ for Amazon Web Services (AWS)\u2014Cloud Computing Services; accessed 20 September 2023."},{"key":"2024040910111673700_c82","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1145\/1773912.1773922","article-title":"Cassandra: A decentralized structured storage system","volume":"44","year":"2010","journal-title":"ACM SIGOPS Oper. Syst. Rev."},{"key":"2024040910111673700_c83","first-page":"1","article-title":"Horizontal scalability towards server performance improvement","year":"2017"},{"key":"2024040910111673700_c84","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1145\/2898442.2898444","article-title":"Borg, Omega, and Kubernetes: Lessons learned from three container-management systems over a decade","volume":"14","year":"2016","journal-title":"Queue"},{"key":"2024040910111673700_c85","doi-asserted-by":"publisher","first-page":"e0177459","DOI":"10.1371\/journal.pone.0177459","article-title":"Singularity: Scientific containers for mobility of compute","volume":"12","year":"2017","journal-title":"PLoS One"},{"key":"2024040910111673700_c86","volume-title":"Redis in Action","year":"2013"},{"key":"2024040910111673700_c87","first-page":"879","article-title":"Evaluation of highly available and fault-tolerant middleware clustered architectures using RabbitMQ","year":"2014"},{"key":"2024040910111673700_c88","unstructured":"See https:\/\/www.rabbitmq.com\/ for RabbitMQ\u2014Messaging that just works; accessed 20 September 2023."},{"key":"2024040910111673700_c89","unstructured":"See https:\/\/github.com\/celery\/celery for Celery: A Distributed Task Queue; accessed 20 September 2023."},{"key":"2024040910111673700_c90","first-page":"9478","article-title":"Apache Kafka: Next generation distributed messaging system","volume":"3","year":"2014","journal-title":"Int. J. Sci. Eng. Technol. Res."},{"key":"2024040910111673700_c91","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1145\/2934664","article-title":"Apache spark: A unified engine for big data processing","volume":"59","year":"2016","journal-title":"Commun. ACM"},{"key":"2024040910111673700_c92","doi-asserted-by":"publisher","first-page":"330","DOI":"10.14778\/1920841.1920886","article-title":"Dremel: Interactive analysis of web-scale datasets","volume":"3","year":"2010","journal-title":"Proc. VLDB Endow."},{"key":"2024040910111673700_c93","first-page":"135","article-title":"Pregel: A system for large-scale graph processing","year":"2010"},{"key":"2024040910111673700_c94","doi-asserted-by":"publisher","first-page":"9","DOI":"10.14445\/22312803\/ijctt-v19p103","article-title":"Big data analysis: Apache storm perspective","volume":"19","year":"2015","journal-title":"Int. J. Comput. Trends Technol."},{"key":"2024040910111673700_c95","first-page":"9","article-title":"Impala: A modern, open-source SQL engine for Hadoop","year":"2015"},{"key":"2024040910111673700_c96","first-page":"1773","article-title":"Apache hive: From mapreduce to enterprise-grade big data warehousing","year":"2019"},{"key":"2024040910111673700_c97","volume-title":"MongoDB: the Definitive Guide: Powerful and Scalable Data Storage","year":"2013"},{"key":"2024040910111673700_c98","year":"2021"},{"key":"2024040910111673700_c99","unstructured":"See https:\/\/www.docker.com\/ for Docker: Accelerated, containerized application development."},{"key":"2024040910111673700_c100","first-page":"1","article-title":"Building a virtual system of systems using Docker swarm in multiple clouds","year":"2016"},{"key":"2024040910111673700_c101","volume-title":"Highly Parallel Computing","year":"1989"},{"key":"2024040910111673700_c102","first-page":"483","article-title":"Validity of the single processor approach to achieving large scale computing capabilities","year":"1967"},{"key":"2024040910111673700_c103","doi-asserted-by":"publisher","first-page":"532","DOI":"10.1145\/42411.42415","article-title":"Reevaluating Amdahl\u2019s law","volume":"31","year":"1988","journal-title":"Commun. ACM"},{"key":"2024040910111673700_c104","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1109\/mc.2008.209","article-title":"Amdahl\u2019s law in the multicore era","volume":"41","year":"2008","journal-title":"Computer"},{"key":"2024040910111673700_c105","doi-asserted-by":"publisher","first-page":"1477","DOI":"10.1016\/j.cpc.2010.04.018","article-title":"NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations","volume":"181","year":"2010","journal-title":"Comput. Phys. Commun."},{"key":"2024040910111673700_c106","doi-asserted-by":"publisher","first-page":"1586","DOI":"10.1021\/acs.jctc.9b01165","article-title":"Efficient treatment of large active spaces through multi-GPU parallel implementation of direct configuration interaction","volume":"16","year":"2020","journal-title":"J. Chem. Theory Comput."},{"key":"2024040910111673700_c107","volume-title":"Distributed Systems","year":"2017","edition":"3"},{"key":"2024040910111673700_c108","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1145\/230798.230809","article-title":"Middleware: A model for distributed system services","volume":"39","year":"1996","journal-title":"Commun. ACM"},{"key":"2024040910111673700_c109","doi-asserted-by":"crossref","unstructured":"M.\n            Jones\n          , J.Bradley, and N.Sakimura, \u201cJSON web token (JWT),\u201d Internet Engineering Task Force: RFC 7519; 2015. https:\/\/datatracker.ietf.org\/doc\/html\/rfc7519; accessed November 1, 2023.","DOI":"10.17487\/RFC7519"},{"key":"2024040910111673700_c110"},{"key":"2024040910111673700_c111","unstructured":"See https:\/\/www.docker.com\/ for Docker: Accelerated, Containerized Application Development; accessed November 1, 2023."},{"key":"2024040910111673700_c112","doi-asserted-by":"crossref","unstructured":"D.\n            Hardt\n          , \u201cThe OAuth 2.0 Authorization Framework,\u201d Internet Engineering Task Force: RFC 6749, 2012, https:\/\/datatracker.ietf.org\/doc\/html\/rfc6749; accessed November 1, 2023.","DOI":"10.17487\/rfc6749"},{"key":"2024040910111673700_c113","unstructured":"See https:\/\/docs.docker.com\/engine\/swarm\/ for Docker Swarm\u2014Distributed application deployment."},{"key":"2024040910111673700_c114","unstructured":"See https:\/\/dockerswarm.rocks\/ for Dockerswarm.rocks\u2014An overview of Docker Swarm; accessed 20 September 2023."},{"key":"2024040910111673700_c115","unstructured":"See https:\/\/kubernetes.io\/ for Kubernetes\u2014An open-source system for aumating deployment, scaling and management of containerized applications; accessed 20 September 2023."},{"key":"2024040910111673700_c116","unstructured":"See https:\/\/redis.io\/ for Redis Labs | The Home of Redis; accessed 20 September 2023."},{"key":"2024040910111673700_c117","doi-asserted-by":"publisher","first-page":"214108","DOI":"10.1063\/5.0004837","article-title":"Coupled-cluster techniques for computational chemistry: The CFOUR program package","volume":"152","year":"2020","journal-title":"J. Chem. Phys."},{"key":"2024040910111673700_c118","first-page":"1167","article-title":"Advances in electronic structure theory: GAMESS a decade later","volume-title":"Theory and Applications of Computational Chemistry","author":"Dykstra","year":"2005"},{"key":"2024040910111673700_c119","doi-asserted-by":"publisher","first-page":"184102","DOI":"10.1063\/5.0004997","article-title":"NWChem: Past, present, and future","volume":"152","year":"2020","journal-title":"J. Chem. Phys."},{"key":"2024040910111673700_c120","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1002\/wcms.1162","article-title":"Turbomole","volume":"4","year":"2014","journal-title":"Wiley Interdiscip. Rev.: Comput. Mol. Sci."},{"key":"2024040910111673700_c121","doi-asserted-by":"publisher","first-page":"e1462","DOI":"10.1002\/wcms.1462","article-title":"adcc: A versatile toolkit for rapid development of algebraic-diagrammatic construction methods","volume":"10","year":"2020","journal-title":"Wiley Interdiscip. Rev.: Comput. Mol. Sci."},{"key":"2024040910111673700_c122","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1002\/wcms.82","article-title":"Molpro: A general-purpose quantum chemistry program package","volume":"2","year":"2012","journal-title":"Wiley Interdiscip. Rev.: Comput. Mol. Sci."},{"key":"2024040910111673700_c123","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/bf00128336","article-title":"MOPAC: A semiempirical molecular orbital program,","volume":"4","year":"1990","journal-title":"J. Comput. Aid. Mol. Des."},{"key":"2024040910111673700_c124","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1021\/ct300857j","article-title":"OpenMM 4: A reusable, extensible, hardware independent library for high performance molecular simulation","volume":"9","year":"2013","journal-title":"J. Chem. Theory Comput."},{"key":"2024040910111673700_c125","doi-asserted-by":"publisher","first-page":"184108","DOI":"10.1063\/5.0006002","article-title":"PSI4 1.4: Open-source software for high-throughput quantum chemistry","volume":"152","year":"2020","journal-title":"J. Chem. Phys."},{"key":"2024040910111673700_c126","article-title":"RDKit: A software suite for cheminformatics, computational chemistry, and predictive modeling","year":"2013"},{"key":"2024040910111673700_c127","doi-asserted-by":"publisher","first-page":"084801","DOI":"10.1063\/5.0055522","article-title":"Software for the frontiers of quantum chemistry: An overview of developments in the Q-Chem 5 package","volume":"155","year":"2021","journal-title":"J. Chem. Phys."},{"key":"2024040910111673700_c128","doi-asserted-by":"publisher","first-page":"3408","DOI":"10.1021\/acs.jcim.0c00451","article-title":"TorchANI: A free and open source PyTorch-based deep learning implementation of the ANI neural network potentials","volume":"60","year":"2020","journal-title":"J. Chem. Inf. Model."},{"key":"2024040910111673700_c129"},{"key":"2024040910111673700_c130","unstructured":"See https:\/\/github.com\/jhrmnn\/pyberny for PyBerny; accessed November 1, 2023."},{"key":"2024040910111673700_c131"},{"key":"2024040910111673700_c132","unstructured":"See https:\/\/github.com\/coltonbh\/qcop for QCOperate: A package for operating Quantum Chemistry programs using qcio standardized data structures; accessed 20 September 2023."},{"key":"2024040910111673700_c133","unstructured":"E.\n            Rescorla\n           and T.Dierks, \u201cThe transport layer security (TLS) protocol version 1.3,\u201d Internet Engineering Task Force: RFC 8446; August, 2018. https:\/\/www.rfc-editor.org\/rfc\/rfc8446; accessed 1 November 2023."},{"key":"2024040910111673700_c134","unstructured":"See https:\/\/traefik.io\/ for Traefik Labs: Makes Networking Boring; accessed 20 September 2023."},{"key":"2024040910111673700_c135","unstructured":"See https:\/\/github.com\/mtzgroup\/traefik-reverse-proxy for Martinez Group Traefik Configuration; accessed 20 September 2023."},{"key":"2024040910111673700_c136","unstructured":"See https:\/\/spec.openapis.org\/oas\/latest.html for OpenAPI Specification; accessed 20 September 2023."},{"key":"2024040910111673700_c137","unstructured":"See https:\/\/fastapi.tiangolo.com\/ for FastAPI is a modern, fast (high-performance), web framework for building APIs with Python 3.6+ based on standard Python type hints; accessed 07 March 2023."},{"key":"2024040910111673700_c138","unstructured":"See https:\/\/www.techempower.com\/benchmarks\/#section=data-r21&hw=ph&test=query&l=zijzen-7 for Web Framework Benchmarks; accessed 07 March 2023."},{"key":"2024040910111673700_c139","unstructured":"See https:\/\/peps.python.org\/pep-0483\/ for PEP 483\u2014The theory of type hints; accessed 16 August 2022."},{"key":"2024040910111673700_c140","unstructured":"See https:\/\/peps.python.org\/pep-0484\/ for PEP 484\u2014Type hints; accessed 16 August 2022."},{"key":"2024040910111673700_c141","unstructured":"See https:\/\/www.openapis.org\/ for Home\u2014OpenAPI initiative."},{"key":"2024040910111673700_c142","unstructured":"See https:\/\/json-schema.org\/ for JSON Schema; accessed 20 September 2023."},{"key":"2024040910111673700_c143","unstructured":"See https:\/\/docs.pydantic.dev\/ for Pydanic\u2014Data validation and settings management using python type annotations; accessed 20 September 2023."},{"key":"2024040910111673700_c144","unstructured":"See https:\/\/openapi-generator.tech\/ for Hello from OpenAPI generator; accessed 20 September 2023."},{"key":"2024040910111673700_c145","unstructured":"See https:\/\/docs.python.org\/3\/library\/asyncio.html for asyncio\u2014Asynchronous I\/O; accessed 20 September 2023."},{"key":"2024040910111673700_c146","unstructured":"See https:\/\/auth0.com\/ for Auth0: Secure access for everyone. But not just anyone; accessed 20 September 2023."},{"key":"2024040910111673700_c147","doi-asserted-by":"crossref","unstructured":"M.\n            Jones\n          , B.Campbell, and C.Mortimore, \u201cJSON web token (JWT) profile for OAuth 2.0 client authentication and authorization grants,\u201d Internet Engineering Task Force: RFC 7523, 2015. https:\/\/datatracker.ietf.org\/doc\/html\/rfc7523; accessed 27 July 2021.","DOI":"10.17487\/RFC7523"},{"key":"2024040910111673700_c148","unstructured":"See https:\/\/jwt.io\/ for JWT.io.; accessed 06 March 2023."},{"key":"2024040910111673700_c149","unstructured":"See https:\/\/molssi.github.io\/QCFractal\/ for QCFractal; accessed 03 March 2024."},{"key":"2024040910111673700_c150","doi-asserted-by":"publisher","first-page":"140022","DOI":"10.1038\/sdata.2014.22","article-title":"Quantum chemistry structures and properties of 134 kilo molecules","volume":"1","year":"2014","journal-title":"Sci. Data"}],"container-title":["The Journal of Chemical Physics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/aip\/jcp\/article-pdf\/doi\/10.1063\/5.0190834\/19873570\/142501_1_5.0190834.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/aip\/jcp\/article-pdf\/doi\/10.1063\/5.0190834\/19873570\/142501_1_5.0190834.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,9]],"date-time":"2024-04-09T06:14:23Z","timestamp":1712643263000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/jcp\/article\/160\/14\/142501\/3282029\/Massively-scalable-workflows-for-quantum-chemistry"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,9]]},"references-count":150,"journal-issue":{"issue":"14","published-print":{"date-parts":[[2024,4,14]]}},"URL":"https:\/\/doi.org\/10.1063\/5.0190834","relation":{"has-preprint":[{"id-type":"doi","id":"10.26434\/chemrxiv-2023-bn0jv-v2","asserted-by":"object"},{"id-type":"doi","id":"10.26434\/chemrxiv-2023-bn0jv","asserted-by":"object"}]},"ISSN":["0021-9606","1089-7690"],"issn-type":[{"value":"0021-9606","type":"print"},{"value":"1089-7690","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,4,14]]},"published":{"date-parts":[[2024,4,9]]},"article-number":"142501"}}