{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T05:13:06Z","timestamp":1772169186500,"version":"3.50.1"},"update-to":[{"DOI":"10.12688\/wellcomeopenres.23491.1","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T00:00:00Z","timestamp":1764633600000}}],"reference-count":30,"publisher":"F1000 Research Ltd","license":[{"start":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T00:00:00Z","timestamp":1764633600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["220526"],"award-info":[{"award-number":["220526"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"name":"World Class Labs scheme","award":["EP\/T022221\/1"],"award-info":[{"award-number":["EP\/T022221\/1"]}]},{"name":"Digital Research Infrastructure programme","award":["EP\/W032244\/1"],"award-info":[{"award-number":["EP\/W032244\/1"]}]}],"content-domain":{"domain":["wellcomeopenresearch.org"],"crossmark-restriction":false},"short-container-title":["Wellcome Open Res"],"abstract":"<ns3:p>Despite significant investment in High-Performance Computing (HPC) clusters by funding councils, there are still many researchers whose workflows could not benefit from the computation speed that is provided by these clusters. Reducing barriers to entry for these researchers would accelerate their scientific throughput, since they will be able to respond to results in a timely fashion, improving either their protocols or correcting any problems that might have arisen. This improves the quality of science, and therefore the return on investment, in computationally-intensive areas such as Cryogenic Electron Microscopy (cryo-EM). This paper outlines a technique, FlowCron, for users to analyse their data on a HPC facility with reduced training, increasing accessibility. FlowCron transfers the responsibilities of installation and upkeep of data processing pipelines from users to HPC project PIs and\/or HPC project managers, simplifies the set up of HPC pipelines, and makes pipelines as reliable as possible once set up. The work described here has software dependencies that are common to the majority of HPC clusters. We achieve this by linking Globus and cron to produce an open-source system that requires little administrative support but provides a very easy way of running an analysis on a HPC system. The user starts the analysis through the Globus website and, when started, the data will be encrypted, uploaded to the HPC, analysed, and returned to the originating machine, along with a record of the analysis. For Globus to transfer any data to and from the HPC, appropriate user authentication is required, thus ensuring that only authorised users can send data in the HPC.<\/ns3:p>","DOI":"10.12688\/wellcomeopenres.23491.2","type":"journal-article","created":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T04:10:07Z","timestamp":1764648607000},"page":"4","update-policy":"https:\/\/doi.org\/10.12688\/wellcomeopenres.crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["FlowCron - Increasing access to HPC by wrapping Globus into a function-as-a-service"],"prefix":"10.12688","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8015-3191","authenticated-orcid":false,"given":"Dimitrios","family":"Bellos","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Allsopp","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8697-4903","authenticated-orcid":false,"given":"Elaine M. L.","family":"Ho","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tibor","family":"Auer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-8940-5627","authenticated-orcid":false,"given":"Gavin","family":"Yearwood","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew J.","family":"Morris","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8438-1415","authenticated-orcid":false,"given":"Mark","family":"Basham","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"2560","published-online":{"date-parts":[[2025,12,2]]},"reference":[{"key":"ref-1","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3789755","article-title":"Strategies for democratization of supercomputing: availability, accessibility and usability of high performance computing for education and practice of big data analytics.","author":"J Samuel","year":"2021","journal-title":"CoRR."},{"key":"ref-2","doi-asserted-by":"publisher","first-page":"622","DOI":"10.21105\/joss.00622","article-title":"Open ondemand:  a web-based client portal for HPC centers.","volume":"3","author":"D Hudak","year":"2018","journal-title":"J Open Source Softw."},{"key":"ref-3","doi-asserted-by":"publisher","first-page":"87-90","DOI":"10.3233\/978-1-61499-649-1-87","article-title":"Jupyter notebooks \u2013 a publishing format for reproducible computational workflows","author":"T Kluyver","year":"2016"},{"key":"ref-4","doi-asserted-by":"publisher","first-page":"676-682","DOI":"10.1038\/nmeth.2019","article-title":"Fiji: an open-source platform for biological-image analysis.","volume":"9","author":"J Schindelin","year":"2012","journal-title":"Nat Methods."},{"key":"ref-5","doi-asserted-by":"publisher","first-page":"519-530","DOI":"10.1016\/j.jsb.2012.09.006","article-title":"RELION: implementation of a Bayesian approach to cryo-EM structure determination.","volume":"180","author":"S Scheres","year":"2012","journal-title":"J Struct Biol."},{"key":"ref-6","doi-asserted-by":"publisher","first-page":"70-73","DOI":"10.1109\/MIC.2011.64","article-title":"Globus online: accelerating and democratizing science through cloud-based services.","volume":"15","author":"I Foster","year":"2011"},{"key":"ref-7","doi-asserted-by":"publisher","first-page":"81-88","DOI":"10.1145\/2076450.2076468","article-title":"Software as a service for data scientists.","volume":"55","author":"B Allen","year":"2012","journal-title":"Commun ACM."},{"key":"ref-8","doi-asserted-by":"publisher","first-page":"1-8","DOI":"10.1145\/2949550.2949554","article-title":"Globus: recent enhancements and future plans.","author":"K Chard","year":"2016"},{"key":"ref-9","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1109\/SC.2005.72","article-title":"The Globus striped GridFTP framework and server","author":"W Allcock","year":"2005"},{"key":"ref-10","doi-asserted-by":"publisher","first-page":"191-198","DOI":"10.1016\/j.future.2018.05.051","article-title":"Transferring a petabyte in a day.","volume":"88","author":"R Kettimuthu","year":"2018","journal-title":"Future Gener Comput Syst."},{"key":"ref-11","doi-asserted-by":"publisher","article-title":"Automated, reliable, and efficient continental-scale replication of 7.3 petabytes of climate simulation data: a case study","author":"L Lacinski","DOI":"10.48550\/arXiv.2404.19717"},{"key":"ref-12","doi-asserted-by":"publisher","first-page":"658-670","DOI":"10.1177\/10943420241281744","article-title":"Globus service enhancements for exascale applications and facilities.","volume":"38","author":"W Zheng","year":"2024","journal-title":"Int J High Perform Comput Appl."},{"key":"ref-13","doi-asserted-by":"publisher","first-page":"4275-4282","DOI":"10.1109\/BigData62323.2024.10825634","article-title":"Model and Data Management for Machine Learning (M2ML): integrating instruments, edge and HPC for accelerated machine learning.","author":"W Zheng","year":"2024"},{"key":"ref-14","doi-asserted-by":"publisher","first-page":"393-409","DOI":"10.1016\/j.future.2023.01.010","article-title":"Globus automation services: research process automation across the space\u2013time continuum.","volume":"142","author":"R Chard","year":"2023","journal-title":"Future Gener Comput Syst."},{"key":"ref-15","article-title":"SLURM: Simple Linux Utility for Resource Management","author":"M Jette","year":"2002"},{"key":"ref-16","article-title":"FlowCron-Globus_Flow-side","author":"J Allsopp"},{"key":"ref-17","article-title":"FlowCron-HPC-side","author":"J Allsopp"},{"key":"ref-18","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-023-36372-9","article-title":"Plasma FIB milling for the determination of structures in situ.","volume":"14","author":"C Berger","year":"2023","journal-title":"Nat Commun."},{"key":"ref-19","doi-asserted-by":"publisher","first-page":"331-332","DOI":"10.1038\/nmeth.4193","article-title":"Motioncor2: anisotropic correction of beam-induced motion for improved cryo-electron microscopy.","volume":"14","author":"S Zheng","year":"2017","journal-title":"Nat Methods."},{"key":"ref-20","doi-asserted-by":"publisher","first-page":"216-221","DOI":"10.1016\/j.jsb.2015.08.008","article-title":"CTFFIND4: fast and accurate defocus estimation from electron micrographs.","volume":"192","author":"A Rohou","year":"2015","journal-title":"J Struct Biol."},{"key":"ref-21","doi-asserted-by":"publisher","DOI":"10.1016\/j.yjsbx.2022.100068","article-title":"AreTomo: an integrated software package for automated marker-free, motion-corrected cryo-electron tomographic alignment and reconstruction.","volume":"6","author":"S Zheng","year":"2022","journal-title":"J Struct Biol X."},{"key":"ref-22","article-title":"Personal communication","author":"G Mason-Williams","year":"2024"},{"key":"ref-23","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.03080","article-title":"Cryo-EM structure of the Plasmodium falciparum 80S ribosome bound to the anti-protozoan drug emetine.","volume":"3","author":"W Wong","year":"2014","journal-title":"eLife."},{"key":"ref-24","doi-asserted-by":"publisher","first-page":"D1503-D1511","DOI":"10.1093\/nar\/gkac1062","article-title":"EMPIAR: the Electron Microscopy Public Image Archive.","volume":"51","author":"A Iudin","year":"2023","journal-title":"Nucleic Acids Res."},{"key":"ref-25","doi-asserted-by":"publisher","first-page":"D456-D465","DOI":"10.1093\/nar\/gkad1019","article-title":"EMDB\u2014the Electron Microscopy Data Bank.","volume":"52","year":"2024","journal-title":"Nucleic Acids Res."},{"key":"ref-26","doi-asserted-by":"publisher","first-page":"235-242","DOI":"10.1093\/nar\/28.1.235","article-title":"The Protein Data Bank.","volume":"28","author":"H Berman","year":"2000","journal-title":"Nucleic Acids Res."},{"key":"ref-27","article-title":"Cryo-electron tomography on plasma FIB lamellae of HeLa cells","author":"C Berger","year":"2023"},{"key":"ref-28","article-title":"Personal communication","author":"S Branford","year":"2024"},{"key":"ref-29","article-title":"Personal communication","author":"W Ball","year":"2024"},{"key":"ref-30","article-title":"Personal communication","author":"L Shemilt","year":"2024"}],"container-title":["Wellcome Open Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/wellcomeopenresearch.org\/articles\/10-4\/v2\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/wellcomeopenresearch.org\/articles\/10-4\/v2\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/wellcomeopenresearch.org\/articles\/10-4\/v2\/iparadigms","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T04:10:09Z","timestamp":1764648609000},"score":1,"resource":{"primary":{"URL":"https:\/\/wellcomeopenresearch.org\/articles\/10-4\/v2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,2]]},"references-count":30,"URL":"https:\/\/doi.org\/10.12688\/wellcomeopenres.23491.2","relation":{"has-version":[{"id-type":"doi","id":"10.12688\/wellcomeopenres.23491.1","asserted-by":"subject"}],"has-review":[{"id-type":"doi","id":"10.21956\/wellcomeopenres.28112.r141309","asserted-by":"object"}]},"ISSN":["2398-502X"],"issn-type":[{"value":"2398-502X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,2]]},"assertion":[{"value":"Indexed","URL":"https:\/\/wellcomeopenresearch.org\/articles\/10-4\/v2#article-reports","order":0,"name":"referee-status","label":"Referee status","group":{"name":"current-referee-status","label":"Current Referee Status"}},{"value":"10.21956\/wellcomeopenres.25911.r117247, Weijian Zheng, Argonne National Laboratory, Lemont, 29 Jan 2025, version 1, indexed","URL":"https:\/\/wellcomeopenresearch.org\/articles\/10-4\/v1#referee-response-117247","order":0,"name":"referee-response-117247","label":"Referee Report","group":{"name":"article-reports","label":"Article Reports"}},{"value":"10.21956\/wellcomeopenres.25911.r118528, Rick Wagner, San Diego Supercomputer Center, University of California San Diego, San Diego, 05 Mar 2025, version 1, indexed","URL":"https:\/\/wellcomeopenresearch.org\/articles\/10-4\/v1#referee-response-118528","order":1,"name":"referee-response-118528","label":"Referee Report","group":{"name":"article-reports","label":"Article Reports"}},{"value":"10.21956\/wellcomeopenres.25911.r118529, Christopher Woods, University of Bristol, Bristol, England, 06 Mar 2025, version 1, indexed","URL":"https:\/\/wellcomeopenresearch.org\/articles\/10-4\/v1#referee-response-118529","order":2,"name":"referee-response-118529","label":"Referee Report","group":{"name":"article-reports","label":"Article Reports"}},{"value":"This work was supported by Wellcome [220526]; World Class Labs scheme [EP\/T022221\/1]; Digital Research Infrastructure programme [EP\/W032244\/1]. The computations described in this research were performed using the Baskerville Tier 2 HPC service (https:\/\/www.baskerville.ac.uk\/). Baskerville was funded by the EPSRC and UKRI through the World Class Labs scheme\r\n(EP\/T022221\/1) and the Digital Research Infrastructure programme (EP\/W032244\/1) and is operated by Advanced Research Computing at the University of Birmingham. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.","order":3,"name":"grant-information","label":"Grant Information"},{"value":"This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.","order":0,"name":"copyright-info","label":"Copyright"}]}}