{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T04:05:14Z","timestamp":1784001914910,"version":"3.55.0"},"reference-count":43,"publisher":"The Royal Society","issue":"2321","license":[{"start":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T00:00:00Z","timestamp":1779926400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T00:00:00Z","timestamp":1779926400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000893","name":"Simons Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000893","id-type":"DOI","asserted-by":"publisher"}]},{"name":"NSF"},{"name":"NIH"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,5,28]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Data science is a pillar of artificial intelligence (AI), which is transforming nearly every domain of human activity, from the social and physical sciences to engineering and medicine. While data-driven findings in AI offer unprecedented power to extract insights and guide decision-making, many are difficult or impossible to replicate. A key reason for this challenge is the uncertainty introduced by the many choices made throughout the data science life cycle (DSLC). Traditional statistical frameworks often fail to account for this uncertainty. The Predictability\u2013Computability\u2013Stability (PCS) framework for veridical (truthful) data science (VDS) offers a principled approach to addressing this challenge throughout the DSLC. This paper presents an updated and streamlined PCS workflow, tailored for practitioners and enhanced with guided use of generative AI (GenAI). We include a running example to display the PCS framework in action and conduct a related case study that showcases the uncertainty in downstream predictions caused by judgement calls in the data cleaning stage.<\/jats:p>\n                  <jats:p>This article is part of the theme issue \u2018Statistical workflow\u2019.<\/jats:p>","DOI":"10.1098\/rsta.2024.0605","type":"journal-article","created":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T13:24:08Z","timestamp":1779974648000},"source":"Crossref","is-referenced-by-count":1,"title":["Predictability\u2013Computability\u2013Stability workflow for veridical data science in the age of artificial intelligence"],"prefix":"10.1098","volume":"384","author":[{"given":"Zachary T.","family":"Rewolinski","sequence":"first","affiliation":[{"name":"UC Berkeley 1 , , ,","place":["Berkeley, CA, USA"],"department":["Department of Statistics"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8888-4060","authenticated-orcid":false,"given":"Bin","family":"Yu","sequence":"additional","affiliation":[{"name":"UC Berkeley 1 , , ,","place":["Berkeley, CA, USA"],"department":["Department of Statistics"]},{"name":"UC Berkeley 2 , ,","place":["Berkeley, CA, USA"],"department":["Department of Electrical Engineering and Computer Sciences"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"175","published-online":{"date-parts":[[2026,5,28]]},"reference":[{"key":"2026052809240143500_R1","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1080\/01621459.1976.10480949","article-title":"Science and statistics","volume":"71","author":"Box","year":"1976","journal-title":"J. Am. Stat. Assoc."},{"key":"2026052809240143500_R2","doi-asserted-by":"crossref","DOI":"10.1016\/j.jeconom.2023.105519","article-title":"What is uncertainty in today\u2019s practice of data science?","volume":"237","author":"Yu","year":"2023","journal-title":"J. Econom."},{"key":"2026052809240143500_R3","doi-asserted-by":"crossref","DOI":"10.1186\/s12915-024-02101-x","article-title":"Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology","volume":"23","author":"Gould","year":"2025","journal-title":"BMC Biol."},{"key":"2026052809240143500_R4","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.2203150119","article-title":"Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty","volume":"119","author":"Breznau","year":"2022","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2026052809240143500_R5","doi-asserted-by":"crossref","first-page":"1484","DOI":"10.3150\/13-BEJSP14","article-title":"Stability","volume":"19","author":"Yu","year":"2013","journal-title":"Bernoulli"},{"key":"2026052809240143500_R6","doi-asserted-by":"crossref","first-page":"3920","DOI":"10.1073\/pnas.1901326117","article-title":"Veridical data science","volume":"117","author":"Yu","year":"2020","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2026052809240143500_R7","volume-title":"Veridical data science: the practice of responsible data analysis and decision making","author":"Yu","year":"2024"},{"key":"2026052809240143500_R8","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1038\/nrd3439-c1","article-title":"Believe it or not: how much can we rely on published data on potential drug targets?","volume":"10","author":"Prinz","year":"2011","journal-title":"Nat. Rev. Drug Discov."},{"key":"2026052809240143500_R9","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1038\/483531a","article-title":"Raise standards for preclinical cancer research","volume":"483","author":"Begley","year":"2012","journal-title":"Nature"},{"key":"2026052809240143500_R10","doi-asserted-by":"crossref","first-page":"S135","DOI":"10.1111\/insr.12427","article-title":"Stable discovery of interpretable subgroups via calibration in causal studies","volume":"88","author":"Dwivedi","year":"2020","journal-title":"Int. Statistical Rev."},{"key":"2026052809240143500_R11","article-title":"Epistasis regulates genetic control of cardiac hypertrophy","author":"Wang","year":"2024","journal-title":"medRxiv."},{"key":"2026052809240143500_R12","doi-asserted-by":"crossref","DOI":"10.1177\/18758592241308755","article-title":"A simplified MyProstateScore2.0 for high-grade prostate cancer","volume":"42","author":"Tang","year":"2025","journal-title":"Cancer Biomark."},{"key":"2026052809240143500_R13","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1214\/ss\/1009213726","article-title":"Statistical modeling: the two cultures","volume":"16","author":"Breiman","year":"2001","journal-title":"Stat. Sci."},{"key":"2026052809240143500_R14","unstructured":"Tang\n              T\n            , KenneyAM. 2023vdocs: beautiful documentation for PCS-style analyses. R package version 0.0.0.9000. Seehttps:\/\/github.com\/Yu-Group\/vdocs."},{"key":"2026052809240143500_R15","article-title":"Designing a data science simulation with merits: a primer","author":"Elliott","year":"2024","journal-title":"arXiv Preprint arXiv:2403.08971."},{"key":"2026052809240143500_R16","doi-asserted-by":"crossref","DOI":"10.21105\/joss.06156","article-title":"simChef: high-quality data science simulations in R","volume":"9","author":"Duncan","year":"2024","journal-title":"J. Open Source Softw."},{"key":"2026052809240143500_R17","unstructured":"Agarwal\n              A\n            , XiaoM, BarterR, RonenO, FanB, YuB. 2025Pcs-uq: uncertainty quantification via the predictability-computability-stability framework. Seehttps:\/\/arxiv.org\/abs\/2505.08784."},{"key":"2026052809240143500_R18","doi-asserted-by":"crossref","first-page":"1943","DOI":"10.1073\/pnas.1711236115","article-title":"Iterative random forests to discover predictive and stable high-order interactions","volume":"115","author":"Basu","year":"2018","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2026052809240143500_R19","first-page":"1","article-title":"A survey on hallucination in large language models: principles, taxonomy, challenges, and open questions","volume":"43","author":"Huang","year":"2025","journal-title":"ACM Trans. Inf. Syst."},{"key":"2026052809240143500_R20","unstructured":"Chiang\n              WL\n            \n            et al\n          . 2024Chatbot arena: an open platform for evaluating LLMs by human preference. InProceedings of the 41st International Conference on Machine Learning. Vienna, Austria: JMLR. (doi:10.5555\/3692070.3692401)"},{"key":"2026052809240143500_R21","volume-title":"Traumatic brain injury in the United States: emergency department visits, hospitalizations, and deaths","author":"Langlois","year":"2006"},{"key":"2026052809240143500_R22","volume-title":"Traumatic brain injury in the united states: emergency department visits, hospitalizations, and deaths, 2002-2006","author":"Faul","year":"2010"},{"key":"2026052809240143500_R23","doi-asserted-by":"crossref","first-page":"1281","DOI":"10.1016\/S0196-0644(05)81065-0","article-title":"Magnetic resonance imaging in minor head injury","volume":"20","author":"Doezema","year":"1991","journal-title":"Ann. Emerg. Med."},{"key":"2026052809240143500_R24","doi-asserted-by":"crossref","first-page":"710","DOI":"10.1001\/jamainternmed.2025.0505","article-title":"Projected lifetime cancer risks from current computed tomography imaging","volume":"185","author":"Smith-Bindman","year":"2025","journal-title":"JAMA Intern. Med."},{"key":"2026052809240143500_R25","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1016\/S0140-6736(09)61558-0","article-title":"Identification of children at very low risk of clinically-important brain injuries after head trauma: a prospective cohort study","volume":"374","author":"Kuppermann","year":"2009","journal-title":"Lancet"},{"key":"2026052809240143500_R26","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1037\/h0071325","article-title":"Analysis of a complex of statistical variables into principal components","volume":"24","author":"Hotelling","year":"1933","journal-title":"J. Educ. Psychol."},{"key":"2026052809240143500_R27","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1080\/01621459.1963.10500845","article-title":"Hierarchical grouping to optimize an objective function","volume":"58","author":"Ward","year":"1963","journal-title":"J. Am. Stat. Assoc."},{"key":"2026052809240143500_R28","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","article-title":"Least squares quantization in PCM","volume":"28","author":"Lloyd","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"key":"2026052809240143500_R29","unstructured":"MacQueen\n              J\n            \n          . 1967Some methods for classification and analysis of multivariate observations. InProc. Fifth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Statistics, vol. 5, pp. 281\u2013298, University of California Press."},{"key":"2026052809240143500_R30","first-page":"2579","article-title":"Visualizing data using t-sne","volume":"9","author":"van der Maaten","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"2026052809240143500_R31","first-page":"547","article-title":"Etude de la distribution florale dans une portion des alpes et du jura","volume":"37","author":"Jaccard","year":"1901","journal-title":"Bull. De La Soc. Vaudoise Des Sci. Nat."},{"key":"2026052809240143500_R32","first-page":"6","article-title":"A stability based method for discovering structure in clustered data","volume":"7","author":"Ben-Hur","year":"2002","journal-title":"Pac. Symp. Biocomput"},{"key":"2026052809240143500_R33","unstructured":"Rudin\n              C\n            \n            et al\n          . 2024Position: amazing things come from having many good models. InProc. 41st Int. Conf. Machine Learning. Vienna, Austria: ICML\u201924. JMLR.org."},{"key":"2026052809240143500_R34","unstructured":"Chang\n              W\n            \n            et al\n          . 2024shiny: Web Application Framework for R. R package version 1.8.1.1. Seehttps:\/\/CRAN.R-project.org\/package=shiny."},{"key":"2026052809240143500_R35","article-title":"The garden of forking paths: why multiple comparisons can be a problem, even when there is no \u2018fishing expedition\u2019 or \u2018p-hacking\u2019 and the research hypothesis was posited ahead of time.","author":"Gelman","year":"2013"},{"key":"2026052809240143500_R36","doi-asserted-by":"crossref","DOI":"10.21105\/joss.03895","article-title":"VeridicalFlow: a Python package for building trustworthy data science pipelines with PCS","volume":"7","author":"Duncan","year":"2022","journal-title":"J. Open Source Softw."},{"key":"2026052809240143500_R37","unstructured":"Sun\n              J\n            , LiG, ZhouP, MaY, XuJ, LiY. 2025Agenticdata: an agentic data analytics system for heterogeneous data. Seehttps:\/\/arxiv.org\/abs\/2508.05002."},{"key":"2026052809240143500_R38","unstructured":"Fine\n              J\n            , KollaM, SoloduchoI. 2025Data science agent in colab: the future of data analysis with gemini. Seehttps:\/\/developers.googleblog.com\/en\/data-science-agent-in-colab-with-gemini\/."},{"key":"2026052809240143500_R39","doi-asserted-by":"crossref","first-page":"13936","DOI":"10.18653\/v1\/2024.findings-emnlp.815","volume-title":"Findings of the association for computational linguistics: EMNLP 2024","author":"Gu","year":"2024"},{"key":"2026052809240143500_R40","unstructured":"Majumder\n              BP\n            \n            et al\n          . 2025Discoverybench: towards data-driven discovery with large language models. InThe Thirteenth Int. Conf. Learning Representations."},{"key":"2026052809240143500_R41","doi-asserted-by":"crossref","first-page":"1378","DOI":"10.1001\/jama.2024.0268","article-title":"Modernizing the data infrastructure for clinical research to meet evolving demands for evidence","volume":"332","author":"Franklin","year":"2024","journal-title":"JAMA"},{"key":"2026052809240143500_R42","article-title":"Yu-Group\/pcs-workflow: PCS Workflow (v1.0.0). Zenodo.","author":"Rewolinski","year":"2025"},{"key":"2026052809240143500_R43","article-title":"Supplementary material from: Predictability\u2013Computability\u2013Stability workflow for veridical data science in the age of artificial intelligence. Figshare.","author":"Rewolinski","year":"2026"}],"container-title":["Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/royalsocietypublishing.org\/rsta\/article-pdf\/doi\/10.1098\/rsta.2024.0605\/6141788\/rsta.2024.0605.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/royalsocietypublishing.org\/rsta\/article-pdf\/doi\/10.1098\/rsta.2024.0605\/6141788\/rsta.2024.0605.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T13:24:17Z","timestamp":1779974657000},"score":1,"resource":{"primary":{"URL":"https:\/\/royalsocietypublishing.org\/rsta\/article\/384\/2321\/20240605\/481951\/Predictability-Computability-Stability-workflow"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,28]]},"references-count":43,"journal-issue":{"issue":"2321","published-online":{"date-parts":[[2026,5,28]]},"published-print":{"date-parts":[[2026,5,28]]}},"URL":"https:\/\/doi.org\/10.1098\/rsta.2024.0605","relation":{},"ISSN":["1364-503X","1471-2962"],"issn-type":[{"value":"1364-503X","type":"print"},{"value":"1471-2962","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,28]]},"article-number":"20240605"}}