{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T20:45:11Z","timestamp":1783716311227,"version":"3.55.0"},"reference-count":50,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2023,11,3]],"date-time":"2023-11-03T00:00:00Z","timestamp":1698969600000},"content-version":"vor","delay-in-days":2,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Accurate prediction of change in protein stability due to point mutations is an attractive goal that remains unachieved. Despite the high interest in this area, little consideration has been given to the transformer architecture, which is dominant in many fields of machine learning.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>In this work, we introduce PROSTATA, a predictive model built in a knowledge-transfer fashion on a new curated dataset. PROSTATA demonstrates advantage over existing solutions based on neural networks. We show that the large improvement margin is due to both the architecture of the model and the quality of the new training dataset. This work opens up opportunities to develop new lightweight and accurate models for protein stability assessment.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>PROSTATA is available at https:\/\/github.com\/AIRI-Institute\/PROSTATA and https:\/\/prostata.airi.net.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btad671","type":"journal-article","created":{"date-parts":[[2023,11,8]],"date-time":"2023-11-08T01:01:06Z","timestamp":1699405266000},"source":"Crossref","is-referenced-by-count":36,"title":["PROSTATA: a framework for protein stability assessment using transformers"],"prefix":"10.1093","volume":"39","author":[{"given":"Dmitriy","family":"Umerenkov","sequence":"first","affiliation":[{"name":"Sber AI Lab , Moscow 105064, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fedor","family":"Nikolaev","sequence":"additional","affiliation":[{"name":"Bioinformatics Group, AIRI , Moscow 121170, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tatiana I","family":"Shashkova","sequence":"additional","affiliation":[{"name":"Bioinformatics Group, AIRI , Moscow 121170, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pavel V","family":"Strashnov","sequence":"additional","affiliation":[{"name":"Bioinformatics Group, AIRI , Moscow 121170, Russia"},{"name":"Department of Computer Design and Technology, Bauman Moscow State Technical University , Moscow 105005, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria","family":"Sindeeva","sequence":"additional","affiliation":[{"name":"Bioinformatics Group, AIRI , Moscow 121170, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrey","family":"Shevtsov","sequence":"additional","affiliation":[{"name":"Bioinformatics Group, AIRI , Moscow 121170, Russia"},{"name":"Regulatory Transcriptomics and Epigenomics Group, Institute of Bioengineering, Research Center of Biotechnology RAS , Moscow 117036, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0333-8117","authenticated-orcid":false,"given":"Nikita V","family":"Ivanisenko","sequence":"additional","affiliation":[{"name":"Bioinformatics Group, AIRI , Moscow 121170, Russia"},{"name":"Laboratory of Computational Proteomics, Institute of Cytology and Genetics SB RAS , Novosibirsk 630090, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olga L","family":"Kardymon","sequence":"additional","affiliation":[{"name":"Bioinformatics Group, AIRI , Moscow 121170, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,11,3]]},"reference":[{"key":"2023111603070122500_btad671-B1","doi-asserted-by":"crossref","first-page":"3031","DOI":"10.1021\/acs.jctc.7b00125","article-title":"The Rosetta all-atom energy function for macromolecular modeling and design","volume":"13","author":"Alford","year":"2017","journal-title":"J Chem Theory Comput"},{"key":"2023111603070122500_btad671-B2","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1002\/jcc.26810","article-title":"Data set and fitting dependencies when estimating protein mutant stability: toward simple, balanced, and interpretable models","volume":"43","author":"B\u00e6k","year":"2022","journal-title":"J Comput Chem"},{"key":"2023111603070122500_btad671-B3","doi-asserted-by":"crossref","first-page":"245403","DOI":"10.1088\/1361-6463\/abedfb","article-title":"An antisymmetric neural network to predict free energy changes in protein variants","volume":"54","author":"Benevenuta","year":"2021","journal-title":"J Phys D: Appl Phys"},{"key":"2023111603070122500_btad671-B4","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1038\/s42256-023-00639-z","article-title":"Regression transformer enables concurrent sequence regression and generation for molecular language modelling","volume":"5","author":"Born","year":"2023","journal-title":"Nat Mach Intell"},{"key":"2023111603070122500_btad671-B5","doi-asserted-by":"crossref","first-page":"1981","DOI":"10.1021\/acs.jcim.1c00201","article-title":"Three simple properties explain protein stability change upon mutation","volume":"61","author":"Caldararu","year":"2021","journal-title":"J Chem Inf Model"},{"key":"2023111603070122500_btad671-B6","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1186\/1471-2105-10-421","article-title":"BLAST+: architecture and applications","volume":"10","author":"Camacho","year":"2009","journal-title":"BMC Bioinformatics"},{"key":"2023111603070122500_btad671-B7","doi-asserted-by":"crossref","first-page":"1508","DOI":"10.1021\/acs.jcim.8b00697","article-title":"DeepDDG: predicting the stability change of protein point mutations using neural networks","volume":"59","author":"Cao","year":"2019","journal-title":"J Chem Inf Model"},{"key":"2023111603070122500_btad671-B8","doi-asserted-by":"crossref","first-page":"e1008543","DOI":"10.1371\/journal.pcbi.1008543","article-title":"PremPS: predicting the impact of missense mutations on protein stability","volume":"16","author":"Chen","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"2023111603070122500_btad671-B9","doi-asserted-by":"crossref","first-page":"2499","DOI":"10.1093\/bioinformatics\/bty140","article-title":"iFeature: a python package and web server for features extraction and selection from protein and peptide sequences","volume":"34","author":"Chen","year":"2018","journal-title":"Bioinformatics"},{"key":"2023111603070122500_btad671-B10","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1186\/1471-2105-12-151","article-title":"PoPMuSiC 2.1: a web server for the estimation of protein stability changes upon mutation and sequence optimality","volume":"12","author":"Dehouck","year":"2011","journal-title":"BMC Bioinformatics"},{"key":"2023111603070122500_btad671-B11","volume-title":"Bert: pre-training of deep bidirectional transformers for language understanding","author":"Devlin","year":"2018"},{"key":"2023111603070122500_btad671-B12","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1093\/bib\/bbz071","article-title":"A critical review of five machine learning-based algorithms for predicting protein stability changes upon mutation","volume":"21","author":"Fang","year":"2020","journal-title":"Brief Bioinform"},{"key":"2023111603070122500_btad671-B13","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1016\/j.cels.2022.01.003","article-title":"Evolutionary velocity with protein language models predicts evolutionary dynamics of diverse proteins","volume":"13","author":"Hie","year":"2022","journal-title":"Cell Syst"},{"key":"2023111603070122500_btad671-B14","doi-asserted-by":"crossref","first-page":"6235","DOI":"10.1021\/acs.iecr.1c04943","article-title":"Recent advances in machine learning variant effect prediction tools for protein engineering","volume":"61","author":"Horne","year":"2022","journal-title":"Ind Eng Chem Res"},{"key":"2023111603070122500_btad671-B15","doi-asserted-by":"crossref","first-page":"4270","DOI":"10.1021\/acs.jcim.2c00799","article-title":"PROST: AlphaFold2-aware sequence-based predictor to estimate protein stability changes upon missense mutations","volume":"62","author":"Iqbal","year":"2022","journal-title":"J Chem Inf Model"},{"key":"2023111603070122500_btad671-B16","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","article-title":"Highly accurate protein structure prediction with AlphaFold","volume":"596","author":"Jumper","year":"2021","journal-title":"Nature"},{"key":"2023111603070122500_btad671-B17","doi-asserted-by":"crossref","first-page":"7444","DOI":"10.3390\/ijms24087444","article-title":"DeepSTABp: a deep learning approach for the prediction of thermal protein stability","volume":"24","author":"Jung","year":"2023","journal-title":"Int J Mol Sci"},{"key":"2023111603070122500_btad671-B18","doi-asserted-by":"crossref","first-page":"2577","DOI":"10.1002\/bip.360221211","article-title":"Dictionary of protein secondary structure: pattern recognition of hydrogen-bonded and geometrical features","volume":"22","author":"Kabsch","year":"1983","journal-title":"Biopolymers"},{"key":"2023111603070122500_btad671-B19","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1002\/prot.22921","article-title":"Role of conformational sampling in computing mutation-induced changes in protein structure and stability","volume":"79","author":"Kellogg","year":"2011","journal-title":"Proteins"},{"key":"2023111603070122500_btad671-B20","doi-asserted-by":"crossref","first-page":"1414","DOI":"10.1093\/bioinformatics\/btv769","article-title":"MAESTROweb: a web server for structure-based protein stability prediction","volume":"32","author":"Laimer","year":"2016","journal-title":"Bioinformatics"},{"key":"2023111603070122500_btad671-B21","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1038\/s41592-020-0848-2","article-title":"Macromolecular modeling and design in Rosetta: recent methods and frameworks","volume":"17","author":"Leman","year":"2020","journal-title":"Nat Methods"},{"key":"2023111603070122500_btad671-B22","doi-asserted-by":"crossref","first-page":"e1008291","DOI":"10.1371\/journal.pcbi.1008291","article-title":"Predicting changes in protein thermodynamic stability upon point mutation with deep 3D convolutional neural networks","volume":"16","author":"Li","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"2023111603070122500_btad671-B23","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1126\/science.ade2574","article-title":"Evolutionary-scale prediction of atomic-level protein structure with a language model","volume":"379","author":"Lin","year":"2023","journal-title":"Science"},{"key":"2023111603070122500_btad671-B24","doi-asserted-by":"crossref","first-page":"2388","DOI":"10.1021\/acs.jcim.0c00064","article-title":"Accurately predicting mutation-caused stability changes from protein sequences using extreme gradient boosting","volume":"60","author":"Lv","year":"2020","journal-title":"J Chem Inf Model"},{"key":"2023111603070122500_btad671-B25","doi-asserted-by":"crossref","first-page":"D170","DOI":"10.1093\/nar\/gkw1081","article-title":"Uniclust databases of clustered and deeply annotated protein sequences and alignments","volume":"45","author":"Mirdita","year":"2017","journal-title":"Nucleic Acids Res"},{"key":"2023111603070122500_btad671-B26","doi-asserted-by":"crossref","first-page":"W222","DOI":"10.1093\/nar\/gkac325","article-title":"DDGun: an untrained predictor of protein stability changes upon amino acid variants","volume":"50","author":"Montanucci","year":"2022","journal-title":"Nucleic Acids Res"},{"key":"2023111603070122500_btad671-B27","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1002\/humu.22204","article-title":"VariBench: a benchmark database for variations","volume":"34","author":"Nair","year":"2013","journal-title":"Hum Mutat"},{"key":"2023111603070122500_btad671-B28","doi-asserted-by":"crossref","first-page":"D420","DOI":"10.1093\/nar\/gkaa1035","article-title":"ProThermDB: thermodynamic database for proteins and mutants revisited after 15 years","volume":"49","author":"Nikam","year":"2021","journal-title":"Nucleic Acids Res"},{"key":"2023111603070122500_btad671-B29","doi-asserted-by":"crossref","first-page":"4312","DOI":"10.1093\/bioinformatics\/btac515","article-title":"Best templates outperform homology models in predicting the impact of mutations on protein stability","volume":"38","author":"Pak","year":"2022","journal-title":"Bioinformatics"},{"key":"2023111603070122500_btad671-B30","author":"Pak","year":"2023"},{"key":"2023111603070122500_btad671-B31","doi-asserted-by":"crossref","first-page":"bbab555","DOI":"10.1093\/bib\/bbab555","article-title":"Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset","volume":"23","author":"Pancotti","year":"2022","journal-title":"Brief Bioinform"},{"key":"2023111603070122500_btad671-B32","doi-asserted-by":"crossref","first-page":"911","DOI":"10.3390\/genes12060911","article-title":"A deep-learning sequence-based method to predict protein stability changes upon genetic variations","volume":"12","author":"Pancotti","year":"2021","journal-title":"Genes (Basel)"},{"key":"2023111603070122500_btad671-B33","doi-asserted-by":"crossref","first-page":"W229","DOI":"10.1093\/nar\/gkx439","article-title":"SDM: a server for predicting effects of mutations on protein stability","volume":"45","author":"Pandurangan","year":"2017","journal-title":"Nucleic Acids Res"},{"key":"2023111603070122500_btad671-B34","doi-asserted-by":"crossref","first-page":"W314","DOI":"10.1093\/nar\/gku411","article-title":"DUET: a server for predicting effects of mutations on protein stability using an integrated computational approach","volume":"42","author":"Pires","year":"2014","journal-title":"Nucleic Acids Res"},{"key":"2023111603070122500_btad671-B35","doi-asserted-by":"crossref","first-page":"3659","DOI":"10.1093\/bioinformatics\/bty348","article-title":"Quantification of biases in predictions of protein stability changes upon mutations","volume":"34","author":"Pucci","year":"2018","journal-title":"Bioinformatics"},{"key":"2023111603070122500_btad671-B36","doi-asserted-by":"crossref","first-page":"2936","DOI":"10.1093\/bioinformatics\/btw361","article-title":"STRUM: structure-based prediction of protein stability changes upon single-point mutation","volume":"32","author":"Quan","year":"2016","journal-title":"Bioinformatics"},{"key":"2023111603070122500_btad671-B37","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1038\/nmeth.1818","article-title":"HHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment","volume":"9","author":"Remmert","year":"2011","journal-title":"Nat Methods"},{"key":"2023111603070122500_btad671-B38","doi-asserted-by":"crossref","first-page":"W350","DOI":"10.1093\/nar\/gky300","article-title":"DynaMut: predicting the impact of mutations on protein conformation, flexibility and stability","volume":"46","author":"Rodrigues","year":"2018","journal-title":"Nucleic Acids Res"},{"key":"2023111603070122500_btad671-B39","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1002\/pro.3942","article-title":"DynaMut2: assessing changes in stability and flexibility upon single and multiple point missense mutations","volume":"30","author":"Rodrigues","year":"2021","journal-title":"Protein Sci"},{"key":"2023111603070122500_btad671-B40","doi-asserted-by":"crossref","first-page":"10657","DOI":"10.1021\/acs.jpcb.1c04913","article-title":"SCONES: self-consistent neural network for protein stability prediction upon mutation","volume":"125","author":"Samaga","year":"2021","journal-title":"J Phys Chem B"},{"key":"2023111603070122500_btad671-B41","doi-asserted-by":"crossref","first-page":"2542","DOI":"10.1093\/bioinformatics\/btw192","article-title":"INPS-MD: a web server to predict stability of protein variants from sequence and structure","volume":"32","author":"Savojardo","year":"2016","journal-title":"Bioinformatics"},{"key":"2023111603070122500_btad671-B42","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1093\/bib\/bbz168","article-title":"On the critical review of five machine learning-based algorithms for predicting protein stability changes upon mutation","volume":"22","author":"Savojardo","year":"2021","journal-title":"Brief Bioinform"},{"key":"2023111603070122500_btad671-B43","doi-asserted-by":"crossref","first-page":"960985","DOI":"10.3389\/fimmu.2022.960985","article-title":"SEMA: antigen B-cell conformational epitope prediction using deep transfer learning","volume":"13","author":"Shashkova","year":"2022","journal-title":"Front Immunol"},{"key":"2023111603070122500_btad671-B44","doi-asserted-by":"crossref","first-page":"926","DOI":"10.1093\/bioinformatics\/btu739","article-title":"UniRef clusters: a comprehensive and scalable alternative for improving sequence similarity searches","volume":"31","author":"Suzek","year":"2015","journal-title":"Bioinformatics"},{"key":"2023111603070122500_btad671-B45","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1038\/s41586-023-06328-6","article-title":"Mega-scale experimental analysis of protein folding stability in biology and design","volume":"620","author":"Tsuboyama","year":"2023","journal-title":"Nature"},{"key":"2023111603070122500_btad671-B46","author":"Vaswani","year":"2017"},{"key":"2023111603070122500_btad671-B47","doi-asserted-by":"crossref","first-page":"e4467","DOI":"10.1002\/pro.4467","article-title":"BayeStab: predicting effects of mutations on protein stability with uncertainty quantification","volume":"31","author":"Wang","year":"2022","journal-title":"Protein Sci"},{"key":"2023111603070122500_btad671-B48","doi-asserted-by":"crossref","first-page":"107952","DOI":"10.1016\/j.compbiolchem.2023.107952","article-title":"ProS-GNN: predicting effects of mutations on protein stability using graph neural networks","volume":"107","author":"Wang","year":"2023","journal-title":"Comput Biol Chem"},{"key":"2023111603070122500_btad671-B49","doi-asserted-by":"crossref","first-page":"W215","DOI":"10.1093\/nar\/gkr363","article-title":"SDM\u2014a server for predicting effects of mutations on protein stability and malfunction","volume":"39","author":"Worth","year":"2011","journal-title":"Nucleic Acids Res"},{"key":"2023111603070122500_btad671-B50","doi-asserted-by":"crossref","first-page":"W122","DOI":"10.1093\/nar\/gkad472","article-title":"DDMut: predicting effects of mutations on protein stability using deep learning","volume":"51","author":"Zhou","year":"2023","journal-title":"Nucleic Acids Res"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btad671\/52812023\/btad671.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/39\/11\/btad671\/53453466\/btad671.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/39\/11\/btad671\/53453466\/btad671.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,16]],"date-time":"2023-11-16T03:07:31Z","timestamp":1700104051000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/doi\/10.1093\/bioinformatics\/btad671\/7342240"}},"subtitle":[],"editor":[{"given":"Lenore","family":"Cowen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2023,11,1]]},"references-count":50,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2023,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btad671","relation":{},"ISSN":["1367-4811"],"issn-type":[{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,11,1]]},"published":{"date-parts":[[2023,11,1]]},"article-number":"btad671"}}