{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T19:21:22Z","timestamp":1770492082822,"version":"3.49.0"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2022,1,11]],"date-time":"2022-01-11T00:00:00Z","timestamp":1641859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,3,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Predicting the difference in thermodynamic stability between protein variants is crucial for protein design and understanding the genotype-phenotype relationships. So far, several computational tools have been created to address this task. Nevertheless, most of them have been trained or optimized on the same and \u2018all\u2019 available data, making a fair comparison unfeasible. Here, we introduce a novel dataset, collected and manually cleaned from the latest version of the ThermoMutDB database, consisting of 669 variants not included in the most widely used training datasets. The prediction performance and the ability to satisfy the antisymmetry property by considering both direct and reverse variants were evaluated across 21 different tools. The Pearson correlations of the tested tools were in the ranges of 0.21\u20130.5 and 0\u20130.45 for the direct and reverse variants, respectively. When both direct and reverse variants are considered, the antisymmetric methods perform better achieving a Pearson correlation in the range of 0.51\u20130.62. The tested methods seem relatively insensitive to the physiological conditions, performing well also on the variants measured with more extreme pH and temperature values. A common issue with all the tested methods is the compression of the $\\Delta \\Delta G$ predictions toward zero. Furthermore, the thermodynamic stability of the most significantly stabilizing variants was found to be more challenging to predict. This study is the most extensive comparisons of prediction methods using an entirely novel set of variants never tested before.<\/jats:p>","DOI":"10.1093\/bib\/bbab555","type":"journal-article","created":{"date-parts":[[2021,12,6]],"date-time":"2021-12-06T12:09:44Z","timestamp":1638792584000},"source":"Crossref","is-referenced-by-count":133,"title":["Predicting protein stability changes upon single-point mutation: a thorough comparison of the available tools on a new dataset"],"prefix":"10.1093","volume":"23","author":[{"given":"Corrado","family":"Pancotti","sequence":"first","affiliation":[{"name":"Department of Medical Sciences, University of Torino, Via Santena 19, 10126 Torino, Italy"}]},{"given":"Silvia","family":"Benevenuta","sequence":"additional","affiliation":[{"name":"Department of Medical Sciences, University of Torino, Via Santena 19, 10126 Torino, Italy"}]},{"given":"Giovanni","family":"Birolo","sequence":"additional","affiliation":[{"name":"Department of Medical Sciences, University of Torino, Via Santena 19, 10126 Torino, Italy"}]},{"given":"Virginia","family":"Alberini","sequence":"additional","affiliation":[{"name":"Department of Medical Sciences, University of Torino, Via Santena 19, 10126 Torino, Italy"}]},{"given":"Valeria","family":"Repetto","sequence":"additional","affiliation":[{"name":"Department of Medical Sciences, University of Torino, Via Santena 19, 10126 Torino, Italy"}]},{"given":"Tiziana","family":"Sanavia","sequence":"additional","affiliation":[{"name":"Department of Medical Sciences, University of Torino, Via Santena 19, 10126 Torino, Italy"}]},{"given":"Emidio","family":"Capriotti","sequence":"additional","affiliation":[{"name":"Department of Pharmacy and Biotechnology (FaBiT), University of Bologna, Bologna, Italy"}]},{"given":"Piero","family":"Fariselli","sequence":"additional","affiliation":[{"name":"Department of Medical Sciences, University of Torino, Via Santena 19, 10126 Torino, Italy"}]}],"member":"286","published-online":{"date-parts":[[2022,1,11]]},"reference":[{"issue":"9","key":"2022031506255331000_ref1","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1093\/protein\/gzp030","article-title":"Assessing computational methods for predicting protein stability upon mutation: good on average but not in the details","volume":"22","author":"Potapov","year":"2009","journal-title":"Protein Eng Des Sel"},{"key":"2022031506255331000_ref2","doi-asserted-by":"crossref","first-page":"1968","DOI":"10.1016\/j.csbj.2020.07.011","article-title":"Limitations and challenges in protein stability prediction upon genome variations: towards future applications in precision medicine","volume":"18","author":"Sanavia","year":"2020","journal-title":"Comput Struct Biotechnol J"},{"issue":"3","key":"2022031506255331000_ref3","doi-asserted-by":"crossref","DOI":"10.1093\/bib\/bbaa074","article-title":"Predicting the stability of mutant proteins by computational approaches: an overview","volume":"22","author":"Marabotti","year":"2021","journal-title":"Brief Bioinform"},{"issue":"1","key":"2022031506255331000_ref4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12859-021-04030-w","article-title":"A base measure of precision for protein stability predictors: structural sensitivity","volume":"22","author":"Caldararu","year":"2021","journal-title":"BMC bioinformatics"},{"issue":"6","key":"2022031506255331000_ref5","doi-asserted-by":"crossref","DOI":"10.1093\/bib\/bbab184","article-title":"Assessing the performance of computational predictors for estimating protein stability changes upon missense mutations","volume":"22","author":"Iqbal","year":"2021","journal-title":"Brief Bioinform"},{"key":"2022031506255331000_ref6","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1146\/annurev-biochem-061516-044518","article-title":"Protein misfolding diseases","volume":"86","author":"Ulrich","year":"2017","journal-title":"Annu Rev Biochem"},{"issue":"2","key":"2022031506255331000_ref7","first-page":"239","article-title":"Large scale analysis of protein stability in omim disease related human protein variants","volume":"17","author":"Martelli","year":"2016","journal-title":"BMC Genomics"},{"issue":"7","key":"2022031506255331000_ref8","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1000135","article-title":"Prediction by graph theoretic measures of structural effects in proteins arising from non-synonymous single nucleotide polymorphisms","volume":"4","author":"Cheng","year":"2008","journal-title":"PLoS Comput Biol"},{"issue":"48","key":"2022031506255331000_ref9","doi-asserted-by":"crossref","first-page":"8601","DOI":"10.1021\/bi4001529","article-title":"Computational and theoretical methods for protein folding","volume":"52","author":"Compiani","year":"2013","journal-title":"Biochemistry"},{"issue":"1","key":"2022031506255331000_ref10","doi-asserted-by":"crossref","first-page":"19264","DOI":"10.1038\/s41598-021-98547-y","article-title":"Pathogenic genetic variants from highly connected cancer susceptibility genes confer the loss of structural stability","volume":"11","author":"Reza","year":"2021","journal-title":"Sci Rep"},{"issue":"2","key":"2022031506255331000_ref11","doi-asserted-by":"crossref","first-page":"1442","DOI":"10.1093\/bib\/bbab042","article-title":"Functional alterations caused by mutations reflect evolutionary trends of SARS-CoV-2","volume":"22","author":"Cheng","year":"2021","journal-title":"Brief Bioinform"},{"issue":"9","key":"2022031506255331000_ref12","doi-asserted-by":"crossref","DOI":"10.3390\/ijms22094516","article-title":"In Silico analysis of the molecular-level impact of SMPD1 variants on Niemann-pick disease severity","volume":"22","author":"Ancien","year":"2021","journal-title":"Int J Mol Sci"},{"key":"2022031506255331000_ref13","doi-asserted-by":"crossref","first-page":"10","DOI":"10.3389\/fmolb.2021.620793","article-title":"Protein stability perturbation contributes to the loss of function in haploinsufficient genes","volume":"8","author":"Birolo","year":"2021","journal-title":"Front Mol Biosci"},{"key":"2022031506255331000_ref14","doi-asserted-by":"crossref","first-page":"19848","DOI":"10.1038\/srep19848","article-title":"In silico functional dissection of saturation mutagenesis: interpreting the relationship between phenotypes and changes in protein stability, interactions and activity","volume":"6","author":"Pires","year":"2016","journal-title":"Sci Rep"},{"issue":"14","key":"2022031506255331000_ref15","doi-asserted-by":"crossref","first-page":"1963","DOI":"10.1093\/bioinformatics\/btab034","article-title":"SWOTein: a structure-based approach to predict stability strengths and weaknesses of prOTEINs","volume":"37","author":"Hou","year":"2021","journal-title":"Bioinformatics"},{"issue":"4","key":"2022031506255331000_ref16","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1093\/bib\/bbz071","article-title":"A critical review of five machine learning-based algorithms for predicting protein stability changes upon mutation","volume":"21","author":"Fang","year":"2020","journal-title":"Brief Bioinform"},{"issue":"21","key":"2022031506255331000_ref17","doi-asserted-by":"crossref","first-page":"3653","DOI":"10.1093\/bioinformatics\/bty340","article-title":"Self-consistency test reveals systematic bias in programs for prediction change of stability upon mutation","volume":"34","author":"Usmanova","year":"2018","journal-title":"Bioinformatics"},{"issue":"21","key":"2022031506255331000_ref18","doi-asserted-by":"crossref","first-page":"3659","DOI":"10.1093\/bioinformatics\/bty348","article-title":"Quantification of biases in predictions of protein stability changes upon mutations","volume":"34","author":"Pucci","year":"2018","journal-title":"Bioinformatics"},{"issue":"14","key":"2022031506255331000_ref19","doi-asserted-by":"crossref","first-page":"2525","DOI":"10.1093\/bioinformatics\/bty979","article-title":"On the biases in predictions of protein stability changes upon variations: the INPS test case","volume":"35","author":"Montanucci","year":"2019","journal-title":"Bioinformatics"},{"issue":"2","key":"2022031506255331000_ref20","first-page":"1","article-title":"A three-state prediction of single point mutations on protein stability changes","volume":"9","author":"Capriotti","year":"2008","journal-title":"BMC bioinformatics"},{"issue":"1","key":"2022031506255331000_ref21","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1093\/bib\/bbz168","article-title":"On the critical review of five machine learning-based algorithms for predicting protein stability changes upon mutation","volume":"22","author":"Savojardo","year":"2021","journal-title":"Brief Bioinform"},{"issue":"Suppl 7","key":"2022031506255331000_ref22","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1186\/s12859-021-04238-w","article-title":"Performance of web tools for predicting changes in protein stability caused by mutations","volume":"22","author":"Marabotti","year":"2021","journal-title":"BMC Bioinformatics"},{"issue":"Database issue","key":"2022031506255331000_ref23","doi-asserted-by":"crossref","first-page":"D204","DOI":"10.1093\/nar\/gkj103","article-title":"ProTherm and ProNIT: thermodynamic databases for proteins and protein-nucleic acid interactions","volume":"34","author":"Kumar","year":"2006","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"2022031506255331000_ref24","doi-asserted-by":"crossref","first-page":"D420","DOI":"10.1093\/nar\/gkaa1035","article-title":"ProThermDB: thermodynamic database for proteins and mutants revisited after 15 years","volume":"49","author":"Nikam","year":"2021","journal-title":"Nucleic Acids Res"},{"issue":"D1","key":"2022031506255331000_ref25","doi-asserted-by":"crossref","first-page":"D475","DOI":"10.1093\/nar\/gkaa925","article-title":"ThermoMutDB: a thermodynamic database for missense mutations","volume":"49","author":"Xavier","year":"2021","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"2022031506255331000_ref26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1471-2105-12-151","article-title":"PoPMuSIC 2.1: a web server for the estimation of protein stability changes upon mutation and sequence optimality","volume":"12","author":"Dehouck","year":"2011","journal-title":"BMC bioinformatics"},{"issue":"1","key":"2022031506255331000_ref27","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1002\/humu.22204","article-title":"VariBench: a benchmark database for variations","volume":"34","author":"Sasidharan Nair","year":"2013","journal-title":"Hum Mutat"},{"issue":"W1","key":"2022031506255331000_ref28","doi-asserted-by":"crossref","first-page":"W147","DOI":"10.1093\/nar\/gkaa416","article-title":"mCSM-membrane: predicting the effects of mutations on transmembrane proteins","volume":"48","author":"Pires","year":"2020","journal-title":"Nucleic Acids Res"},{"issue":"11","key":"2022031506255331000_ref29","doi-asserted-by":"crossref","first-page":"166646","DOI":"10.1016\/j.jmb.2020.09.005","article-title":"MPTherm-pred: analysis and prediction of thermal stability changes upon mutations in transmembrane proteins","volume":"433","author":"Kulandaisamy","year":"2021","journal-title":"J Mol Biol"},{"issue":"10","key":"2022031506255331000_ref30","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1016\/j.str.2013.08.005","article-title":"High-resolution comparative modeling with rosettacm","volume":"21","author":"Song","year":"2013","journal-title":"Structure"},{"issue":"24","key":"2022031506255331000_ref31","doi-asserted-by":"crossref","DOI":"10.1088\/1361-6463\/abedfb","article-title":"An antisymmetric neural network to predict free energy changes in protein variants","volume":"54","author":"Benevenuta","year":"2021","journal-title":"J Phys D Appl Phys"},{"issue":"6","key":"2022031506255331000_ref32","first-page":"911","article-title":"A deep-learning sequence-based method to predict protein stability changes upon genetic variations","volume":"12","author":"Pancotti","year":"2021","journal-title":"Gen"},{"issue":"14","key":"2022031506255331000_ref33","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1186\/s12859-019-2923-1","article-title":"DDGun: an untrained method for the prediction of protein stability changes upon single and multiple point variations","volume":"20","author":"Montanucci","year":"2019","journal-title":"BMC bioinformatics"},{"issue":"2","key":"2022031506255331000_ref34","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1002\/prot.1075","article-title":"How to guarantee optimal stability for most representative structures in the protein data bank","volume":"44","author":"Bastolla","year":"2001","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"issue":"3","key":"2022031506255331000_ref35","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1093\/bioinformatics\/btt691","article-title":"mCSM: predicting the effects of mutations in proteins using graph-based signatures","volume":"30","author":"Pires","year":"2014","journal-title":"Bioinformatics"},{"issue":"suppl_2","key":"2022031506255331000_ref36","doi-asserted-by":"crossref","first-page":"W215","DOI":"10.1093\/nar\/gkr363","article-title":"Sdm-a server for predicting effects of mutations on protein stability and malfunction","volume":"39","author":"Worth","year":"2011","journal-title":"Nucleic Acids Res"},{"issue":"W1","key":"2022031506255331000_ref37","doi-asserted-by":"crossref","first-page":"W314","DOI":"10.1093\/nar\/gku411","article-title":"DUET: a server for predicting effects of mutations on protein stability using an integrated computational approach","volume":"42","author":"Pires","year":"2014","journal-title":"Nucleic Acids Res"},{"issue":"W1","key":"2022031506255331000_ref38","doi-asserted-by":"crossref","first-page":"W350","DOI":"10.1093\/nar\/gky300","article-title":"DynaMut: predicting the impact of mutations on protein conformation, flexibility and stability","volume":"46","author":"Rodrigues","year":"2018","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"2022031506255331000_ref39","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1002\/pro.3942","article-title":"DynaMut2: assessing changes in stability and flexibility upon single and multiple point missense mutations","volume":"30","author":"Rodrigues","year":"2021","journal-title":"Protein Sci"},{"issue":"suppl_2","key":"2022031506255331000_ref40","doi-asserted-by":"crossref","first-page":"W382","DOI":"10.1093\/nar\/gki387","article-title":"The FoldX web server: an online force field","volume":"33","author":"Schymkowitz","year":"2005","journal-title":"Nucleic Acids Res"},{"issue":"2","key":"2022031506255331000_ref41","doi-asserted-by":"crossref","first-page":"606","DOI":"10.3390\/ijms22020606","article-title":"SAAFEC-SEQ: a sequence-based method for predicting the effect of single point mutations on protein thermodynamic stability","volume":"22","author":"Li","year":"2021","journal-title":"Int J Mol Sci"},{"issue":"4","key":"2022031506255331000_ref42","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1002\/prot.20810","article-title":"Prediction of protein stability changes for single-site mutations using support vector machines","volume":"62","author":"Cheng","year":"2006","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"issue":"3","key":"2022031506255331000_ref43","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1002\/prot.22921","article-title":"Role of conformational sampling in computing mutation-induced changes in protein structure and stability","volume":"79","author":"Kellogg","year":"2011","journal-title":"Proteins: Structure, Function, and Bioinformatics"},{"issue":"11","key":"2022031506255331000_ref44","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1008291","article-title":"Predicting changes in protein thermodynamic stability upon point mutation with deep 3d convolutional neural networks","volume":"16","author":"Li","year":"2020","journal-title":"PLoS Comput Biol"},{"issue":"12","key":"2022031506255331000_ref45","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1008543","article-title":"PremPS: predicting the impact of missense mutations on protein stability","volume":"16","author":"Chen","year":"2020","journal-title":"PLoS Comput Biol"},{"issue":"9","key":"2022031506255331000_ref46","doi-asserted-by":"crossref","first-page":"1414","DOI":"10.1093\/bioinformatics\/btv769","article-title":"MAESTROweb: a web server for structure-based protein stability prediction","volume":"32","author":"Laimer","year":"2016","journal-title":"Bioinformatics"},{"issue":"16","key":"2022031506255331000_ref47","doi-asserted-by":"crossref","first-page":"2542","DOI":"10.1093\/bioinformatics\/btw192","article-title":"INPS-MD: a web server to predict stability of protein variants from sequence and structure","volume":"32","author":"Savojardo","year":"2016","journal-title":"Bioinformatics"},{"issue":"suppl_2","key":"2022031506255331000_ref48","doi-asserted-by":"crossref","first-page":"W306","DOI":"10.1093\/nar\/gki375","article-title":"I-mutant2. 0: predicting stability changes upon mutation from the protein sequence or structure","volume":"33","author":"Capriotti","year":"2005","journal-title":"Nucleic Acids Res"},{"issue":"9","key":"2022031506255331000_ref49","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1093\/bioinformatics\/bty880","article-title":"A natural upper bound to the accuracy of predicting protein stability changes upon mutations","volume":"35","author":"Montanucci","year":"2019","journal-title":"Bioinformatics"},{"key":"2022031506255331000_ref50","doi-asserted-by":"crossref","first-page":"1177932219871263","DOI":"10.1177\/1177932219871263","article-title":"On the upper bounds of the real-valued predictions","volume":"13","author":"Benevenuta","year":"2019","journal-title":"Bioinform Biol Insights"},{"issue":"10","key":"2022031506255331000_ref51","doi-asserted-by":"crossref","first-page":"4772","DOI":"10.1021\/acs.jcim.0c00591","article-title":"Systematic investigation of the data set dependency of protein stability predictors","volume":"60","author":"Caldararu","year":"2020","journal-title":"J Chem Inf Model"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/23\/2\/bbab555\/42805194\/bbab555.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/23\/2\/bbab555\/42805194\/bbab555.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,15]],"date-time":"2022-03-15T06:30:45Z","timestamp":1647325845000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbab555\/6502552"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,11]]},"references-count":51,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,3,10]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbab555","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,3]]},"published":{"date-parts":[[2022,1,11]]},"article-number":"bbab555"}}