{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T04:31:33Z","timestamp":1783139493507,"version":"3.54.6"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,16]],"date-time":"2024-03-16T00:00:00Z","timestamp":1710547200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,16]],"date-time":"2024-03-16T00:00:00Z","timestamp":1710547200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001869","name":"Academia Sinica","doi-asserted-by":"publisher","award":["AS-IA-107-L03"],"award-info":[{"award-number":["AS-IA-107-L03"]}],"id":[{"id":"10.13039\/501100001869","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001869","name":"Academia Sinica","doi-asserted-by":"publisher","award":["AS-IA-107-L03"],"award-info":[{"award-number":["AS-IA-107-L03"]}],"id":[{"id":"10.13039\/501100001869","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST-98-2113-M-001-011"],"award-info":[{"award-number":["MOST-98-2113-M-001-011"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology, Taiwan","doi-asserted-by":"publisher","award":["MOST-98-2113-M-001-011"],"award-info":[{"award-number":["MOST-98-2113-M-001-011"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Protein language models, inspired by the success of large language models in deciphering human language, have emerged as powerful tools for unraveling the intricate code of life inscribed within protein sequences. They have gained significant attention for their promising applications across various areas, including the sequence-based prediction of secondary and tertiary protein structure, the discovery of new functional protein sequences\/folds, and the assessment of mutational impact on protein fitness. However, their utility in learning to predict protein residue properties based on scant datasets, such as protein\u2013protein interaction (PPI)-hotspots whose mutations significantly impair PPIs, remained unclear. Here, we explore the feasibility of using protein language-learned representations as features for machine learning to predict PPI-hotspots using a dataset containing 414 experimentally confirmed PPI-hotspots and 504 PPI-nonhot spots.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Our findings showcase the capacity of unsupervised learning with protein language models in capturing critical functional attributes of protein residues derived from the evolutionary information encoded within amino acid sequences. We show that methods relying on protein language models can compete with methods employing sequence and structure-based features to predict PPI-hotspots from the free protein structure. We observed an optimal number of features for model precision, suggesting a balance between information and overfitting.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>This study underscores the potential of transformer-based protein language models to extract critical knowledge from sparse datasets, exemplified here by the challenging realm of predicting PPI-hotspots. These models offer a cost-effective and time-efficient alternative to traditional experimental methods for predicting certain residue properties. However, the challenge of explaining why specific features are important for determining certain residue properties remains.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12859-024-05737-2","type":"journal-article","created":{"date-parts":[[2024,3,16]],"date-time":"2024-03-16T03:02:13Z","timestamp":1710558133000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Using protein language models for protein interaction hot spot prediction with limited data"],"prefix":"10.1186","volume":"25","author":[{"given":"Karen","family":"Sargsyan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carmay","family":"Lim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,3,16]]},"reference":[{"key":"5737_CR1","unstructured":"Zhao WX, Zhou K, Li J, Tang T, Wang X, Hou Y, Min Y, Zhang B, Zhang J, Dong Z et al. A survey of large language models; 2023. http:\/\/arxiv.org\/abs\/2303.18223"},{"issue":"12","key":"5737_CR2","doi-asserted-by":"publisher","first-page":"1315","DOI":"10.1038\/s41592-019-0598-1","volume":"16","author":"EC Alley","year":"2019","unstructured":"Alley EC, Khimulya G, Biswas S, AlQuraishi M, Church GM. Unified rational protein engineering with sequence-based deep representation learning. Nat Methods. 2019;16(12):1315\u201322.","journal-title":"Nat Methods"},{"issue":"723","key":"5737_CR3","first-page":"1","volume":"20","author":"M Heinzinger","year":"2019","unstructured":"Heinzinger M, Elnaggar A, Wang Y, Dallago C, Nechaev D, Matthes F, Rost B. Modeling aspects of the language of life through transfer-learning protein sequences. Bmc Bioinform. 2019;20(723):1\u201317.","journal-title":"Bmc Bioinform"},{"issue":"15","key":"5737_CR4","doi-asserted-by":"publisher","first-page":"e2016239118","DOI":"10.1073\/pnas.2016239118","volume":"118","author":"A Rives","year":"2021","unstructured":"Rives A, Meier J, Sercu T, Goyal S, Lin ZM, Liu JS, Guo DM, Ott M, Zitnick CL, Ma J, et al. Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences. P Natl Acad Sci USA. 2021;118(15):e2016239118.","journal-title":"P Natl Acad Sci USA"},{"issue":"6637","key":"5737_CR5","doi-asserted-by":"publisher","first-page":"1123","DOI":"10.1126\/science.ade2574","volume":"379","author":"ZM Lin","year":"2023","unstructured":"Lin ZM, Akin H, Rao RS, Hie B, Zhu ZK, Lu WT, Smetanin N, Verkuil R, Kabeli O, Shmueli Y, et al. Evolutionary-scale prediction of atomic-level protein structure with a language model. Science. 2023;379(6637):1123\u201330.","journal-title":"Science"},{"issue":"23\u201324","key":"5737_CR6","doi-asserted-by":"publisher","first-page":"e2300011","DOI":"10.1002\/pmic.202300011","volume":"23","author":"NQK Le","year":"2023","unstructured":"Le NQK. Leveraging transformers-based language models in proteome bioinformatics. Proteomics. 2023;23(23\u201324):e2300011.","journal-title":"Proteomics"},{"issue":"4","key":"5737_CR7","doi-asserted-by":"publisher","first-page":"1052","DOI":"10.1021\/acs.jcim.2c00025","volume":"62","author":"YC Chen","year":"2022","unstructured":"Chen YC, Chen YH, Wright JD, Lim C. PPI-HotspotDB: database of protein-protein interaction hot spots. J Chem Inf Model. 2022;62(4):1052\u201360.","journal-title":"J Chem Inf Model"},{"key":"5737_CR8","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I. Attention is all you need; 2017. http:\/\/arxiv.org\/abs\/1706.03762"},{"key":"5737_CR9","doi-asserted-by":"crossref","unstructured":"Su J, Han C, Zhou Y, Shan J, Zhou X, Yuan F: SaProt: protein language modeling with structure-aware vocabulary. bioRxiv 2023:2023.2010.2001.560349","DOI":"10.1101\/2023.10.01.560349"},{"key":"5737_CR10","doi-asserted-by":"crossref","unstructured":"Hsu C, Verkuil R, Liu J, Lin Z, Hie B, Sercu T, Lerer A, Rives A: Learning inverse folding from millions of predicted structures. In: Kamalika C, Stefanie J, Le S, Csaba S, Gang N, Sivan S, editors Proceedings of the 39th international conference on machine learning; proceedings of machine learning research, PMLR 2022; pp. 8946\u20138970","DOI":"10.1101\/2022.04.10.487779"},{"key":"5737_CR11","doi-asserted-by":"crossref","unstructured":"Meier J, Rao R, Verkuil R, Liu J, Sercu T, Rives A. Language models enable zero-shot prediction of the effects of mutations on protein function. bioRxiv 2021:2021.2007.2009.450648","DOI":"10.1101\/2021.07.09.450648"},{"issue":"11","key":"5737_CR12","doi-asserted-by":"publisher","first-page":"1692","DOI":"10.1038\/s41587-022-01556-z","volume":"40","author":"R Chowdhury","year":"2022","unstructured":"Chowdhury R, Bouatta N, Biswas S, Floristean C, Kharkar A, Roy K, Rochereau C, Ahdritz G, Zhang JN, Church GM, et al. Single-sequence protein structure prediction using a language model and deep learning. Nat Biotechnol. 2022;40(11):1692\u20131692.","journal-title":"Nat Biotechnol"},{"key":"5737_CR13","doi-asserted-by":"crossref","unstructured":"Wu R, Ding F, Wang R, Shen R, Zhang X, Luo S, Su C, Wu Z, Xie Q, Berger B et al. High-resolution de novo structure prediction from primary sequence. bioRxiv 2022:2022.2007.2021.500999","DOI":"10.1101\/2022.07.21.500999"},{"issue":"7873","key":"5737_CR14","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","volume":"596","author":"J Jumper","year":"2021","unstructured":"Jumper J, Evans R, Pritzel A, Green T, Figurnov M, Ronneberger O, Tunyasuvunakool K, Bates R, Zidek A, Potapenko A, et al. Highly accurate protein structure prediction with AlphaFold. Nature. 2021;596(7873):583\u20139.","journal-title":"Nature"},{"key":"5737_CR15","doi-asserted-by":"publisher","first-page":"646","DOI":"10.1038\/s41586-023-06622-3","volume":"622","author":"J Durairaj","year":"2023","unstructured":"Durairaj J, Waterhouse AM, Mets T, Brodiazhenko T, Abdullah M, Studer G, Tauriello G, Akdel M, Andreeva A, Bateman A, et al. Uncovering new families and folds in the natural protein universe. Nature. 2023;622:646\u201353.","journal-title":"Nature"},{"issue":"8","key":"5737_CR16","doi-asserted-by":"publisher","first-page":"2401","DOI":"10.1093\/bioinformatics\/btaa003","volume":"36","author":"N Strodthoff","year":"2020","unstructured":"Strodthoff N, Wagner P, Wenzel M, Samek W. UDSMProt: universal deep sequence models for protein classification. Bioinformatics. 2020;36(8):2401\u20139.","journal-title":"Bioinformatics"},{"key":"5737_CR17","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1038\/s41587-023-01763-2","volume":"42","author":"BL Hie","year":"2023","unstructured":"Hie BL, Shanker VR, Xu D, Bruun TUJ, Weidenbacher PA, Tang SG, Wu WS, Pak JE, Kim PS. Efficient evolution of human antibodies from general protein language models. Nat Biotechnol. 2023;42:275\u201383.","journal-title":"Nat Biotechnol"},{"key":"5737_CR18","doi-asserted-by":"crossref","unstructured":"Hie B, Candido S, Lin Z, Kabeli O, Rao R, Smetanin N, Sercu T, Rives A: A high-level programming language for generative protein design. bioRxiv 2022:2022.2012.2021.521526","DOI":"10.1101\/2022.12.21.521526"},{"issue":"8","key":"5737_CR19","doi-asserted-by":"publisher","first-page":"1099","DOI":"10.1038\/s41587-022-01618-2","volume":"41","author":"A Madani","year":"2023","unstructured":"Madani A, Krause B, Greene ER, Subramanian S, Mohr BP, Holton JM, Olmos JL, Xiong CM, Sun ZZ, Socher R, et al. Large language models generate functional protein sequences across diverse families. Nat Biotechnol. 2023;41(8):1099\u2013106.","journal-title":"Nat Biotechnol"},{"key":"5737_CR20","unstructured":"Brown TB, Mann B, Ryder N, Subbiah M, Kaplan J, Dhariwal P, Neelakantan A, Shyam P, Sastry G, Askell A et al. Language models are few-shot learners; 2020. http:\/\/arxiv.org\/abs\/2005.14165"},{"issue":"11","key":"5737_CR21","doi-asserted-by":"publisher","first-page":"1453","DOI":"10.1093\/bioinformatics\/btg163","volume":"19","author":"TB Fischer","year":"2003","unstructured":"Fischer TB, Arunachalam KV, Bailey D, Mangual V, Bakhru S, Russo R, Huang D, Paczkowski M, Lalchandani V, Ramachandra C, et al. The binding interface database (BID): a compilation of amino acid hot spots in protein interfaces. Bioinformatics. 2003;19(11):1453\u20134.","journal-title":"Bioinformatics"},{"issue":"22","key":"5737_CR22","doi-asserted-by":"publisher","first-page":"9861","DOI":"10.1021\/jacs.0c02430","volume":"142","author":"K Mazmanian","year":"2020","unstructured":"Mazmanian K, Sargsyan K, Lim C. How the local environment of functional sites regulates protein function. J Am Chem Soc. 2020;142(22):9861\u201371.","journal-title":"J Am Chem Soc"},{"key":"5737_CR23","doi-asserted-by":"publisher","unstructured":"Chen Y, Sargsyan K, Wright J, Chen Y, Huang Y, Lim C: PPI-hotspotID: a method for detecting protein\u2013protein interaction hot spots from the free protein structure; 2023. https:\/\/doi.org\/10.21203\/rs.3.rs-3400169\/v1","DOI":"10.21203\/rs.3.rs-3400169\/v1"},{"issue":"3","key":"5737_CR24","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1093\/bioinformatics\/17.3.284","volume":"17","author":"KS Thorn","year":"2001","unstructured":"Thorn KS, Bogan AA. ASEdb: a database of alanine mutations and their effects on the free energy of binding in protein interactions. Bioinformatics. 2001;17(3):284\u20135.","journal-title":"Bioinformatics"},{"issue":"3","key":"5737_CR25","doi-asserted-by":"publisher","first-page":"462","DOI":"10.1093\/bioinformatics\/bty635","volume":"35","author":"J Jankauskaite","year":"2019","unstructured":"Jankauskaite J, Jim\u00e9nez-Garc\u00eda B, Dapkunas J, Fern\u00e1ndez-Recio J, Moal IH. SKEMPI 2.0: an updated benchmark of changes in protein-protein binding energy, kinetics and thermodynamics upon mutation. Bioinformatics. 2019;35(3):462\u20139.","journal-title":"Bioinformatics"},{"issue":"D1","key":"5737_CR26","doi-asserted-by":"publisher","first-page":"D506","DOI":"10.1093\/nar\/gky1049","volume":"47","author":"A Bateman","year":"2019","unstructured":"Bateman A, Martin MJ, Orchard S, Magrane M, Alpi E, Bely B, Bingley M, Britto R, Bursteinas B, Busiello G, et al. UniProt: a worldwide hub of protein knowledge. Nucleic Acids Res. 2019;47(D1):D506\u201315.","journal-title":"Nucleic Acids Res"},{"key":"5737_CR27","doi-asserted-by":"publisher","first-page":"100853","DOI":"10.1016\/j.imu.2022.100853","volume":"29","author":"LO Schwen","year":"2022","unstructured":"Schwen LO, Schacherer D, Gei\u00dfler C, Homeyer A. Evaluating generic AutoML tools for computational pathology. Inform Med Unlock. 2022;29:100853.","journal-title":"Inform Med Unlock"},{"key":"5737_CR28","doi-asserted-by":"publisher","first-page":"548","DOI":"10.1038\/s41589-022-01223-z","volume":"19","author":"Y Cheng","year":"2023","unstructured":"Cheng Y, Wang H, Xu H, et al. Co-evolution-based prediction of metal-binding sites in proteomes by machine learning. Nat Chem Biol. 2023;19:548\u201355.","journal-title":"Nat Chem Biol"},{"issue":"21","key":"5737_CR29","doi-asserted-by":"publisher","first-page":"6537","DOI":"10.1021\/acs.jcim.3c01563","volume":"63","author":"A Raza","year":"2023","unstructured":"Raza A, Uddin J, Almuhaimeed A, Akbar S, Zou Q, Ahmad A. AIPs-SnTCN: predicting anti-inflammatory peptides using fasttext and transformer encoder-based hybrid word embedding with self-normalized temporal convolutional networks. J Chem Inf Model. 2023;63(21):6537\u201354.","journal-title":"J Chem Inf Model"},{"key":"5737_CR30","unstructured":"Erickson N, Mueller J, Shirkov A, Zhang H, Larroy P, Li M, Smola A. AutoGluon-tabular: robust and accurate AutoML for structured data; 2020. http:\/\/arxiv.org\/abs\/2003.06505"},{"issue":"1","key":"5737_CR31","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1093\/bioinformatics\/19.1.163","volume":"19","author":"F Glaser","year":"2003","unstructured":"Glaser F, Pupko T, Paz I, Bell RE, Bechor-Shental D, Martz E, Ben-Tal N. ConSurf: identification of functional regions in proteins by surface-mapping of phylogenetic information. Bioinformatics. 2003;19(1):163\u20134.","journal-title":"Bioinformatics"},{"key":"5737_CR32","doi-asserted-by":"publisher","first-page":"W299","DOI":"10.1093\/nar\/gki370","volume":"33","author":"M Landau","year":"2005","unstructured":"Landau M, Mayrose I, Rosenberg Y, Glaser F, Martz E, Pupko T, Ben-Tal N. ConSurf 2005: the projection of evolutionary conservation scores of residues on protein structures. Nucleic Acids Res. 2005;33:W299\u2013302.","journal-title":"Nucleic Acids Res"},{"issue":"12","key":"5737_CR33","doi-asserted-by":"publisher","first-page":"2577","DOI":"10.1002\/bip.360221211","volume":"22","author":"W Kabsch","year":"1983","unstructured":"Kabsch W, Sander C. Dictionary of protein secondary structure: pattern-recognition of hydrogen-bonded and geometrical features. Biopolymers. 1983;22(12):2577\u2013637.","journal-title":"Biopolymers"},{"key":"5737_CR34","doi-asserted-by":"publisher","first-page":"189","DOI":"10.12688\/f1000research.7931.1","volume":"5","author":"S Mitternacht","year":"2016","unstructured":"Mitternacht S. FreeSASA: an open source C library for solvent accessible surface area calculations. F1000Res. 2016;5:189.","journal-title":"F1000Res"},{"issue":"20","key":"5737_CR35","doi-asserted-by":"publisher","first-page":"6183","DOI":"10.1021\/acs.jcim.3c01153","volume":"63","author":"DA Case","year":"2023","unstructured":"Case DA, Aktulga HM, Belfon K, Cerutti DS, Cisneros GA, Cruzeiro VWD, Forouzesh N, Giese TJ, G\u00f6tz AW, Gohlke H, et al. The AmberTools. J Chem Inf Model. 2023;63(20):6183\u201391.","journal-title":"J Chem Inf Model"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-024-05737-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-024-05737-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-024-05737-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,16]],"date-time":"2024-03-16T03:02:40Z","timestamp":1710558160000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-024-05737-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,16]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["5737"],"URL":"https:\/\/doi.org\/10.1186\/s12859-024-05737-2","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-3830911\/v1","asserted-by":"object"}]},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,16]]},"assertion":[{"value":"3 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"115"}}