{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T11:04:09Z","timestamp":1783595049444,"version":"3.55.0"},"reference-count":64,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2024,8,23]],"date-time":"2024-08-23T00:00:00Z","timestamp":1724371200000},"content-version":"vor","delay-in-days":29,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"Ministry of Agriculture and Rural Affairs of China, Biological Breeding-Major Projects","award":["2023ZD0407401"],"award-info":[{"award-number":["2023ZD0407401"]}]},{"name":"Strategic Priority Research Program of the Chinese Academy of Sciences","award":["XDA16010503"],"award-info":[{"award-number":["XDA16010503"]}]},{"name":"Beijing Institute for Stem Cell and Regenerative Medicine","award":["2022FH122"],"award-info":[{"award-number":["2022FH122"]}]},{"name":"Beijing Institute for Stem Cell and Regenerative Medicine","award":["2023FH105"],"award-info":[{"award-number":["2023FH105"]}]},{"name":"Beijing Institute for Stem Cell and Regenerative Medicine","award":["2023FH106"],"award-info":[{"award-number":["2023FH106"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32001062"],"award-info":[{"award-number":["32001062"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Initiative Scientific Research Program, Institute of Zoology, Chinese Academy of Sciences","award":["2023IOZ0204"],"award-info":[{"award-number":["2023IOZ0204"]}]},{"DOI":"10.13039\/501100002367","name":"Chinese Academy of Sciences","doi-asserted-by":"publisher","award":["ZDBS-LY-SM005"],"award-info":[{"award-number":["ZDBS-LY-SM005"]}],"id":[{"id":"10.13039\/501100002367","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,7,25]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Protein solubility plays a crucial role in various biotechnological, industrial, and biomedical applications. With the reduction in sequencing and gene synthesis costs, the adoption of high-throughput experimental screening coupled with tailored bioinformatic prediction has witnessed a rapidly growing trend for the development of novel functional enzymes of interest (EOI). High protein solubility rates are essential in this process and accurate prediction of solubility is a challenging task. As deep learning technology continues to evolve, attention-based protein language models (PLMs) can extract intrinsic information from protein sequences to a greater extent. Leveraging these models along with the increasing availability of protein solubility data inferred from structural database like the Protein Data Bank holds great potential to enhance the prediction of protein solubility. In this study, we curated an Updated Escherichia coli protein Solubility DataSet (UESolDS) and employed a combination of multiple PLMs and classification layers to predict protein solubility. The resulting best-performing model, named Protein Language Model-based protein Solubility prediction model (PLM_Sol), demonstrated significant improvements over previous reported models, achieving a notable 6.4% increase in accuracy, 9.0% increase in F1_score, and 11.1% increase in Matthews correlation coefficient score on the independent test set. Moreover, additional evaluation utilizing our in-house synthesized protein resource as test data, encompassing diverse types of enzymes, also showcased the good performance of PLM_Sol. Overall, PLM_Sol exhibited consistent and promising performance across both independent test set and experimental set, thereby making it well suited for facilitating large-scale EOI studies. PLM_Sol is available as a standalone program and as an easy-to-use model at https:\/\/zenodo.org\/doi\/10.5281\/zenodo.10675340.<\/jats:p>","DOI":"10.1093\/bib\/bbae404","type":"journal-article","created":{"date-parts":[[2024,8,24]],"date-time":"2024-08-24T00:39:11Z","timestamp":1724459951000},"source":"Crossref","is-referenced-by-count":27,"title":["PLM_Sol: predicting protein solubility by benchmarking multiple protein language models with the updated <i>Escherichia coli<\/i> protein solubility dataset"],"prefix":"10.1093","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-3037-6808","authenticated-orcid":false,"given":"Xuechun","family":"Zhang","sequence":"first","affiliation":[{"name":"Key Laboratory of Organ Regeneration and Reconstruction , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Chinese Academy of Sciences , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Institute for Stem Cell and Regeneration, Chinese Academy of Sciences , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"University of Chinese Academy of Sciences , No. 1 Yanqihu East Rd, Huairou District, Beijing 101408, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoxuan","family":"Hu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Organ Regeneration and Reconstruction , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Chinese Academy of Sciences , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Institute for Stem Cell and Regeneration, Chinese Academy of Sciences , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"University of Chinese Academy of Sciences , No. 1 Yanqihu East Rd, Huairou District, Beijing 101408, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tongtong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Organ Regeneration and Reconstruction , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Chinese Academy of Sciences , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Institute for Stem Cell and Regeneration, Chinese Academy of Sciences , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"University of Chinese Academy of Sciences , No. 1 Yanqihu East Rd, Huairou District, Beijing 101408, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ling","family":"Yang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Organ Regeneration and Reconstruction , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Chinese Academy of Sciences , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Institute for Stem Cell and Regeneration, Chinese Academy of Sciences , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"University of Chinese Academy of Sciences , No. 1 Yanqihu East Rd, Huairou District, Beijing 101408, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chunhong","family":"Liu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Organ Regeneration and Reconstruction , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Chinese Academy of Sciences , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Institute for Stem Cell and Regeneration, Chinese Academy of Sciences , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"University of Chinese Academy of Sciences , No. 1 Yanqihu East Rd, Huairou District, Beijing 101408, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ning","family":"Xu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Organ Regeneration and Reconstruction , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Chinese Academy of Sciences , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Institute for Stem Cell and Regeneration, Chinese Academy of Sciences , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"University of Chinese Academy of Sciences , No. 1 Yanqihu East Rd, Huairou District, Beijing 101408, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haoyi","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Organ Regeneration and Reconstruction , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Chinese Academy of Sciences , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Institute for Stem Cell and Regeneration, Chinese Academy of Sciences , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"University of Chinese Academy of Sciences , No. 1 Yanqihu East Rd, Huairou District, Beijing 101408, China"},{"name":"Beijing Institute for Stem Cell and Regenerative Medicine , A 3 Datun Road, Chaoyang District, Beijing 100100, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wen","family":"Sun","sequence":"additional","affiliation":[{"name":"Key Laboratory of Organ Regeneration and Reconstruction , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Chinese Academy of Sciences , State Key Laboratory of Stem Cell and Reproductive Biology, Institute of Zoology, , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Institute for Stem Cell and Regeneration, Chinese Academy of Sciences , 1 Beichen West Road, Chaoyang District, Beijing 100101, China"},{"name":"Beijing Institute for Stem Cell and Regenerative Medicine , A 3 Datun Road, Chaoyang District, Beijing 100100, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2024,8,23]]},"reference":[{"key":"2024082322555207200_ref1","doi-asserted-by":"crossref","first-page":"11332","DOI":"10.1038\/s41598-021-90772-9","article-title":"Freeze\u2013thaw characterization process to minimize aggregation and enable drug product manufacturing of protein based therapeutics","volume":"11","author":"Jain","year":"2021","journal-title":"Sci Rep"},{"key":"2024082322555207200_ref2","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1093\/toxsci\/kfw121","article-title":"Editor\u2019s highlight: subvisible aggregates of immunogenic proteins promote a Th1-type response","volume":"153","author":"Ratanji","year":"2016","journal-title":"Toxicol Sci"},{"key":"2024082322555207200_ref3","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1023\/B:PHAM.0000029275.41323.a6","article-title":"Structure-immunogenicity relationships of therapeutic proteins","volume":"21","author":"Hermeling","year":"2004","journal-title":"Pharm Res"},{"key":"2024082322555207200_ref4","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1016\/j.tibtech.2021.06.008","article-title":"Discovery and mining of enzymes from the human gut microbiome","volume":"40","author":"Jia","year":"2022","journal-title":"Trends Biotechnol"},{"key":"2024082322555207200_ref5","first-page":"1","article-title":"Evolutionary mining and functional characterization of TnpB nucleases identify efficient miniature genome editors","volume":"42","author":"Xiang","year":"2023","journal-title":"Nat Biotechnol"},{"issue":"15","key":"2024082322555207200_ref6","doi-asserted-by":"crossref","first-page":"3182","DOI":"10.1016\/j.cell.2023.05.041","article-title":"Discovery of deaminase functions by structure-based protein clustering","volume":"186","author":"Huang","year":"2023","journal-title":"Cell"},{"key":"2024082322555207200_ref7","doi-asserted-by":"crossref","first-page":"420","DOI":"10.3389\/fbioe.2019.00420","article-title":"Recent developments in bioprocessing of recombinant proteins: expression hosts and process development","volume":"7","author":"Tripathi","year":"2019","journal-title":"Front Bioeng Biotechnol"},{"key":"2024082322555207200_ref8","doi-asserted-by":"crossref","first-page":"1714","DOI":"10.1110\/ps.0205202","article-title":"High-throughput screening of soluble recombinant proteins","volume":"11","author":"Shih","year":"2002","journal-title":"Protein Sci"},{"key":"2024082322555207200_ref9","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1110\/ps.041009005","article-title":"Understanding the relationship between the primary structure of proteins and its propensity to be soluble on overexpression in Escherichia coli","volume":"14","author":"Idicula-Thomas","year":"2005","journal-title":"Protein Sci"},{"key":"2024082322555207200_ref10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12896-019-0520-z","article-title":"Surface patches on recombinant erythropoietin predict protein solubility: engineering proteins to minimise aggregation","volume":"19","author":"Carballo-Amador","year":"2019","journal-title":"BMC Biotechnol"},{"key":"2024082322555207200_ref11","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1002\/prot.25594","article-title":"AggScore: prediction of aggregation-prone regions in proteins based on the distribution of surface patches","volume":"86","author":"Sankar","year":"2018","journal-title":"Proteins Struct Funct Bioinf"},{"key":"2024082322555207200_ref12","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/j.jmb.2009.03.002","article-title":"A relationship between mRNA expression levels and protein solubility in E. coli","volume":"388","author":"Tartaglia","year":"2009","journal-title":"J Mol Biol"},{"key":"2024082322555207200_ref13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1475-2859-4-11","article-title":"Sequence determinants of protein aggregation: tools to increase protein solubility","volume":"4","author":"Ventura","year":"2005","journal-title":"Microb Cell Fact"},{"key":"2024082322555207200_ref14","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1146\/annurev-biochem-061516-045115","article-title":"Protein misfolding, amyloid formation, and human disease: a summary of progress over the last decade","volume":"86","author":"Chiti","year":"2017","journal-title":"Annu Rev Biochem"},{"key":"2024082322555207200_ref15","doi-asserted-by":"crossref","first-page":"63","DOI":"10.3389\/fmicb.2014.00063","article-title":"Fusion tags for protein solubility, purification and immunogenicity in Escherichia coli: the novel Fh8 system","volume":"5","author":"Costa","year":"2014","journal-title":"Front Microbiol"},{"key":"2024082322555207200_ref16","first-page":"443","article-title":"Predicting the solubility of recombinant proteins in Escherichia coli","volume":"9","author":"Wilkinson","year":"1991","journal-title":"Bio\/technology"},{"key":"2024082322555207200_ref17","doi-asserted-by":"crossref","first-page":"4691","DOI":"10.1093\/bioinformatics\/btaa578","article-title":"Solubility-weighted index: fast and accurate prediction of protein solubility","volume":"36","author":"Bhandari","year":"2020","journal-title":"Bioinformatics"},{"key":"2024082322555207200_ref18","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1007\/s42979-021-00592-x","article-title":"Machine learning: algorithms, real-world applications and research directions","volume":"2","author":"Sarker","year":"2021","journal-title":"SN Comput Sci"},{"key":"2024082322555207200_ref19","doi-asserted-by":"crossref","first-page":"2536","DOI":"10.1093\/bioinformatics\/btl623","article-title":"Protein solubility: sequence based prediction and experimental verification","volume":"23","author":"Smialowski","year":"2007","journal-title":"Bioinformatics"},{"key":"2024082322555207200_ref20","doi-asserted-by":"crossref","first-page":"2200","DOI":"10.1093\/bioinformatics\/btp386","article-title":"SOLpro: accurate sequence-based prediction of protein solubility","volume":"25","author":"Magnan","year":"2009","journal-title":"Bioinformatics"},{"key":"2024082322555207200_ref21","doi-asserted-by":"crossref","first-page":"2192","DOI":"10.1111\/j.1742-4658.2012.08603.x","article-title":"PROSO II\u2013a new method for protein solubility prediction","volume":"279","author":"Smialowski","year":"2012","journal-title":"FEBS J"},{"key":"2024082322555207200_ref22","doi-asserted-by":"crossref","DOI":"10.1186\/1471-2105-13-S17-S3","article-title":"Prediction and analysis of protein solubility using a novel scoring card method with dipeptide composition","volume-title":"BMC Bioinformatics","author":"Huang"},{"key":"2024082322555207200_ref23","doi-asserted-by":"crossref","first-page":"3098","DOI":"10.1093\/bioinformatics\/btx345","article-title":"Protein\u2013sol: a web tool for predicting protein solubility from sequence","volume":"33","author":"Hebditch","year":"2017","journal-title":"Bioinformatics"},{"key":"2024082322555207200_ref24","doi-asserted-by":"crossref","first-page":"1092","DOI":"10.1093\/bioinformatics\/btx662","article-title":"PaRSnIP: sequence-based protein solubility prediction using gradient boosting machine","volume":"34","author":"Rawi","year":"2018","journal-title":"Bioinformatics"},{"key":"2024082322555207200_ref25","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1093\/bioinformatics\/btaa1102","article-title":"SoluProt: prediction of soluble protein expression in Escherichia coli","volume":"37","author":"Hon","year":"2021","journal-title":"Bioinformatics"},{"key":"2024082322555207200_ref26","doi-asserted-by":"crossref","DOI":"10.1109\/GUCON.2018.8675097","article-title":"A review on conventional machine learning vs deep learning","author":"Chauhan","year":"2018","journal-title":"2018 International Conference on Computing, Power and Communication Technologies (GUCON)"},{"key":"2024082322555207200_ref27","doi-asserted-by":"crossref","first-page":"2605","DOI":"10.1093\/bioinformatics\/bty166","article-title":"DeepSol: a deep learning framework for sequence-based protein solubility prediction","volume":"34","author":"Khurana","year":"2018","journal-title":"Bioinformatics"},{"key":"2024082322555207200_ref28","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1007722","article-title":"Insight into the protein solubility driving forces with neural attention","volume":"16","author":"Raimondi","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"2024082322555207200_ref29","doi-asserted-by":"crossref","first-page":"4314","DOI":"10.1093\/bioinformatics\/btab463","article-title":"EPSOL: sequence-based protein solubility prediction using multidimensional embedding","volume":"37","author":"Wu","year":"2021","journal-title":"Bioinformatics"},{"key":"2024082322555207200_ref30","doi-asserted-by":"crossref","first-page":"13555","DOI":"10.3390\/ijms222413555","article-title":"DSResSol: a sequence-based solubility predictor created with dilated squeeze excitation residual networks","volume":"22","author":"Madani","year":"2021","journal-title":"Int J Mol Sci"},{"key":"2024082322555207200_ref31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12915-023-01510-8","article-title":"Prediction of protein solubility based on sequence physicochemical patterns and distributed representation information with DeepSoluE","volume":"21","author":"Wang","year":"2023","journal-title":"BMC Biol"},{"key":"2024082322555207200_ref32","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv Neural Inf Process Syst"},{"key":"2024082322555207200_ref33","article-title":"Bert: pre-training of deep bidirectional transformers for language understanding","author":"Devlin","year":"2018","journal-title":"arXiv preprint. arXiv:1810.04805"},{"key":"2024082322555207200_ref34","doi-asserted-by":"crossref","first-page":"2102","DOI":"10.1093\/bioinformatics\/btac020","article-title":"ProteinBERT: a universal deep-learning model of protein sequence and function","volume":"38","author":"Brandes","year":"2022","journal-title":"Bioinformatics"},{"key":"2024082322555207200_ref35","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.2016239118","article-title":"Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences","volume":"118","author":"Rives","year":"2021","journal-title":"Proc Natl Acad Sci"},{"key":"2024082322555207200_ref36","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1126\/science.ade2574","article-title":"Evolutionary-scale prediction of atomic-level protein structure with a language model","volume":"379","author":"Lin","year":"2023","journal-title":"Science"},{"key":"2024082322555207200_ref37","doi-asserted-by":"crossref","first-page":"7112","DOI":"10.1109\/TPAMI.2021.3095381","article-title":"Prottrans: toward understanding the language of life through self-supervised learning","volume":"44","author":"Elnaggar","year":"2021","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"2024082322555207200_ref38","doi-asserted-by":"crossref","first-page":"926","DOI":"10.1093\/bioinformatics\/btu739","article-title":"UniRef clusters: a comprehensive and scalable alternative for improving sequence similarity searches","volume":"31","author":"Suzek","year":"2015","journal-title":"Bioinformatics"},{"key":"2024082322555207200_ref39","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","article-title":"Highly accurate protein structure prediction with AlphaFold","volume":"596","author":"Jumper","year":"2021","journal-title":"Nature"},{"key":"2024082322555207200_ref40","doi-asserted-by":"crossref","first-page":"941","DOI":"10.1093\/bioinformatics\/btab801","article-title":"NetSolP: predicting protein solubility in Escherichia coli using language models","volume":"38","author":"Thumuluri","year":"2022","journal-title":"Bioinformatics"},{"key":"2024082322555207200_ref41","article-title":"Protein structure initiative\u2013targettrack 2000-2017\u2013all data files","volume":"10","author":"Berman","year":"2017","journal-title":"Zenodo"},{"key":"2024082322555207200_ref42","doi-asserted-by":"crossref","first-page":"D1253","DOI":"10.1093\/nar\/gkt1060","article-title":"DNASU plasmid and PSI: biology-materials repositories: resources to accelerate biological research","volume":"42","author":"Seiler","year":"2014","journal-title":"Nucleic Acids Res"},{"key":"2024082322555207200_ref43","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1093\/dnares\/dsi012","article-title":"Complete set of ORF clones of Escherichia coli ASKA library (a complete set of E. coli K-12 ORF archive): unique resources for biological research","volume":"12","author":"Kitagawa","year":"2005","journal-title":"DNA Res"},{"key":"2024082322555207200_ref44","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1093\/nar\/28.1.235","article-title":"The protein data bank","volume":"28","author":"Berman","year":"2000","journal-title":"Nucleic Acids Res"},{"key":"2024082322555207200_ref45","doi-asserted-by":"crossref","DOI":"10.1093\/bioadv\/vbab035","article-title":"Light attention predicts protein location from the language of life","volume":"1","author":"St\u00e4rk","year":"2021","journal-title":"Bioinform Adv"},{"key":"2024082322555207200_ref46","doi-asserted-by":"crossref","DOI":"10.7717\/peerj-cs.1005","article-title":"Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model","volume":"8","author":"Jiang","year":"2022","journal-title":"PeerJ Comput Sci"},{"key":"2024082322555207200_ref47","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1006\/jmbi.2000.4315","article-title":"Predicting transmembrane protein topology with a hidden Markov model: application to complete genomes","volume":"305","author":"Krogh","year":"2001","journal-title":"J Mol Biol"},{"key":"2024082322555207200_ref48","article-title":"Preface: overexpression of integral membrane proteins","volume-title":"Biochim Biophys Acta","author":""},{"key":"2024082322555207200_ref49","doi-asserted-by":"crossref","first-page":"W29","DOI":"10.1093\/nar\/gkt282","article-title":"BLAST: a more efficient report with usability improvements","volume":"41","author":"Boratyn","year":"2013","journal-title":"Nucleic Acids Res"},{"key":"2024082322555207200_ref50","doi-asserted-by":"crossref","first-page":"1026","DOI":"10.1038\/nbt.3988","article-title":"MMseqs2 enables sensitive protein sequence searching for the analysis of massive data sets","volume":"35","author":"Steinegger","year":"2017","journal-title":"Nat Biotechnol"},{"key":"2024082322555207200_ref51","article-title":"Learned embeddings from deep learning to visualize and predict protein sets","volume":"1","author":"Dallago","journal-title":"Curr Protoc"},{"key":"2024082322555207200_ref52","article-title":"Decoupled weight decay regularization","author":"","journal-title":"The International Conference on Learning Representations"},{"key":"2024082322555207200_ref53","first-page":"2825","article-title":"Scikit-learn: machine learning in python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J Mach Learn Res"},{"key":"2024082322555207200_ref54","doi-asserted-by":"crossref","first-page":"D523","DOI":"10.1093\/nar\/gkac1052","article-title":"UniProt: the universal protein knowledgebase in 2023","volume":"51","year":"2023","journal-title":"Nucleic Acids Res"},{"key":"2024082322555207200_ref55","article-title":"Visualizing data using t-SNE","volume":"9","author":"","journal-title":"J Mach Learn Res"},{"key":"2024082322555207200_ref56","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1017\/S0033583512000145","article-title":"The emerging diversity of transpososome architectures","volume":"45","author":"Dyda","year":"2012","journal-title":"Q Rev Biophys"},{"key":"2024082322555207200_ref57","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1038\/nsmb970","article-title":"Molecular architecture of a eukaryotic DNA transposase","volume":"12","author":"Hickman","year":"2005","journal-title":"Nat Struct Mol Biol"},{"key":"2024082322555207200_ref58","doi-asserted-by":"crossref","first-page":"53040","DOI":"10.1109\/ACCESS.2019.2912200","article-title":"Review of deep learning algorithms and architectures","volume":"7","author":"Shrestha","year":"2019","journal-title":"IEEE access"},{"key":"2024082322555207200_ref59","first-page":"843","volume-title":"Proceedings of the IEEE international conference on computer vision","author":"Sun"},{"key":"2024082322555207200_ref60","first-page":"1","volume-title":"2016 eighth international conference on quality of multimedia experience (QoMEX)","author":"Dodge"},{"key":"2024082322555207200_ref61","article-title":"LoRA: low-rank adaptation of large language models","author":"","journal-title":"The International Conference on Learning Representations"},{"key":"2024082322555207200_ref62","first-page":"2790","volume-title":"International conference on machine learning","author":"Houlsby"},{"key":"2024082322555207200_ref63","first-page":"1950","article-title":"Few-shot parameter-efficient fine-tuning is better and cheaper than in-context learning","volume":"35","author":"Liu","year":"2022","journal-title":"Adv Neural Inf Proc Syst"},{"key":"2024082322555207200_ref64","article-title":"The power of scale for parameter-efficient prompt tuning","author":"Lester","journal-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/5\/bbae404\/58905916\/bbae404.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/5\/bbae404\/58905916\/bbae404.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,24]],"date-time":"2024-08-24T00:40:00Z","timestamp":1724460000000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbae404\/7739950"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,25]]},"references-count":64,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,7,25]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbae404","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,9]]},"published":{"date-parts":[[2024,7,25]]},"article-number":"bbae404"}}