{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T22:04:16Z","timestamp":1783721056871,"version":"3.55.0"},"reference-count":49,"publisher":"Oxford University Press (OUP)","issue":"14","license":[{"start":{"date-parts":[[2019,7,8]],"date-time":"2019-07-08T00:00:00Z","timestamp":1562544000000},"content-version":"vor","delay-in-days":7,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2016YFA0501300"],"award-info":[{"award-number":["2016YFA0501300"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["31470805"],"award-info":[{"award-number":["31470805"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004739","name":"Youth Innovation Promotion Association CAS","doi-asserted-by":"crossref","award":["2014091"],"award-info":[{"award-number":["2014091"]}],"id":[{"id":"10.13039\/501100004739","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National High Technology Research and Development Program of China","award":["863"],"award-info":[{"award-number":["863"]}]},{"name":"National High Technology Research and Development Program of China","award":["2014AA020902"],"award-info":[{"award-number":["2014AA020902"]}]},{"name":"National High Technology Research and Development Program of China","award":["2014AA020901"],"award-info":[{"award-number":["2014AA020901"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,7,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>De novo peptide sequencing based on tandem mass spectrometry data is the key technology of shotgun proteomics for identifying peptides without any database and assembling unknown proteins. However, owing to the low ion coverage in tandem mass spectra, the order of certain consecutive amino acids cannot be determined if all of their supporting fragment ions are missing, which results in the low precision of de novo sequencing.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>In order to solve this problem, we developed pNovo 3, which used a learning-to-rank framework to distinguish similar peptide candidates for each spectrum. Three metrics for measuring the similarity between each experimental spectrum and its corresponding theoretical spectrum were used as important features, in which the theoretical spectra can be precisely predicted by the pDeep algorithm using deep learning. On seven benchmark datasets from six diverse species, pNovo 3 recalled 29\u2013102% more correct spectra, and the precision was 11\u201389% higher than three other state-of-the-art de novo sequencing algorithms. Furthermore, compared with the newly developed DeepNovo, which also used the deep learning approach, pNovo 3 still identified 21\u201350% more spectra on the nine datasets used in the study of DeepNovo. In summary, the deep learning and learning-to-rank techniques implemented in pNovo 3 significantly improve the precision of de novo sequencing, and such machine learning framework is worth extending to other related research fields to distinguish the similar sequences.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>pNovo 3 can be freely downloaded from http:\/\/pfind.ict.ac.cn\/software\/pNovo\/index.html.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Supplementary information<\/jats:title>\n                  <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btz366","type":"journal-article","created":{"date-parts":[[2019,5,10]],"date-time":"2019-05-10T19:22:02Z","timestamp":1557516122000},"page":"i183-i190","source":"Crossref","is-referenced-by-count":93,"title":["pNovo 3: precise <i>de novo<\/i> peptide sequencing using a learning-to-rank framework"],"prefix":"10.1093","volume":"35","author":[{"given":"Hao","family":"Yang","sequence":"first","affiliation":[{"name":"Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing. Technology, Chinese Academy of Sciences, Beijing, China"},{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Chi","sequence":"additional","affiliation":[{"name":"Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing. Technology, Chinese Academy of Sciences, Beijing, China"},{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wen-Feng","family":"Zeng","sequence":"additional","affiliation":[{"name":"Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing. Technology, Chinese Academy of Sciences, Beijing, China"},{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wen-Jing","family":"Zhou","sequence":"additional","affiliation":[{"name":"Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing. Technology, Chinese Academy of Sciences, Beijing, China"},{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Si-Min","family":"He","sequence":"additional","affiliation":[{"name":"Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing. Technology, Chinese Academy of Sciences, Beijing, China"},{"name":"University of Chinese Academy of Sciences, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2019,7,5]]},"reference":[{"key":"2023062712342363900_btz366-B1","first-page":"345","volume-title":"Current Trends in Connectionism","author":"Bartell","year":"1995"},{"key":"2023062712342363900_btz366-B2","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1021\/acsinfecdis.6b00026","article-title":"De novo sequencing and resurrection of a human astrovirus-neutralizing antibody","volume":"2","author":"Bogdanoff","year":"2016","journal-title":"ACS Infect. Dis"},{"key":"2023062712342363900_btz366-B3","doi-asserted-by":"crossref","first-page":"3773","DOI":"10.1021\/acs.jproteome.6b00569","article-title":"Combination of bottom-up 2D-LC-MS and semi-top-down GelFree-LC-MS enhances coverage of proteome and low molecular weight short open reading frame encoded peptides of the archaeon Methanosarcina mazei","volume":"15","author":"Cassidy","year":"2016","journal-title":"J. Proteome Res"},{"key":"2023062712342363900_btz366-B4","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1021\/pr3006843","article-title":"pNovo+: de novo peptide sequencing using complementary HCD and ETD tandem mass spectra","volume":"12","author":"Chi","year":"2013","journal-title":"J. Proteome Res"},{"key":"2023062712342363900_btz366-B5","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.jprot.2015.05.009","article-title":"pFind-Alioth: a novel unrestricted database search algorithm to improve the interpretation of high-resolution MS\/MS data","volume":"125","author":"Chi","year":"2015","journal-title":"J. Proteomics"},{"key":"2023062712342363900_btz366-B6","doi-asserted-by":"crossref","first-page":"1059","DOI":"10.1038\/nbt.4236","article-title":"Comprehensive identification of peptides in tandem mass spectra using an efficient open search engine","volume":"36","author":"Chi","year":"2018","journal-title":"Nat. Biotechnol"},{"key":"2023062712342363900_btz366-B7","doi-asserted-by":"crossref","first-page":"2713","DOI":"10.1021\/pr100182k","article-title":"pNovo: de novo peptide sequencing and identification using HCD spectra","volume":"9","author":"Chi","year":"2010","journal-title":"J. Proteome Res"},{"key":"2023062712342363900_btz366-B8","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1038\/nbt.3267","article-title":"A mass-tolerant database search identifies a large proportion of unassigned spectra in shotgun proteomics as modified peptides","volume":"33","author":"Chick","year":"2015","journal-title":"Nat. Biotechnol"},{"key":"2023062712342363900_btz366-B9","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn"},{"key":"2023062712342363900_btz366-B10","doi-asserted-by":"crossref","first-page":"1367","DOI":"10.1038\/nbt.1511","article-title":"MaxQuant enables high peptide identification rates, individualized p.p.b.-range mass accuracies and proteome-wide protein quantification","volume":"26","author":"Cox","year":"2008","journal-title":"Nat. Biotechnol"},{"key":"2023062712342363900_btz366-B11","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1021\/acs.jproteome.6b00596","article-title":"Proteomic and bioinformatic characterization of extracellular vesicles released from human macrophages upon influenza A virus infection","volume":"16","author":"Cypryk","year":"2017","journal-title":"J. Proteome Res"},{"key":"2023062712342363900_btz366-B12","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1145\/1143844.1143874","volume-title":"Proceedings of the 23rd International Conference on Machine Learning","author":"Davis","year":"2006"},{"key":"2023062712342363900_btz366-B13","doi-asserted-by":"crossref","first-page":"976","DOI":"10.1016\/1044-0305(94)80016-2","article-title":"An approach to correlate tandem mass-spectral data of peptides with amino-acid-sequences in a protein database","volume":"5","author":"Eng","year":"1994","journal-title":"J. Am. Soc. Mass Spectrom"},{"key":"2023062712342363900_btz366-B14","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1021\/ac048788h","article-title":"PepNovo: de novo peptide sequencing via probabilistic network modeling","volume":"77","author":"Frank","year":"2005","journal-title":"Anal. Chem"},{"key":"2023062712342363900_btz366-B15","first-page":"933","article-title":"An efficient boosting algorithm for combining preferences","volume":"4","author":"Freund","year":"2004","journal-title":"J. Mach. Learn. Res"},{"key":"2023062712342363900_btz366-B16","doi-asserted-by":"crossref","first-page":"7783","DOI":"10.1021\/ac051324e","article-title":"De novo sequencing of neuropeptides using reductive isotopic methylation and investigation of ESI QTOF MS\/MS fragmentation pattern of neuropeptides with N-terminal dimethylation","volume":"77","author":"Fu","year":"2005","journal-title":"Anal. Chem"},{"key":"2023062712342363900_btz366-B17","first-page":"273","author":"Graves","year":"2013"},{"key":"2023062712342363900_btz366-B18","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1021\/acs.jproteome.6b00608","article-title":"De novo MS\/MS sequencing of native human antibodies","volume":"16","author":"Guthals","year":"2017","journal-title":"J. Proteome Res"},{"key":"2023062712342363900_btz366-B19","doi-asserted-by":"crossref","first-page":"4203","DOI":"10.1021\/ac303053e","article-title":"Metaproteomics: harnessing the power of high performance mass spectrometry to identify the suite of proteins that control metabolic activities in microbial communities","volume":"85","author":"Hettich","year":"2013","journal-title":"Anal. Chem"},{"key":"2023062712342363900_btz366-B20","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput"},{"key":"2023062712342363900_btz366-B21","doi-asserted-by":"crossref","first-page":"2841","DOI":"10.1021\/acs.jproteome.6b00423","article-title":"Proteome analysis of the hemolymph, mushroom body, and antenna provides novel insight into honeybee resistance against varroa infestation","volume":"15","author":"Hu","year":"2016","journal-title":"J. Proteome Res"},{"key":"2023062712342363900_btz366-B22","author":"Joachims","year":"2002"},{"key":"2023062712342363900_btz366-B23","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/s10994-009-5108-8","article-title":"Cutting-plane training of structural SVMs","volume":"77","author":"Joachims","year":"2009","journal-title":"Mach. Learn"},{"key":"2023062712342363900_btz366-B24","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1021\/acs.jproteome.7b00602","article-title":"Performance evaluation of the Q Exactive HF-X for shotgun proteomics","volume":"17","author":"Kelstrup","year":"2018","journal-title":"J. Proteome Res"},{"key":"2023062712342363900_btz366-B25","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1038\/nmeth.2834","article-title":"Minimal, encapsulated proteomic-sample processing applied to copy-number estimation in eukaryotic cells","volume":"11","author":"Kulak","year":"2014","journal-title":"Nat. Methods"},{"key":"2023062712342363900_btz366-B26","first-page":"904","author":"Liu","year":"2010"},{"key":"2023062712342363900_btz366-B27","doi-asserted-by":"crossref","first-page":"1885","DOI":"10.1007\/s13361-015-1204-0","article-title":"Novor: real-time peptide de novo sequencing software","volume":"26","author":"Ma","year":"2015","journal-title":"J. Am. Soc. Mass Spectrom"},{"key":"2023062712342363900_btz366-B28","doi-asserted-by":"crossref","first-page":"2337","DOI":"10.1002\/rcm.1196","article-title":"PEAKS: powerful software for peptide de novo sequencing by tandem mass spectrometry","volume":"17","author":"Ma","year":"2003","journal-title":"Rapid Commun. Mass Spectrom"},{"key":"2023062712342363900_btz366-B29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/pmic.201600406","article-title":"In-depth characterization of the tomato fruit pericarp proteome","volume":"17","author":"Mata","year":"2017","journal-title":"Proteomics"},{"key":"2023062712342363900_btz366-B30","article-title":"Evaluating de novo sequencing in proteomics: already an accurate alternative to database-driven peptide identification?","author":"Muth","year":"2017","journal-title":"Brief. Bioinform"},{"key":"2023062712342363900_btz366-B31","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1074\/mcp.M116.063867","article-title":"Impact of cystinosin glycosylation on protein stability by differential dynamic stable isotope labeling by amino acids in cell culture (SILAC)","volume":"16","author":"Nevo","year":"2017","journal-title":"Mol. Cell. Proteomics"},{"key":"2023062712342363900_btz366-B32","doi-asserted-by":"crossref","first-page":"4208","DOI":"10.1021\/acs.jproteome.6b00211","article-title":"Label-free proteomic reveals that cowpea severe mosaic virus transiently suppresses the host leaf protein accumulation during the compatible interaction with cowpea (Vigna unguiculata [L.] Walp.)","volume":"15","author":"Paiva","year":"2016","journal-title":"J. Proteome Res"},{"key":"2023062712342363900_btz366-B33","doi-asserted-by":"crossref","first-page":"3551","DOI":"10.1002\/(SICI)1522-2683(19991201)20:18<3551::AID-ELPS3551>3.0.CO;2-2","article-title":"Probability-based protein identification by searching sequence databases using mass spectrometry data","volume":"20","author":"Perkins","year":"1999","journal-title":"Electrophoresis"},{"key":"2023062712342363900_btz366-B34","doi-asserted-by":"crossref","first-page":"16195","DOI":"10.1038\/nmicrobiol.2016.195","article-title":"Chemosynthetic symbionts of marine invertebrate animals are capable of nitrogen fixation","volume":"2","author":"Petersen","year":"2016","journal-title":"Nat. Microbiol"},{"key":"2023062712342363900_btz366-B35","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1006\/ijhc.1987.0321","article-title":"Simplifying decision trees","volume":"51","author":"Quinlan","year":"1999","journal-title":"Int. J. Hum.-Comput. St"},{"key":"2023062712342363900_btz366-B36","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1038\/nbt0905-1073","article-title":"Monoclonal antibody successes in the clinic","volume":"23","author":"Reichert","year":"2005","journal-title":"Nat. Biotechnol"},{"key":"2023062712342363900_btz366-B37","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1101\/gr.215293.116","article-title":"Large-scale reduction of the Bacillus subtilis genome: consequences for the transcriptional network, resource allocation, and metabolism","volume":"27","author":"Reu\u00df","year":"2017","journal-title":"Genome Res"},{"key":"2023062712342363900_btz366-B38","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1021\/acs.jproteome.6b00647","article-title":"Quantitative global proteomics of yeast PBP1 deletion mutants and their stress responses identifies glucose metabolism, mitochondrial, and stress granule changes","volume":"16","author":"Seidel","year":"2017","journal-title":"J. Proteome Res"},{"key":"2023062712342363900_btz366-B39","doi-asserted-by":"crossref","first-page":"1819","DOI":"10.1038\/nn.4160","article-title":"Cell type- and brain region-resolved mouse brain proteome","volume":"18","author":"Sharma","year":"2015","journal-title":"Nat. Neurosci"},{"key":"2023062712342363900_btz366-B40","doi-asserted-by":"crossref","first-page":"484.","DOI":"10.1038\/nature16961","article-title":"Mastering the game of Go with deep neural networks and tree search","volume":"529","author":"Silver","year":"2016","journal-title":"Nature"},{"key":"2023062712342363900_btz366-B41","volume-title":"Interpreting Protein Mass Spectra, A Comprehensive Resource","author":"Snyder","year":"2000"},{"key":"2023062712342363900_btz366-B42","doi-asserted-by":"crossref","first-page":"31730","DOI":"10.1038\/srep31730","article-title":"Complete de novo assembly of monoclonal antibody sequences","volume":"6","author":"Tran","year":"2016","journal-title":"Sci. Rep"},{"key":"2023062712342363900_btz366-B43","author":"Tran","year":"2017"},{"key":"2023062712342363900_btz366-B44","doi-asserted-by":"crossref","first-page":"988","DOI":"10.1109\/72.788640","article-title":"An overview of statistical learning theory","volume":"10","author":"Vapnik","year":"1999","journal-title":"IEEE Trans. Neural Netw"},{"key":"2023062712342363900_btz366-B45","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1021\/acs.jproteome.6b00716","article-title":"Open-pNovo: de Novo peptide sequencing with thousands of protein modifications","volume":"16","author":"Yang","year":"2017","journal-title":"J. Proteome Res"},{"key":"2023062712342363900_btz366-B46","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1021\/acs.jproteome.7b00428","article-title":"pSite: amino acid confidence evaluation for quality control of de novo peptide sequencing and modification site localization","volume":"17","author":"Yang","year":"2018","journal-title":"J. Proteome Res"},{"key":"2023062712342363900_btz366-B47","doi-asserted-by":"crossref","first-page":"M111.010587","DOI":"10.1074\/mcp.M111.010587","article-title":"PEAKS DB: de novo sequencing assisted database search for sensitive and accurate peptide identification","volume":"11","author":"Zhang","year":"2012","journal-title":"Mol. Cell. Proteomics"},{"key":"2023062712342363900_btz366-B48","doi-asserted-by":"crossref","first-page":"12690","DOI":"10.1021\/acs.analchem.7b02566","article-title":"pDeep: predicting MS\/MS spectra of peptides with deep learning","volume":"89","author":"Zhou","year":"2017","journal-title":"Anal. Chem"},{"key":"2023062712342363900_btz366-B49","doi-asserted-by":"crossref","first-page":"1552","DOI":"10.1074\/mcp.M113.031203","article-title":"SpliceVista, a tool for splice variant identification and visualization in shotgun proteomics data","volume":"13","author":"Zhu","year":"2014","journal-title":"Mol. Cell. Proteomics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/35\/14\/i183\/50720445\/bioinformatics_35_14_i183.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/35\/14\/i183\/50720445\/bioinformatics_35_14_i183.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,27]],"date-time":"2023-06-27T12:35:16Z","timestamp":1687869316000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/35\/14\/i183\/5529238"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7]]},"references-count":49,"journal-issue":{"issue":"14","published-print":{"date-parts":[[2019,7,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btz366","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,7]]},"published":{"date-parts":[[2019,7]]}}}