{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T07:00:49Z","timestamp":1770274849480,"version":"3.49.0"},"reference-count":40,"publisher":"Oxford University Press (OUP)","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016,1,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Motivation: Protein phosphorylation is a post-translational modification that underlines various aspects of cellular signaling. A key step to reconstructing signaling networks involves identification of the set of all kinases and their substrates. Experimental characterization of kinase substrates is both expensive and time-consuming. To expedite the discovery of novel substrates, computational approaches based on kinase recognition sequence (motifs) from known substrates, protein structure, interaction and co-localization have been proposed. However, rarely do these methods take into account the dynamic responses of signaling cascades measured from in vivo cellular systems. Given that recent advances in mass spectrometry-based technologies make it possible to quantify phosphorylation on a proteome-wide scale, computational approaches that can integrate static features with dynamic phosphoproteome data would greatly facilitate the prediction of biologically relevant kinase-specific substrates.<\/jats:p>\n               <jats:p>Results: Here, we propose a positive-unlabeled ensemble learning approach that integrates dynamic phosphoproteomics data with static kinase recognition motifs to predict novel substrates for kinases of interest. We extended a positive-unlabeled learning technique for an ensemble model, which significantly improves prediction sensitivity on novel substrates of kinases while retaining high specificity. We evaluated the performance of the proposed model using simulation studies and subsequently applied it to predict novel substrates of key kinases relevant to insulin signaling. Our analyses show that static sequence motifs and dynamic phosphoproteomics data are complementary and that the proposed integrated model performs better than methods relying only on static information for accurate prediction of kinase-specific substrates.<\/jats:p>\n               <jats:p>Availability and implementation: Executable GUI tool, source code and documentation are freely available at https:\/\/github.com\/PengyiYang\/KSP-PUEL.<\/jats:p>\n               <jats:p>Contact: \u00a0pengyi.yang@nih.gov or jothi@mail.nih.gov<\/jats:p>\n               <jats:p>Supplementary information: \u00a0Supplementary data are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/btv550","type":"journal-article","created":{"date-parts":[[2015,9,23]],"date-time":"2015-09-23T01:59:09Z","timestamp":1442973549000},"page":"252-259","source":"Crossref","is-referenced-by-count":34,"title":["Positive-unlabeled ensemble learning for kinase substrate prediction from dynamic phosphoproteomics data"],"prefix":"10.1093","volume":"32","author":[{"given":"Pengyi","family":"Yang","sequence":"first","affiliation":[{"name":"1 Systems Biology Section,"},{"name":"2 Epigenetics & Stem Cell Biology Laboratory, National Institute of Environmental Health Sciences, National Institutes of Health, RTP, NC 27709, USA,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sean J.","family":"Humphrey","sequence":"additional","affiliation":[{"name":"3 Department of Proteomics and Signal Transduction, Max-Planck-Institute of Biochemistry, Martinsried, Germany,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David E.","family":"James","sequence":"additional","affiliation":[{"name":"4 Charles Perkins Centre, School of Molecular Bioscience, Sydney Medical School and"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yee Hwa","family":"Yang","sequence":"additional","affiliation":[{"name":"5 School of Mathematics and Statistics, The University of Sydney, NSW 2006, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raja","family":"Jothi","sequence":"additional","affiliation":[{"name":"1 Systems Biology Section,"},{"name":"2 Epigenetics & Stem Cell Biology Laboratory, National Institute of Environmental Health Sciences, National Institutes of Health, RTP, NC 27709, USA,"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2015,9,22]]},"reference":[{"key":"2023020110281583800_btv550-B1","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1038\/nbt0307-285","article-title":"A curated compendium of phosphorylation motifs","volume":"25","author":"Amanchy","year":"2007","journal-title":"Nat. Biotechnol."},{"key":"2023020110281583800_btv550-B2","first-page":"27","article-title":"LibSVM: a library for support vector machines","volume":"2","author":"Chang","year":"2011","journal-title":"ACM Trans. Intell. Syst. Technol. (TIST)"},{"key":"2023020110281583800_btv550-B3","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1038\/nrm2900","article-title":"Decoding signalling networks by mass spectrometry-based proteomics","volume":"11","author":"Choudhary","year":"2010","journal-title":"Nat. Rev. Mol. Cell Biol."},{"key":"2023020110281583800_btv550-B4","doi-asserted-by":"crossref","first-page":"2857","DOI":"10.1093\/bioinformatics\/btn546","article-title":"Prediction of kinase-specific phosphorylation sites using conditional random fields","volume":"24","author":"Dang","year":"2008","journal-title":"Bioinformatics"},{"key":"2023020110281583800_btv550-B5","doi-asserted-by":"crossref","first-page":"D261","DOI":"10.1093\/nar\/gkq1104","article-title":"Phospho. elm: a database of phosphorylation sitesupdate 2011","volume":"39","author":"Dinkel","year":"2011","journal-title":"Nucleic Acids Res."},{"key":"2023020110281583800_btv550-B6","doi-asserted-by":"crossref","DOI":"10.1145\/1401890.1401920","article-title":"Learning classifiers from only positive and unlabeled data","author":"Elkan","year":"2008"},{"key":"2023020110281583800_btv550-B7","doi-asserted-by":"crossref","first-page":"1241","DOI":"10.1021\/ac503934f","article-title":"Evaluating multiplexed quantitative phosphopeptide analysis on a hybrid quadrupole mass filter\/linear ion trap\/orbitrap mass spectrometer","volume":"87","author":"Erickson","year":"2014","journal-title":"Anal. Chem."},{"key":"2023020110281583800_btv550-B8","doi-asserted-by":"crossref","first-page":"2586","DOI":"10.1074\/mcp.M110.001388","article-title":"Musite, a tool for global prediction of general and kinase-specific phosphorylation sites","volume":"9","author":"Gao","year":"2010","journal-title":"Mol. Cell. Proteomics"},{"key":"2023020110281583800_btv550-B9","doi-asserted-by":"crossref","DOI":"10.1007\/0-387-29362-0","volume-title":"Bioinformatics and Computational Biology Solutions Using R and Bioconductor","author":"Gentleman","year":"2005"},{"key":"2023020110281583800_btv550-B10","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1021\/pr0341033","article-title":"Identification of phosphorylation sites in protein kinase A substrates using artificial neural networks and mass spectrometry","volume":"3","author":"Hjerrild","year":"2004","journal-title":"J. Proteome Res."},{"key":"2023020110281583800_btv550-B11","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1038\/nmeth.2968","article-title":"Kinomexplorer: an integrated platform for kinome biology studies","volume":"11","author":"Horn","year":"2014","journal-title":"Nat. Methods"},{"key":"2023020110281583800_btv550-B12","doi-asserted-by":"crossref","first-page":"D261","DOI":"10.1093\/nar\/gkr1122","article-title":"PhosphoSitePlus: a comprehensive resource for investigating the structure and function of experimentally determined post-translational modifications in man and mouse","volume":"40","author":"Hornbeck","year":"2011","journal-title":"Nucleic Acids Res."},{"key":"2023020110281583800_btv550-B13","doi-asserted-by":"crossref","first-page":"W226","DOI":"10.1093\/nar\/gki471","article-title":"Kinasephos: a web tool for identifying protein kinase-specific phosphorylation sites","volume":"33","author":"Huang","year":"2005","journal-title":"Nucleic Acids Res."},{"key":"2023020110281583800_btv550-B14","doi-asserted-by":"crossref","first-page":"990","DOI":"10.1038\/nbt.3327","article-title":"High-throughput phosphoproteomics reveals in vivo insulin signaling dynamics","volume":"33","author":"Humphrey","year":"2015","journal-title":"Nat. Biotechnol"},{"key":"2023020110281583800_btv550-B15","doi-asserted-by":"crossref","first-page":"pe20","DOI":"10.1126\/scisignal.2003085","article-title":"Uncaging akt","volume":"5","author":"Humphrey","year":"2012","journal-title":"Sci. Signal."},{"key":"2023020110281583800_btv550-B16","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1016\/j.cmet.2013.04.010","article-title":"Dynamic adipocyte phosphoproteome reveals that akt directly regulates mtorc2","volume":"17","author":"Humphrey","year":"2013","journal-title":"Cell Metab."},{"key":"2023020110281583800_btv550-B17","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/0092-8674(95)90405-0","article-title":"Protein kinases and phosphatases: the yin and yang of protein phosphorylation and signaling","volume":"80","author":"Hunter","year":"1995","journal-title":"Cell"},{"key":"2023020110281583800_btv550-B18","doi-asserted-by":"crossref","first-page":"3179","DOI":"10.1093\/bioinformatics\/bth382","article-title":"Prediction of phosphorylation sites using SVMs","volume":"20","author":"Kim","year":"2004","journal-title":"Bioinformatics"},{"key":"2023020110281583800_btv550-B19","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1016\/j.cell.2012.03.017","article-title":"mTor signaling in growth control and disease","volume":"149","author":"Laplante","year":"2012","journal-title":"Cell"},{"key":"2023020110281583800_btv550-B20","doi-asserted-by":"crossref","first-page":"1117","DOI":"10.1016\/j.cell.2010.06.011","article-title":"Cell signaling by receptor tyrosine kinases","volume":"141","author":"Lemmon","year":"2010","journal-title":"Cell"},{"key":"2023020110281583800_btv550-B21","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/3-540-40992-0_6","article-title":"Learning from positive and unlabeled examples","volume-title":"Algorithmic Learning Theory","author":"Letouzey","year":"2000"},{"key":"2023020110281583800_btv550-B22","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1016\/j.cell.2007.05.052","article-title":"Systematic discovery of in vivo phosphorylation networks","volume":"129","author":"Linding","year":"2007","journal-title":"Cell"},{"key":"2023020110281583800_btv550-B23","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1007\/978-1-60327-834-8_22","article-title":"Kinase-specific prediction of protein phosphorylation sites","volume-title":"Phospho-Proteomics","author":"Miller","year":"2009"},{"key":"2023020110281583800_btv550-B24","doi-asserted-by":"crossref","first-page":"ra2","DOI":"10.1126\/scisignal.1159433","article-title":"Linear motif atlas for phosphorylation-dependent signaling","volume":"1","author":"Miller","year":"2008","journal-title":"Sci. Signal."},{"key":"2023020110281583800_btv550-B25","doi-asserted-by":"crossref","first-page":"3635","DOI":"10.1093\/nar\/gkg584","article-title":"Scansite 2.0: proteome-wide prediction of cell signaling interactions using short sequence motifs","volume":"31","author":"Obenauer","year":"2003","journal-title":"Nucleic Acids Res."},{"key":"2023020110281583800_btv550-B26","doi-asserted-by":"crossref","first-page":"rs4","DOI":"10.1126\/scisignal.2005768","article-title":"Dynamic phosphoproteomics reveals torc1-dependent regulation of yeast nucleotide and amino acid biosynthesis","volume":"8","author":"Oliveira","year":"2015","journal-title":"Sci. Signal."},{"key":"2023020110281583800_btv550-B27","doi-asserted-by":"crossref","first-page":"3444","DOI":"10.1074\/mcp.O113.034181","article-title":"Status of large-scale analysis of post-translational modifications by mass spectrometry","volume":"12","author":"Olsen","year":"2013","journal-title":"Mol. Cell. Proteomics"},{"key":"2023020110281583800_btv550-B28","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1016\/j.cell.2006.09.026","article-title":"Global, in vivo, and site-specific phosphorylation dynamics in signaling networks","volume":"127","author":"Olsen","year":"2006","journal-title":"Cell"},{"key":"2023020110281583800_btv550-B29","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1016\/j.copbio.2011.11.014","article-title":"Mass spectrometry-based proteomics for systems biology","volume":"23","author":"Sabido","year":"2012","journal-title":"Curr. Opin. Biotechnol."},{"key":"2023020110281583800_btv550-B30","doi-asserted-by":"crossref","first-page":"1070","DOI":"10.1074\/mcp.M111.012625","article-title":"Systematic analysis of protein phosphorylation networks from phosphoproteomic data","volume":"11","author":"Song","year":"2012","journal-title":"Mol. Cell. Proteomics"},{"key":"2023020110281583800_btv550-B31","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1109\/TSMCB.2008.2002909","article-title":"SVMs modeling for highly imbalanced classification","volume":"39","author":"Tang","year":"2009","journal-title":"IEEE Trans. Syst. Man Cybern. B Cybern."},{"key":"2023020110281583800_btv550-B32","doi-asserted-by":"crossref","first-page":"W281","DOI":"10.1093\/nar\/gks469","article-title":"Seq2logo: a method for construction and visualization of amino acid binding motifs and sequence profiles including sequence weighting, pseudo counts and two-sided representation of amino acid enrichment and depletion","volume":"40","author":"Thomsen","year":"2012","journal-title":"Nucleic Acids Res."},{"key":"2023020110281583800_btv550-B33","doi-asserted-by":"crossref","first-page":"2927","DOI":"10.1093\/bioinformatics\/btr525","article-title":"Computational prediction of eukaryotic phosphorylation sites","volume":"27","author":"Trost","year":"2011","journal-title":"Bioinformatics"},{"key":"2023020110281583800_btv550-B34","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1093\/bioinformatics\/btt031","article-title":"Computational phosphorylation site prediction in plants using random forests and organism-specific instance weights","volume":"29","author":"Trost","year":"2013","journal-title":"Bioinformatics"},{"key":"2023020110281583800_btv550-B35","doi-asserted-by":"crossref","first-page":"W588","DOI":"10.1093\/nar\/gkm322","article-title":"Kinasephos 2.0: a web server for identifying protein kinase-specific phosphorylation sites based on sequences and coupling patterns","volume":"35","author":"Wong","year":"2007","journal-title":"Nucleic Acids Res."},{"key":"2023020110281583800_btv550-B36","doi-asserted-by":"crossref","first-page":"1598","DOI":"10.1074\/mcp.M700574-MCP200","article-title":"Gps 2.0, a tool to predict kinase-specific phosphorylation sites in hierarchy","volume":"7","author":"Xue","year":"2008","journal-title":"Mol. Cell. Proteomics"},{"key":"2023020110281583800_btv550-B37","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1093\/protein\/gzq094","article-title":"Gps 2.1: enhanced prediction of kinase-specific phosphorylation sites with an algorithm of motif length selection","volume":"24","author":"Xue","year":"2010","journal-title":"Protein Eng. Des. Sel"},{"key":"2023020110281583800_btv550-B38","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1038\/86737","article-title":"A motif-based profile scanning approach for genome-wide prediction of signaling pathways","volume":"19","author":"Yaffe","year":"2001","journal-title":"Nat. Biotechnol."},{"key":"2023020110281583800_btv550-B39","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1109\/TCYB.2013.2257480","article-title":"Sample subset optimization techniques for imbalanced and ensemble learning problems in bioinformatics applications","volume":"44","author":"Yang","year":"2014","journal-title":"IEEE Trans. Cybern."},{"key":"2023020110281583800_btv550-B40","doi-asserted-by":"crossref","first-page":"e1004403","DOI":"10.1371\/journal.pcbi.1004403","article-title":"Knowledge-based analysis for detecting key signaling events from time-series phosphoproteomics data","volume":"11","author":"Yang","year":"2015","journal-title":"PLoS Comput. Biol."}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/32\/2\/252\/49016333\/bioinformatics_32_2_252.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/32\/2\/252\/49016333\/bioinformatics_32_2_252.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,1]],"date-time":"2023-02-01T21:36:08Z","timestamp":1675287368000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/32\/2\/252\/1743815"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,9,22]]},"references-count":40,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2016,1,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btv550","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2016,1,15]]},"published":{"date-parts":[[2015,9,22]]}}}