{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T18:30:56Z","timestamp":1783189856765,"version":"3.54.6"},"reference-count":48,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,11,22]],"date-time":"2023-11-22T00:00:00Z","timestamp":1700611200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002701","name":"Ministry of Education","doi-asserted-by":"publisher","award":["2022R1I1A1A01072759"],"award-info":[{"award-number":["2022R1I1A1A01072759"]}],"id":[{"id":"10.13039\/501100002701","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ministry of Oceans and Fisheries in Republic of Korea"},{"name":"National Science Foundation Major Research Instrumentation","award":["2117941"],"award-info":[{"award-number":["2117941"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,11,22]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The rapid growth of uncharacterized enzymes and their functional diversity urge accurate and trustworthy computational functional annotation tools. However, current state-of-the-art models lack trustworthiness on the prediction of the multilabel classification problem with thousands of classes. Here, we demonstrate that a novel evidential deep learning model (named ECPICK) makes trustworthy predictions of enzyme commission (EC) numbers with data-driven domain-relevant evidence, which results in significantly enhanced predictive power and the capability to discover potential new motif sites. ECPICK learns complex sequential patterns of amino acids and their hierarchical structures from 20\u00a0million enzyme data. ECPICK identifies significant amino acids that contribute to the prediction without multiple sequence alignment. Our intensive assessment showed not only outstanding enhancement of predictive performance on the largest databases of Uniprot, Protein Data Bank (PDB) and Kyoto Encyclopedia of Genes and Genomes (KEGG), but also a capability to discover new motif sites in microorganisms. ECPICK is a reliable EC number prediction tool to identify protein functions of an increasing number of uncharacterized enzymes.<\/jats:p>","DOI":"10.1093\/bib\/bbad401","type":"journal-article","created":{"date-parts":[[2023,11,22]],"date-time":"2023-11-22T17:27:25Z","timestamp":1700674045000},"source":"Crossref","is-referenced-by-count":22,"title":["Evidential deep learning for trustworthy prediction of enzyme commission number"],"prefix":"10.1093","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2649-1795","authenticated-orcid":false,"given":"So-Ra","family":"Han","sequence":"first","affiliation":[{"name":"Sun Moon University Department of Life Science and Biochemical Engineering, , Asan, Republic of Korea"},{"name":"SunMoon University Bio Big Data-based Chungnam Smart Clean Research Leader Training Program, , Asan, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2366-9412","authenticated-orcid":false,"given":"Mingyu","family":"Park","sequence":"additional","affiliation":[{"name":"SunMoon University Bio Big Data-based Chungnam Smart Clean Research Leader Training Program, , Asan, Republic of Korea"},{"name":"Sun Moon University Division of Computer Science and Engineering, , Asan, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sai","family":"Kosaraju","sequence":"additional","affiliation":[{"name":"University of Nevada Department of Computer Science, , Las Vegas, NV, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"JeungMin","family":"Lee","sequence":"additional","affiliation":[{"name":"SunMoon University Bio Big Data-based Chungnam Smart Clean Research Leader Training Program, , Asan, Republic of Korea"},{"name":"Sun Moon University Division of Computer Science and Engineering, , Asan, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0089-1002","authenticated-orcid":false,"given":"Hyun","family":"Lee","sequence":"additional","affiliation":[{"name":"SunMoon University Bio Big Data-based Chungnam Smart Clean Research Leader Training Program, , Asan, Republic of Korea"},{"name":"Sun Moon University Division of Computer Science and Engineering, , Asan, Republic of Korea"},{"name":"Genome-based BioIT Convergence Institute , Asan, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun Hyuck","family":"Lee","sequence":"additional","affiliation":[{"name":"Korea Polar Research Institute Research Unit of Cryogenic Novel Material, , Incheon, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8407-5039","authenticated-orcid":false,"given":"Tae-Jin","family":"Oh","sequence":"additional","affiliation":[{"name":"Sun Moon University Department of Life Science and Biochemical Engineering, , Asan, Republic of Korea"},{"name":"SunMoon University Bio Big Data-based Chungnam Smart Clean Research Leader Training Program, , Asan, Republic of Korea"},{"name":"Genome-based BioIT Convergence Institute , Asan, Republic of Korea"},{"name":"Sun Moon University Department of Pharmaceutical Engineering and Biotechnology, , Asan, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9565-9523","authenticated-orcid":false,"given":"Mingon","family":"Kang","sequence":"additional","affiliation":[{"name":"University of Nevada Department of Computer Science, , Las Vegas, NV, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,11,22]]},"reference":[{"key":"2023112212311414900_ref1","doi-asserted-by":"crossref","first-page":"13204","DOI":"10.1002\/anie.201901491","article-title":"The crucial role of methodology development in directed evolution of selective enzymes","volume":"59","author":"Qu","year":"2019","journal-title":"Angew Chemie Int Ed"},{"key":"2023112212311414900_ref2","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1097\/AJP.0b013e318074c986","article-title":"Nature and prevalence of pain in Fabry disease and its response to enzyme replacement therapy\u2014a retrospective analysis from the Fabry Outcome Survey","volume":"23","author":"Hoffmann","year":"2007","journal-title":"Clin J Pain"},{"key":"2023112212311414900_ref3","doi-asserted-by":"crossref","first-page":"50276","DOI":"10.1109\/ACCESS.2020.2979888","article-title":"MF-EFP: predicting multi-functional enzymes function using improved hybrid multi-label classifier","volume":"8","author":"Xiao","year":"2020","journal-title":"IEEE Access"},{"key":"2023112212311414900_ref4"},{"key":"2023112212311414900_ref5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1042\/bse0590001","article-title":"Enzymes: principles and biotechnological applications","volume":"59","author":"Robinson","year":"2015","journal-title":"Essays Biochem"},{"key":"2023112212311414900_ref6","doi-asserted-by":"crossref","first-page":"D480","DOI":"10.1093\/nar\/gkaa1100","article-title":"UniProt: the universal protein knowledgebase in 2021","volume":"49","author":"Consortium","year":"2020","journal-title":"Nucleic Acids Res"},{"key":"2023112212311414900_ref7","doi-asserted-by":"crossref","first-page":"107147","DOI":"10.1016\/j.compbiolchem.2019.107147","article-title":"A deep learning ensemble for function prediction of hypothetical proteins from pathogenic bacterial species","volume":"83","author":"Mishra","year":"2019","journal-title":"Comput Biol Chem"},{"key":"2023112212311414900_ref8","doi-asserted-by":"crossref","first-page":"1475","DOI":"10.1016\/S1359-6446(05)03621-4","article-title":"Beyond annotation transfer by homology: novel protein-function prediction methods to assist drug discovery","volume":"10","author":"Ofran","year":"2005","journal-title":"Drug Discov Today"},{"key":"2023112212311414900_ref9","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1080\/21501203.2019.1614106","article-title":"Current insights into fungal species diversity and perspective on naming the environmental DNA sequences of fungi","volume":"10","author":"Wu","year":"2019","journal-title":"Mycology"},{"key":"2023112212311414900_ref10","doi-asserted-by":"crossref","first-page":"13996","DOI":"10.1073\/pnas.1821905116","article-title":"Deep learning enables high-quality and high-throughput prediction of enzyme commission numbers","volume":"116","author":"Ryu","year":"2019","journal-title":"Proc Natl Acad Sci U S A"},{"key":"2023112212311414900_ref11","first-page":"1","article-title":"DEEPred: automated protein function prediction with multi-task feed-forward deep neural networks","volume":"9","author":"Rifaioglu","year":"2019","journal-title":"Sci Rep"},{"key":"2023112212311414900_ref12","doi-asserted-by":"crossref","first-page":"4583","DOI":"10.1093\/bioinformatics\/btaa536","article-title":"HECNet: a hierarchical approach to enzyme function classification using a siamese triplet network","volume":"36","author":"Memon","year":"2020","journal-title":"Bioinformatics"},{"key":"2023112212311414900_ref13","doi-asserted-by":"crossref","DOI":"10.34133\/research.0153","article-title":"Enzyme commission number prediction and benchmarking with hierarchical dual-core multitask learning framework","volume":"6","author":"Shi","year":"2023","journal-title":"Research"},{"key":"2023112212311414900_ref14","doi-asserted-by":"crossref","first-page":"1358","DOI":"10.1126\/science.adf2465","article-title":"Enzyme function prediction using contrastive learning","volume":"379","author":"Yu","year":"2023","journal-title":"Science"},{"key":"2023112212311414900_ref15","doi-asserted-by":"crossref","first-page":"W291","DOI":"10.1093\/nar\/gkx366","article-title":"COFACTOR: improved protein function prediction by combining structure, sequence and protein\u2013protein interaction information","volume":"45","author":"Zhang","year":"2017","journal-title":"Nucleic Acids Res"},{"key":"2023112212311414900_ref16","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1038\/nmeth.3213","article-title":"The I-TASSER suite: protein structure and function prediction","volume":"12","author":"Yang","year":"2015","journal-title":"Nat Methods"},{"key":"2023112212311414900_ref17","doi-asserted-by":"crossref","first-page":"6226","DOI":"10.1093\/nar\/gkh956","article-title":"EFICAz: a comprehensive approach for accurate genome-scale enzyme function inference","volume":"32","author":"Tian","year":"2004","journal-title":"Nucleic Acids Res"},{"key":"2023112212311414900_ref18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2011\/743782","article-title":"ModEnzA: accurate identification of metabolic enzymes using function specific profile HMMs with optimised discrimination threshold and modified emission probabilities","volume":"2011","author":"Desai","year":"2011","journal-title":"Adv Bioinformatics"},{"key":"2023112212311414900_ref19","doi-asserted-by":"crossref","first-page":"6633","DOI":"10.1093\/nar\/gkg847","article-title":"Enzyme-specific profiles for genome annotation: PRIAM","volume":"31","author":"Claudel-Renard","year":"2003","journal-title":"Nucleic Acids Res"},{"key":"2023112212311414900_ref20","first-page":"1","article-title":"Multi-label prediction of enzyme classes using InterPro signatures","volume":"123","author":"De Ferrari","year":"2010","journal-title":"Mach Learn Syst Biol"},{"key":"2023112212311414900_ref21","article-title":"EnzML: multi-label prediction of enzyme classes using InterPro signatures","volume":"13.1","author":"De Ferrari","year":"2012","journal-title":"BMC Bioinformatics"},{"key":"2023112212311414900_ref22","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1038\/s41592-019-0496-6","article-title":"Machine-learning-guided directed evolution for protein engineering","volume":"16","author":"Yang","year":"2019","journal-title":"Nat Methods"},{"key":"2023112212311414900_ref23","doi-asserted-by":"crossref","first-page":"1758","DOI":"10.1099\/mic.0.027839-0","article-title":"From a consortium sequence to a unified sequence: the Bacillus subtilis 168 reference genome a decade later","volume":"155","author":"Barbe","year":"2009","journal-title":"Microbiology"},{"key":"2023112212311414900_ref24","article-title":"Technologies for trustworthy machine learning: a survey in a socio-technical context","author":"Toreini","year":"2020"},{"key":"2023112212311414900_ref25","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1002\/pro.4172","article-title":"KEGG mapping tools for uncovering hidden features in biological data","volume":"31","author":"Kanehisa","year":"2022","journal-title":"Protein Sci"},{"key":"2023112212311414900_ref26","doi-asserted-by":"crossref","first-page":"4431","DOI":"10.1073\/pnas.1120949109","article-title":"Stoichiometry of proton translocation by respiratory complex I and its mechanistic implications","volume":"109","author":"Wikstr\u00f6m","year":"2012","journal-title":"Proc Natl Acad Sci U S A"},{"key":"2023112212311414900_ref27","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1186\/s13068-018-1106-z","article-title":"Methane-yielding microbial communities processing lactate-rich substrates: a piece of the anaerobic digestion puzzle","volume":"11","author":"Detman","year":"2018","journal-title":"Biotechnol Biofuels"},{"key":"2023112212311414900_ref28","doi-asserted-by":"crossref","first-page":"4035","DOI":"10.1093\/nar\/gki711","article-title":"Genome annotation errors in pathway databases due to semantic ambiguity in partial EC numbers","volume":"33","author":"Green","year":"2005","journal-title":"Nucleic Acids Res"},{"key":"2023112212311414900_ref29","article-title":"The complete genome of Bacillus subtilis: from sequence annotation to data management and analysis","volume":"430.1\u20132","author":"Moszer","year":"1998","journal-title":"FEBS Lett"},{"key":"2023112212311414900_ref30","doi-asserted-by":"crossref","first-page":"1453","DOI":"10.1126\/science.277.5331.1453","article-title":"The complete genome sequence of Escherichia coli K-12","volume":"277","author":"Blattner","year":"1997","journal-title":"Science"},{"key":"2023112212311414900_ref31","doi-asserted-by":"crossref","first-page":"3529","DOI":"10.5897\/AJMR2014.6970","article-title":"Antibacterial and antioxidant potential of polar microorganisms isolated from Antarctic lichen Psoroma sp","volume":"8","author":"Kim","year":"2014","journal-title":"African J Microbiol Res"},{"key":"2023112212311414900_ref32","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1038\/nrd792","article-title":"Cytochrome P450 enzymes in the generation of commercial products","volume":"1","author":"Guengerich","year":"2002","journal-title":"Nat Rev Drug Discov"},{"key":"2023112212311414900_ref33","doi-asserted-by":"crossref","first-page":"932","DOI":"10.1021\/cr9002193","article-title":"Hydrocarbon hydroxylation by cytochrome P450 enzymes","volume":"110","author":"Ortiz De Montellano","year":"2010","journal-title":"Chem Rev"},{"key":"2023112212311414900_ref34","doi-asserted-by":"crossref","first-page":"1472","DOI":"10.4014\/jmb.1706.06013","article-title":"Crystal structure and functional characterization of a cytochrome P450 (BaCYP106A2) from Bacillus sp. PAMC 23377","volume":"27","author":"Kim","year":"2017","journal-title":"J Microbiol Biotechnol"},{"key":"2023112212311414900_ref35","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1002\/cbic.201500524","article-title":"Crystal structure of CYP106A2 in substrate-free and substrate-bound form","volume":"17","author":"Janocha","year":"2016","journal-title":"Chembiochem"},{"key":"2023112212311414900_ref36","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1038\/msb.2011.75","article-title":"Fast, scalable generation of high-quality protein multiple sequence alignments using Clustal Omega","volume":"7","author":"Sievers","year":"2011","journal-title":"Mol Syst Biol"},{"key":"2023112212311414900_ref37","doi-asserted-by":"crossref","DOI":"10.21203\/rs.2.20111\/v1","article-title":"Complete genome sequence analysis of a novel granaticin producer, Streptomyces sp. A1013Y","author":"Zheng","year":"2020"},{"key":"2023112212311414900_ref38","doi-asserted-by":"crossref","DOI":"10.3389\/fmicb.2021.677558","article-title":"Pan-genome of the genus Streptomyces and prioritization of biosynthetic gene clusters with potential to produce antibiotic compounds","volume":"12","author":"Caicedo-Montoya","year":"2021","journal-title":"Front Microbiol"},{"key":"2023112212311414900_ref39","article-title":"Advantages of single-molecule real-time sequencing in high-GC content genomes","volume":"8.7","author":"Shin","year":"2013","journal-title":"PloS One"},{"key":"2023112212311414900_ref40","article-title":"The RAST server: rapid annotations using subsystems technology","volume":"9.1","author":"Aziz","year":"2008","journal-title":"BMC Genomics"},{"key":"2023112212311414900_ref41","article-title":"RASTtk: a modular and extensible implementation of the RAST algorithm for building custom annotation pipelines and annotating batches of genomes","volume":"5.1","author":"Brettin","year":"2015","journal-title":"Sci Rep"},{"key":"2023112212311414900_ref42","doi-asserted-by":"crossref","DOI":"10.1186\/1745-6150-5-31","article-title":"Non-homologous isofunctional enzymes: a systematic analysis of alternative solutions in enzyme evolution","volume":"5","author":"Omelchenko","year":"2010","journal-title":"Biol Direct"},{"key":"2023112212311414900_ref43","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1007\/BF02100114","article-title":"Evolutionary conservation of protein regions in the protonmotive cytochrome b and their possible roles in redox catalysis","volume":"29","author":"Howell","year":"1989","journal-title":"J Mol Evol"},{"key":"2023112212311414900_ref44","doi-asserted-by":"crossref","first-page":"W95","DOI":"10.1093\/nar\/gky418","article-title":"dbCAN2: a meta server for automated carbohydrate-active enzyme annotation","volume":"46","author":"Zhang","year":"2018","journal-title":"Nucleic Acids Res"},{"key":"2023112212311414900_ref45","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1038\/nmeth.1701","article-title":"SignalP 4.0: discriminating signal peptides from transmembrane regions","volume":"8","author":"Petersen","year":"2011","journal-title":"Nat Methods"},{"key":"2023112212311414900_ref46","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1038\/nmeth.3176","article-title":"Fast and sensitive protein alignment using DIAMOND","volume":"12","author":"Buchfink","year":"2015","journal-title":"Nat Methods"},{"key":"2023112212311414900_ref47","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12859-017-1625-9","article-title":"Homology to peptide pattern for annotation of carbohydrate-active enzymes and prediction of function","volume":"18","author":"Busk","year":"2017","journal-title":"BMC Bioinformatics"},{"key":"2023112212311414900_ref48","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13068-018-1294-6","article-title":"Effect of lignin fractions isolated from different biomass sources on cellulose oxidation by fungal lytic polysaccharide monooxygenases","volume":"11","author":"Muraleedharan","year":"2018","journal-title":"Biotechnol Biofuels"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/1\/bbad401\/53678359\/bbad401.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/1\/bbad401\/53678359\/bbad401.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,22]],"date-time":"2023-11-22T17:28:14Z","timestamp":1700674094000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbad401\/7441066"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,22]]},"references-count":48,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,11,22]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbad401","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,1,1]]},"published":{"date-parts":[[2023,11,22]]},"article-number":"bbad401"}}