{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T02:16:06Z","timestamp":1783995366975,"version":"3.55.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T00:00:00Z","timestamp":1630627200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T00:00:00Z","timestamp":1630627200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001537","name":"University of Auckland","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001537","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Nectar Research Cloud"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Cheminform"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The prediction of metabolism and biotransformation pathways of xenobiotics is a highly desired tool in environmental sciences, drug discovery, and (eco)toxicology. Several systems predict single transformation steps or complete pathways as series of parallel and subsequent steps. Their performance is commonly evaluated on the level of a single transformation step. Such an approach cannot account for some specific challenges that are caused by specific properties of biotransformation experiments. That is, missing transformation products in the reference data that occur only in low concentrations, e.g. transient intermediates or higher-generation metabolites. Furthermore, some rule-based prediction systems evaluate the performance only based on the defined set of transformation rules. Therefore, the performance of these models cannot be directly compared. In this paper, we introduce a new evaluation framework that extends the evaluation of biotransformation prediction from single transformations to whole pathways, taking into account multiple generations of metabolites. We introduce a procedure to address transient intermediates and propose a weighted scoring system that acknowledges the uncertainty of higher-generation metabolites. We implemented this framework in enviPath and demonstrate its strict performance metrics on predictions of in vitro biotransformation and degradation of xenobiotics in soil. Our approach is model-agnostic and can be transferred to other prediction systems. It is also capable of revealing knowledge gaps in terms of incompletely defined sets of transformation rules.<\/jats:p>","DOI":"10.1186\/s13321-021-00543-x","type":"journal-article","created":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T08:28:04Z","timestamp":1630657684000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Holistic evaluation of biodegradation pathway prediction: assessing multi-step reactions and intermediate products"],"prefix":"10.1186","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7513-2257","authenticated-orcid":false,"given":"Jason Y. C.","family":"Tam","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tim","family":"Lorsbach","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"Schmidt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J\u00f6rg S.","family":"Wicker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,9,3]]},"reference":[{"key":"543_CR1","unstructured":"Council of European Union: Council regulation (EU) no 1907\/2006. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX%3A02006R1907-20200824. Accessed 31 Aug\u00a02021"},{"issue":"suppl_1","key":"543_CR2","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1093\/nar\/gkj076","volume":"34","author":"LB Ellis","year":"2006","unstructured":"Ellis LB, Roe D, Wackett LP (2006) The university of minnesota biocatalysis\/biodegradation database: the first decade. Nucleic Acids Res 34(suppl_1):517\u2013521","journal-title":"Nucleic Acids Res"},{"key":"543_CR3","unstructured":"enviPath: Benzyl Sulfide. https:\/\/envipath.org\/package\/32de3cf4-e3e6-4168-956e-32fa5ddb0ce1\/pathway\/9508ba2f-26d2-422c-888d-da2de9fe6aca. Accessed 17 May 2021"},{"key":"543_CR4","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1007\/978-3-319-31858-5_5","volume-title":"computational sustainability","author":"J Wicker","year":"2016","unstructured":"Wicker J, Fenner K, Kramer S (2016) A hybrid machine learning and knowledge based approach to limit combinatorial explosion in biodegradation prediction. In: L\u00e4ssig J, Kersting K, Morik K (eds) computational sustainability. Springer, Cham, pp 75\u201397"},{"issue":"6","key":"543_CR5","doi-asserted-by":"publisher","first-page":"814","DOI":"10.1093\/bioinformatics\/btq024","volume":"26","author":"J Wicker","year":"2010","unstructured":"Wicker J, Fenner K, Ellis L, Wackett L, Kramer S (2010) Predicting biodegradation products and pathways: a hybrid knowledge- and machine learning-based approach. Bioinformatics 26(6):814\u2013821","journal-title":"Bioinformatics"},{"issue":"D1","key":"543_CR6","doi-asserted-by":"publisher","first-page":"502","DOI":"10.1093\/nar\/gkv1229","volume":"44","author":"J Wicker","year":"2016","unstructured":"Wicker J, Lorsbach T, G\u00fctlein M, Schmid E, Latino D, Kramer S, Fenner K (2016) envipath-the environmental contaminant biotransformation pathway resource. Nucleic acids Res 44(D1):502\u2013508","journal-title":"Nucleic acids Res"},{"issue":"3","key":"543_CR7","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1039\/C6EM00697C","volume":"19","author":"DA Latino","year":"2017","unstructured":"Latino DA, Wicker J, G\u00fctlein M, Schmid E, Kramer S, Fenner K (2017) Eawag-soil in envipath: a new resource for exploring regulatory pesticide soil biodegradation pathways and half-life data. Environ Sci Process Impacts 19(3):449\u2013464","journal-title":"Environ Sci Process Impacts"},{"issue":"10","key":"543_CR8","doi-asserted-by":"publisher","first-page":"501","DOI":"10.1016\/j.tibtech.2010.07.002","volume":"28","author":"KC Soh","year":"2010","unstructured":"Soh KC, Hatzimanikatis V (2010) Dreams of metabolism. Trends Biotechnol 28(10):501\u2013508","journal-title":"Trends Biotechnol"},{"issue":"2\u20133","key":"543_CR9","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1080\/10629369908039182","volume":"10","author":"N Greene","year":"1999","unstructured":"Greene N, Judson P, Langowski J, Marchant C (1999) Knowledge-based expert systems for toxicity and metabolism prediction: Derek, star and meteor. SAR and QSAR Environ Res 10(2\u20133):299\u2013314","journal-title":"SAR and QSAR Environ Res"},{"issue":"5","key":"543_CR10","doi-asserted-by":"publisher","first-page":"1356","DOI":"10.1021\/ci020271o","volume":"43","author":"PN Judson","year":"2003","unstructured":"Judson PN, Vessey JD (2003) A comprehensive approach to argumentation. J Chem Inf Comput Sci 43(5):1356\u20131363","journal-title":"J Chem Inf Comput Sci"},{"issue":"5","key":"543_CR11","doi-asserted-by":"publisher","first-page":"1364","DOI":"10.1021\/ci020272g","volume":"43","author":"PN Judson","year":"2003","unstructured":"Judson PN, Marchant CA, Vessey JD (2003) Using argumentation for absolute reasoning about the potential toxicity of chemicals. J Chem Inf Comput Sci 43(5):1364\u20131370","journal-title":"J Chem Inf Comput Sci"},{"issue":"suppl_2","key":"543_CR12","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1093\/nar\/gkq318","volume":"38","author":"Y Moriya","year":"2010","unstructured":"Moriya Y, Shigemizu D, Hattori M, Tokimatsu T, Kotera M, Goto S, Kanehisa M (2010) Pathpred: an enzyme-catalyzed metabolic pathway prediction server. Nucleic Acids Res 38(suppl_2):138\u2013143","journal-title":"Nucleic Acids Res"},{"issue":"suppl_1","key":"543_CR13","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1093\/nar\/gkp896","volume":"38","author":"M Kanehisa","year":"2010","unstructured":"Kanehisa M, Goto S, Furumichi M, Tanabe M, Hirakawa M (2010) Kegg for representation and analysis of molecular networks involving diseases and drugs. Nucleic acids research 38(suppl_1):355\u2013360","journal-title":"Nucleic acids research"},{"issue":"50","key":"543_CR14","doi-asserted-by":"publisher","first-page":"16487","DOI":"10.1021\/ja0466457","volume":"126","author":"M Kotera","year":"2004","unstructured":"Kotera M, Okuno Y, Hattori M, Goto S, Kanehisa M (2004) Computational assignment of the ec numbers for genomic-scale analysis of enzymatic reactions. J Am Chem Soc 126(50):16487\u201316498","journal-title":"J Am Chem Soc"},{"issue":"18","key":"543_CR15","doi-asserted-by":"publisher","first-page":"2079","DOI":"10.1093\/bioinformatics\/btn378","volume":"24","author":"K Fenner","year":"2008","unstructured":"Fenner K, Gao J, Kramer S, Ellis L, Wackett L (2008) Data-driven extraction of relative reasoning rules to limit combinatorial explosion in biodegradation pathway prediction. Bioinformatics 24(18):2079\u20132085","journal-title":"Bioinformatics"},{"issue":"1","key":"543_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13321-018-0324-5","volume":"11","author":"Y Djoumbou-Feunang","year":"2019","unstructured":"Djoumbou-Feunang Y, Fiamoncini J, Gil-de-la-Fuente A, Greiner R, Manach C, Wishart DS (2019) Biotransformer: a comprehensive computational tool for small molecule metabolism prediction and metabolite identification. J Cheminform 11(1):1\u201325","journal-title":"J Cheminform"},{"issue":"5\u20136","key":"543_CR17","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1080\/1062936X.2012.679689","volume":"23","author":"O Mekenyan","year":"2012","unstructured":"Mekenyan O, Dimitrov S, Pavlov T, Dimitrova G, Todorov M, Petkov P, Kotov S (2012) Simulation of chemical metabolism for fate and hazard assessment. v. mammalian hazard assessment. SAR and QSAR Environm Res 23(5\u20136):553\u2013606","journal-title":"SAR and QSAR Environm Res"},{"issue":"1","key":"543_CR18","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1016\/j.yrtph.2012.02.013","volume":"63","author":"RC Kolanczyk","year":"2012","unstructured":"Kolanczyk RC, Schmieder P, Jones WJ, Mekenyan OG, Chapkanov A, Temelkov S, Kotov S, Velikova M, Kamenska V, Vasilev K et al (2012) Metapath: an electronic knowledge base for collating, exchanging and analyzing case studies of xenobiotic metabolism. Regul Toxicol Pharmacol 63(1):84\u201396","journal-title":"Regul Toxicol Pharmacol"},{"key":"543_CR19","unstructured":"Zhang M, Chen Y (2018) Link prediction based on graph neural networks. In:\u00a0Annual conference on neural information processing systems, NeurIPS 2018.\u00a0Advances in Neural Information Processing Systems, pp. 5165\u20135175"},{"issue":"9","key":"543_CR20","doi-asserted-by":"publisher","first-page":"3564","DOI":"10.1021\/acs.chemmater.9b01294","volume":"31","author":"C Chen","year":"2019","unstructured":"Chen C, Ye W, Zuo Y, Zheng C, Ong SP (2019) Graph networks as a universal machine learning framework for molecules and crystals. Chem Mater 31(9):3564\u20133572","journal-title":"Chem Mater"},{"issue":"2","key":"543_CR21","doi-asserted-by":"publisher","first-page":"370","DOI":"10.1039\/C8SC04228D","volume":"10","author":"CW Coley","year":"2019","unstructured":"Coley CW, Jin W, Rogers L, Jamison TF, Jaakkola TS, Green WH, Barzilay R, Jensen KF (2019) A graph-convolutional neural network model for the prediction of chemical reactivity. Chem Sci 10(2):370\u2013377","journal-title":"Chem Sci"},{"key":"543_CR22","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1109\/TSMC.1983.6313167","volume":"3","author":"A Sanfeliu","year":"1983","unstructured":"Sanfeliu A, Fu K-S (1983) A distance measure between attributed relational graphs for pattern recognition. IEEE Trans Syst Man Cybern 3:353\u2013362","journal-title":"IEEE Trans Syst Man Cybern"},{"key":"543_CR23","doi-asserted-by":"crossref","unstructured":"Wicker J, Pfahringer B, Kramer S (2012) Multi-label classification using boolean matrix decomposition. In: Proceedings of the 27th annual ACM symposium on applied computing, pp 179\u2013186","DOI":"10.1145\/2245276.2245311"},{"issue":"5","key":"543_CR24","doi-asserted-by":"publisher","first-page":"742","DOI":"10.1021\/ci100050t","volume":"50","author":"D Rogers","year":"2010","unstructured":"Rogers D, Hahn M (2010) Extended-connectivity fingerprints. J Chem Inf Model 50(5):742\u2013754","journal-title":"J Chem Inf Model"},{"issue":"6","key":"543_CR25","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1002\/qsar.200290002","volume":"21","author":"M Ashton","year":"2002","unstructured":"Ashton M, Barnard J, Casset F, Charlton M, Downs G, Gorse D, Holliday J, Lahana R, Willett P (2002) Identification of diverse database subsets using property-based and fragment-based molecular descriptions. Quant Struct Activity Relationships 21(6):598\u2013604","journal-title":"Quant Struct Activity Relationships"},{"key":"543_CR26","unstructured":"enviPath: 1,1,1-Trichloroethane. https:\/\/envipath.org\/package\/32de3cf4-e3e6-4168-956e-32fa5ddb0ce1\/pathway\/f1aa12e8-f2be-4f22-918a-b3a2a13170d1. Accessed 17 May 2021"},{"key":"543_CR27","unstructured":"enviPath: EAWAG-BBD Package on enviPath. https:\/\/envipath.org\/package\/32de3cf4-e3e6-4168-956e-32fa5ddb0ce1. Accessed 17 May 2021"},{"key":"543_CR28","unstructured":"enviPath: EAWAG-SOIL Package on enviPath. https:\/\/envipath.org\/package\/5882df9c-dae1-4d80-a40e-db4724271456. Accessed 17 May 2021"},{"key":"543_CR29","unstructured":"enviPath: enviPath. https:\/\/envipath.org\/. Accessed 17 May 2021"},{"key":"543_CR30","unstructured":"enviPath: enviPath Github repository. https:\/\/github.com\/enviPath\/mg-evaluation. Accessed 17 May 2021"}],"container-title":["Journal of Cheminformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13321-021-00543-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13321-021-00543-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13321-021-00543-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T08:41:26Z","timestamp":1630658486000},"score":1,"resource":{"primary":{"URL":"https:\/\/jcheminf.biomedcentral.com\/articles\/10.1186\/s13321-021-00543-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,3]]},"references-count":30,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["543"],"URL":"https:\/\/doi.org\/10.1186\/s13321-021-00543-x","relation":{"has-preprint":[{"id-type":"doi","id":"10.26434\/chemrxiv.14315963.v1","asserted-by":"object"},{"id-type":"doi","id":"10.26434\/chemrxiv.14315963.v2","asserted-by":"object"}]},"ISSN":["1758-2946"],"issn-type":[{"value":"1758-2946","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,3]]},"assertion":[{"value":"30 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 August 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 September 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"J\u00f6rg Wicker is one of the founders of enviPath UG & Co. KG, a scientific software development company that develops and maintains enviPath. J\u00f6rg Wicker, Tim Lorsbach, and Jason Tam are employees of enviPath UG & Co. KG. Sebastian Schmidt is an employee of Bayer AG, a manufacturer of pharmaceutical, agricultural, and consumer health chemicals. The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"63"}}