{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T15:11:26Z","timestamp":1778166686392,"version":"3.51.4"},"reference-count":38,"publisher":"Oxford University Press (OUP)","issue":"13","license":[{"start":{"date-parts":[[2023,5,16]],"date-time":"2023-05-16T00:00:00Z","timestamp":1684195200000},"content-version":"vor","delay-in-days":1784,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002341","name":"Academy of Finland","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Finnish Center of Excellence in Computational Inference Research COIN","award":["295503"],"award-info":[{"award-number":["295503"]}]},{"name":"Finnish Center of Excellence in Computational Inference Research COIN","award":["294238"],"award-info":[{"award-number":["294238"]}]},{"name":"Finnish Center of Excellence in Computational Inference Research COIN","award":["292334"],"award-info":[{"award-number":["292334"]}]},{"name":"Finnish Center of Excellence in Computational Inference Research COIN","award":["284642"],"award-info":[{"award-number":["284642"]}]},{"name":"Finnish Center of Excellence in Computational Inference Research COIN","award":["305780"],"award-info":[{"award-number":["305780"]}]},{"name":"Finnish Center of Excellence in Computational Inference Research COIN","award":["286607"],"award-info":[{"award-number":["286607"]}]},{"name":"Finnish Center of Excellence in Computational Inference Research COIN","award":["294015"],"award-info":[{"award-number":["294015"]}]},{"DOI":"10.13039\/501100004022","name":"Jenny and Antti Wihuri Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004022","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008969","name":"Alfred Kordelin Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008969","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Motivation<\/jats:title><jats:p>Precision medicine requires the ability to predict the efficacies of different treatments for a given individual using high-dimensional genomic measurements. However, identifying predictive features remains a challenge when the sample size is small. Incorporating expert knowledge offers a promising approach to improve predictions, but collecting such knowledge is laborious if the number of candidate features is very large.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We introduce a probabilistic framework to incorporate expert feedback about the impact of genomic measurements on the outcome of interest and present a novel approach to collect the feedback efficiently, based on Bayesian experimental design. The new approach outperformed other recent alternatives in two medical applications: prediction of metabolic traits and prediction of sensitivity of cancer cells to different drugs, both using genomic features as predictors. Furthermore, the intelligent approach to collect feedback reduced the workload of the expert to approximately 11%, compared to a baseline approach.<\/jats:p><\/jats:sec><jats:sec><jats:title>Availability and implementation<\/jats:title><jats:p>Source code implementing the introduced computational methods is freely available at https:\/\/github.com\/AaltoPML\/knowledge-elicitation-for-precision-medicine.<\/jats:p><\/jats:sec><jats:sec><jats:title>Supplementary information<\/jats:title><jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p><\/jats:sec>","DOI":"10.1093\/bioinformatics\/bty257","type":"journal-article","created":{"date-parts":[[2018,4,13]],"date-time":"2018-04-13T06:58:15Z","timestamp":1523602695000},"page":"i395-i403","source":"Crossref","is-referenced-by-count":9,"title":["Improving genomics-based predictions for precision medicine through active elicitation of expert knowledge"],"prefix":"10.1093","volume":"34","author":[{"given":"Iiris","family":"Sundin","sequence":"first","affiliation":[{"name":"Department of Computer Science, Helsinki Institute for Information Technology HIIT, Aalto University, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tomi","family":"Peltola","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Helsinki Institute for Information Technology HIIT, Aalto University, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luana","family":"Micallef","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Helsinki Institute for Information Technology HIIT, Aalto University, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Homayun","family":"Afrabandpey","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Helsinki Institute for Information Technology HIIT, Aalto University, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marta","family":"Soare","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Helsinki Institute for Information Technology HIIT, Aalto University, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muntasir","family":"Mamun Majumder","sequence":"additional","affiliation":[{"name":"Institute for Molecular Medicine Finland FIMM, Helsinki Institute of Life Science, University of Helsinki, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pedram","family":"Daee","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Helsinki Institute for Information Technology HIIT, Aalto University, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chen","family":"He","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Helsinki Institute for Information Technology HIIT, University of Helsinki, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Baris","family":"Serim","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Helsinki Institute for Information Technology HIIT, University of Helsinki, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aki","family":"Havulinna","sequence":"additional","affiliation":[{"name":"Institute for Molecular Medicine Finland FIMM, Helsinki Institute of Life Science, University of Helsinki, Helsinki, Finland"},{"name":"National Institute for Health and Welfare THL, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Caroline","family":"Heckman","sequence":"additional","affiliation":[{"name":"Institute for Molecular Medicine Finland FIMM, Helsinki Institute of Life Science, University of Helsinki, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giulio","family":"Jacucci","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Helsinki Institute for Information Technology HIIT, University of Helsinki, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pekka","family":"Marttinen","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Helsinki Institute for Information Technology HIIT, Aalto University, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Samuel","family":"Kaski","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Helsinki Institute for Information Technology HIIT, Aalto University, Helsinki, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2018,6,27]]},"reference":[{"key":"2023051604252592700_bty257-B1","first-page":"265","author":"Afrabandpey","year":"2017"},{"key":"2023051604252592700_bty257-B2","doi-asserted-by":"crossref","first-page":"i455","DOI":"10.1093\/bioinformatics\/btw433","article-title":"Drug response prediction by inferring pathway-response associations with kernelized Bayesian matrix factorization","volume":"32","author":"Ammad-Ud Din","year":"2016","journal-title":"Bioinformatics"},{"key":"2023051604252592700_bty257-B3","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1007\/978-3-540-87987-9_27","volume-title":"International Conference on Algorithmic Learning Theory","author":"Balcan","year":"2008"},{"key":"2023051604252592700_bty257-B4","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1093\/eurpub\/cku174","article-title":"Forty-year trends in cardiovascular risk factors in Finland","volume":"25","author":"Borodulin","year":"2015","journal-title":"Eur. J. Public Health"},{"key":"2023051604252592700_bty257-B5","doi-asserted-by":"crossref","first-page":"1382","DOI":"10.1109\/TSMCB.2011.2148197","article-title":"A method for integrating expert knowledge when learning Bayesian networks from data","volume":"41","author":"Cano","year":"2011","journal-title":"IEEE Trans Syst Man Cybern B Cybern"},{"key":"2023051604252592700_bty257-B6","doi-asserted-by":"crossref","first-page":"1202","DOI":"10.1038\/nbt.2877","article-title":"A community effort to assess and improve drug sensitivity prediction algorithms","volume":"32","author":"Costello","year":"2014","journal-title":"Nat. Biotechnol"},{"key":"2023051604252592700_bty257-B7","doi-asserted-by":"crossref","first-page":"1599","DOI":"10.1007\/s10994-017-5651-7","article-title":"Knowledge elicitation via sequential probabilistic inference for high-dimensional prediction","volume":"106","author":"Daee","year":"2017","journal-title":"Mach. Learn"},{"key":"2023051604252592700_bty257-B8","doi-asserted-by":"crossref","first-page":"77.","DOI":"10.3390\/a9040077","article-title":"Algorithms for drug sensitivity prediction","volume":"9","author":"De Niz","year":"2016","journal-title":"Algorithms"},{"key":"2023051604252592700_bty257-B9","first-page":"161","author":"Deng","year":"2011"},{"key":"2023051604252592700_bty257-B10","doi-asserted-by":"crossref","first-page":"D805","DOI":"10.1093\/nar\/gku1075","article-title":"COSMIC: exploring the world\u2019s knowledge of somatic mutations in human cancer","volume":"43","author":"Forbes","year":"2015","journal-title":"Nucleic Acids Res"},{"key":"2023051604252592700_bty257-B11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v033.i01","article-title":"Regularization paths for generalized linear models via coordinate descent","volume":"33","author":"Friedman","year":"2010","journal-title":"J. Stat. Softw"},{"key":"2023051604252592700_bty257-B12","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1038\/nature11005","article-title":"Systematic identification of genomic markers of drug sensitivity in cancer cells","volume":"483","author":"Garnett","year":"2012","journal-title":"Nature"},{"key":"2023051604252592700_bty257-B13","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1080\/02664763.2012.734794","article-title":"Prior distribution elicitation for generalized linear and piecewise-linear models","volume":"40","author":"Garthwaite","year":"2013","journal-title":"J. Appl. Stat"},{"key":"2023051604252592700_bty257-B14","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1111\/j.2517-6161.1988.tb01741.x","article-title":"Quantifying expert opinion in linear regression problems","volume":"50","author":"Garthwaite","year":"1988","journal-title":"J. Roy. Stat. Soc. Ser. B (Methodological)"},{"key":"2023051604252592700_bty257-B15","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1080\/01621459.1993.10476353","article-title":"Variable selection via Gibbs sampling","volume":"88","author":"George","year":"1993","journal-title":"J. Am. Stat. Assoc"},{"key":"2023051604252592700_bty257-B16","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-19425-7","volume-title":"Regression Modeling Strategies: With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis","author":"Harrell","year":"2015","edition":"2nd edn."},{"key":"2023051604252592700_bty257-B17","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1007\/s10994-014-5475-7","article-title":"Expectation propagation in linear regression models with spike-and-slab priors","volume":"99","author":"Hern\u00e1ndez-Lobato","year":"2015","journal-title":"Mach. Learn"},{"key":"2023051604252592700_bty257-B18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/sam.11253","article-title":"Bayesian visual analytics: baVa","volume":"8","author":"House","year":"2015","journal-title":"Stat. Anal. Data Mining"},{"key":"2023051604252592700_bty257-B19","first-page":"63","volume-title":"Pacific Symposium on Biocomputing","author":"Jang","year":"2014"},{"key":"2023051604252592700_bty257-B20","first-page":"32","author":"Jang","year":"2015"},{"key":"2023051604252592700_bty257-B21","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1080\/01621459.1980.10477562","article-title":"Interactive elicitation of opinion for a normal linear model","volume":"75","author":"Kadane","year":"1980","journal-title":"J. Am. Stat. Assoc"},{"key":"2023051604252592700_bty257-B22","doi-asserted-by":"crossref","first-page":"11122","DOI":"10.1038\/ncomms11122","article-title":"Genome-wide study for circulating metabolites identifies 62 loci and reveals novel systemic effects of LPA","volume":"7","author":"Kettunen","year":"2016","journal-title":"Nat. Commun"},{"key":"2023051604252592700_bty257-B23","doi-asserted-by":"crossref","first-page":"1738","DOI":"10.1038\/leu.2014.89","article-title":"Novel activating STAT5B mutations as putative drivers of T-cell acute lymphoblastic leukemia","volume":"28","author":"Kontro","year":"2014","journal-title":"Leukemia"},{"key":"2023051604252592700_bty257-B24","first-page":"299","author":"Lu","year":"2007"},{"key":"2023051604252592700_bty257-B25","doi-asserted-by":"crossref","first-page":"2026","DOI":"10.1093\/bioinformatics\/btu140","article-title":"Assessing multivariate gene-metabolome associations with rare variants using Bayesian reduced rank regression","volume":"30","author":"Marttinen","year":"2014","journal-title":"Bioinformatics"},{"key":"2023051604252592700_bty257-B26","first-page":"547","author":"Micallef","year":"2017"},{"key":"2023051604252592700_bty257-B27","first-page":"352","author":"Minka","year":"2002"},{"key":"2023051604252592700_bty257-B28","doi-asserted-by":"crossref","first-page":"875","DOI":"10.1080\/01621459.2015.1066682","article-title":"Active clinical trials for personalized medicine","volume":"111","author":"Minsker","year":"2016","journal-title":"J. Am. Stat. Assoc"},{"key":"2023051604252592700_bty257-B29","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1080\/01621459.1988.10478694","article-title":"Bayesian variable selection in linear regression","volume":"83","author":"Mitchell","year":"1988","journal-title":"J. Am. Stat. Assoc"},{"key":"2023051604252592700_bty257-B30","doi-asserted-by":"crossref","DOI":"10.1002\/0470033312","volume-title":"Uncertain Judgements: Eliciting Experts\u2019 Probabilities","author":"O\u2019Hagan","year":"2006"},{"key":"2023051604252592700_bty257-B31","first-page":"645","author":"Riihim\u00e4ki","year":"2010"},{"key":"2023051604252592700_bty257-B32","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1214\/aos\/1176345338","article-title":"The Bayesian bootstrap","volume":"9","author":"Rubin","year":"1981","journal-title":"Ann. Stat"},{"key":"2023051604252592700_bty257-B33","first-page":"759","article-title":"Bayesian inference and optimal design for the sparse linear model","volume":"9","author":"Seeger","year":"2008","journal-title":"J. Mach. Learn. Res"},{"key":"2023051604252592700_bty257-B34","first-page":"734","author":"Soare","year":"2016"},{"key":"2023051604252592700_bty257-B35","doi-asserted-by":"crossref","first-page":"e1004790.","DOI":"10.1371\/journal.pcbi.1004790","article-title":"Pathway-based genomics prediction using generalized elastic net","volume":"12","author":"Sokolov","year":"2016","journal-title":"PLoS Comput. Biol"},{"key":"2023051604252592700_bty257-B36","doi-asserted-by":"crossref","first-page":"2439","DOI":"10.1162\/08997660260293292","article-title":"Bayesian model assessment and comparison using cross-validation predictive densities","volume":"14","author":"Vehtari","year":"2002","journal-title":"Neural Comput"},{"key":"2023051604252592700_bty257-B37","doi-asserted-by":"crossref","first-page":"5193.","DOI":"10.1038\/srep05193","article-title":"Quantitative scoring of differential drug sensitivity for individually optimized anticancer therapies","volume":"4","author":"Yadav","year":"2014","journal-title":"Sci. Rep"},{"key":"2023051604252592700_bty257-B38","doi-asserted-by":"crossref","first-page":"31619.","DOI":"10.1038\/srep31619","article-title":"Multitask learning improves prediction of cancer drug sensitivity","volume":"6","author":"Yuan","year":"2016","journal-title":"Sci. Rep"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/13\/i395\/50316349\/bioinformatics_34_13_i395.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/13\/i395\/50316349\/bioinformatics_34_13_i395.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,6]],"date-time":"2024-07-06T00:08:34Z","timestamp":1720224514000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/34\/13\/i395\/5045753"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,27]]},"references-count":38,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2018,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/bty257","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,7,1]]},"published":{"date-parts":[[2018,6,27]]}}}