{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T13:13:44Z","timestamp":1779196424110,"version":"3.51.4"},"reference-count":31,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2016,12,28]],"date-time":"2016-12-28T00:00:00Z","timestamp":1482883200000},"content-version":"vor","delay-in-days":833,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2015,2,15]]},"abstract":"<jats:p>Motivation: Inferring how humans respond to external cues such as drugs, chemicals, viruses or hormones is an essential question in biomedicine. Very often, however, this question cannot be addressed because it is not possible to perform experiments in humans. A reasonable alternative consists of generating responses in animal models and \u2018translating\u2019 those results to humans. The limitations of such translation, however, are far from clear, and systematic assessments of its actual potential are urgently needed. sbv IMPROVER (systems biology verification for Industrial Methodology for PROcess VErification in Research) was designed as a series of challenges to address translatability between humans and rodents. This collaborative crowd-sourcing initiative invited scientists from around the world to apply their own computational methodologies on a multilayer systems biology dataset composed of phosphoproteomics, transcriptomics and cytokine data derived from normal human and rat bronchial epithelial cells exposed in parallel to 52 different stimuli under identical conditions. Our aim was to understand the limits of species-to-species translatability at different levels of biological organization: signaling, transcriptional and release of secreted factors (such as cytokines). Participating teams submitted 49 different solutions across the sub-challenges, two-thirds of which were statistically significantly better than random. Additionally, similar computational methods were found to range widely in their performance within the same challenge, and no single method emerged as a clear winner across all sub-challenges. Finally, computational methods were able to effectively translate some specific stimuli and biological processes in the lung epithelial system, such as DNA synthesis, cytoskeleton and extracellular matrix, translation, immune\/inflammation and growth factor\/proliferation pathways, better than the expected response similarity between species.<\/jats:p><jats:p>Contact: \u00a0pmeyerr@us.ibm.com or Julia.Hoeng@pmi.com<\/jats:p><jats:p>Supplementary information: \u00a0Supplementary Data are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/btu611","type":"journal-article","created":{"date-parts":[[2014,9,19]],"date-time":"2014-09-19T04:50:41Z","timestamp":1411102241000},"page":"471-483","source":"Crossref","is-referenced-by-count":67,"title":["Understanding the limits of animal models as predictors of human biology: lessons learned from the sbv IMPROVER Species Translation Challenge"],"prefix":"10.1093","volume":"31","author":[{"given":"Kahn","family":"Rhrissorrakrai","sequence":"first","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vincenzo","family":"Belcastro","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Erhan","family":"Bilal","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raquel","family":"Norel","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carine","family":"Poussin","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carole","family":"Mathis","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"R\u00e9mi H. J.","family":"Dulize","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nikolai V.","family":"Ivanov","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leonidas","family":"Alexopoulos","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J.","family":"Jeremy Rice","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manuel C.","family":"Peitsch","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gustavo","family":"Stolovitzky","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pablo","family":"Meyer","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julia","family":"Hoeng","sequence":"additional","affiliation":[{"name":"1 \u00a01IBM T.J. Watson Research Center, Computational Biology Center, Yorktown Heights, NY 10003, USA, 2Philip Morris International R&D, Philip Morris Products S.A., 2000 Neuch\u00e2tel, Switzerland, 3Telethon Institute of Genetics and Medicine, Via Pietro Castellino, 111, 80131 Naples, Italy, 4ProtATonce Ltd, Scientific Park Lefkippos, Patriarchou Grigoriou & Neapoleos 15343 Ag. Paraskevi, Attiki and 5National Technical University of Athens, Heroon Polytechniou 9, Zografou 15780, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2014,9,17]]},"reference":[{"key":"2023020108553400700_btu611-B1","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1093\/bioinformatics\/btn645","article-title":"Predicting the binding preference of transcription factors to individual DNA k-mers","volume":"25","author":"Alleyne","year":"2009","journal-title":"Bioinformatics"},{"key":"2023020108553400700_btu611-B2","doi-asserted-by":"crossref","first-page":"e1002258","DOI":"10.1371\/journal.pcbi.1002258","article-title":"Interspecies translation of disease networks increases robustness and predictive accuracy","volume":"7","author":"Anvar","year":"2011","journal-title":"PLoS Computat. Biol."},{"key":"2023020108553400700_btu611-B3","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1038\/nrg1272","article-title":"Network biology: understanding the cell's functional organization","volume":"5","author":"Barabasi","year":"2004","journal-title":"Nat. Rev. Genet."},{"key":"2023020108553400700_btu611-B4","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc. Ser. B Methodol."},{"key":"2023020108553400700_btu611-B5","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1093\/bioinformatics\/btu407","article-title":"Inter-species prediction of protein phosphorylation in the sbv IMPROVER species translation challenge","volume":"31","author":"Biehl","year":"2015","journal-title":"Bioinformatics"},{"key":"2023020108553400700_btu611-B6","doi-asserted-by":"crossref","first-page":"120","DOI":"10.3115\/1610075.1610094","article-title":"Domain adaptation with structural correspondence learning","volume-title":"EMNLP \u201806 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing","author":"Blitzer","year":"2006"},{"key":"2023020108553400700_btu611-B7","volume-title":"R:A Language and Environment for Statistical Computing","author":"Computing,R.F.f.S","year":"2013"},{"key":"2023020108553400700_btu611-B8","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1126\/science.1105136","article-title":"The ENCODE (ENCyclopedia Of DNA elements) project","volume":"306","author":"Consortium,E.P","year":"2004","journal-title":"Science"},{"key":"2023020108553400700_btu611-B9","doi-asserted-by":"crossref","first-page":"1787","DOI":"10.1126\/science.1198374","article-title":"Identification of functional elements and regulatory circuits by Drosophila modENCODE","volume":"330","author":"Consortium","year":"2010","journal-title":"Science"},{"key":"2023020108553400700_btu611-B10","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.cccn.2005.06.023","article-title":"Applications of Luminex xMAP technology for rapid, high-throughput multiplexed nucleic acid detection","volume":"363","author":"Dunbar","year":"2006","journal-title":"Clin. Chim. Acta"},{"key":"2023020108553400700_btu611-B11","doi-asserted-by":"crossref","first-page":"R759","DOI":"10.1152\/ajpregu.00293.2004","article-title":"The viral mimic, polyinosinic:polycytidylic acid, induces fever in rats via an interleukin-1-dependent mechanism","volume":"287","author":"Fortier","year":"2004","journal-title":"Am. J. Physiol. Regul. Integr. Comp. Physiol."},{"key":"2023020108553400700_btu611-B12","doi-asserted-by":"crossref","first-page":"6473","DOI":"10.1038\/onc.2008.313","article-title":"PI3K\/Akt: getting it right matters","volume":"27","author":"Franke","year":"2008","journal-title":"Oncogene"},{"key":"2023020108553400700_btu611-B13","doi-asserted-by":"crossref","first-page":"1775","DOI":"10.1126\/science.1196914","article-title":"Integrative analysis of the Caenorhabditis elegans genome by the modENCODE project","volume":"330","author":"Gerstein","year":"2010","journal-title":"Science"},{"key":"2023020108553400700_btu611-B14","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1093\/bib\/bbr031","article-title":"When orthologs diverge between human and mouse","volume":"12","author":"Gharib","year":"2011","journal-title":"Brief. Bioinformatics"},{"key":"2023020108553400700_btu611-B15","doi-asserted-by":"crossref","first-page":"8685","DOI":"10.1073\/pnas.0701361104","article-title":"The human disease network","volume":"104","author":"Goh","year":"2007","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023020108553400700_btu611-B16","doi-asserted-by":"crossref","first-page":"7092","DOI":"10.1093\/nar\/gkr404","article-title":"Conservation of transcription factor bindingevents predicts gene expression across species","volume":"39","author":"Hemberg","year":"2011","journal-title":"Nucleic Acids Res."},{"key":"2023020108553400700_btu611-B17","doi-asserted-by":"crossref","first-page":"7858","DOI":"10.1093\/nar\/gks477","article-title":"Integrated genome analysis suggests that most conserved non-coding sequences are regulatory factor binding sites","volume":"40","author":"Hemberg","year":"2012","journal-title":"Nucleic Acids Res."},{"key":"2023020108553400700_btu611-B18","doi-asserted-by":"crossref","first-page":"14621","DOI":"10.1073\/pnas.1000138107","article-title":"Discovery of drug mode of action and drug repositioning from transcriptional responses","volume":"107","author":"Iorio","year":"2010","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023020108553400700_btu611-B19","doi-asserted-by":"crossref","first-page":"6987","DOI":"10.1073\/pnas.0800387105","article-title":"Null mutations in human and mouse orthologs frequently result in different phenotypes","volume":"105","author":"Liao","year":"2008","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023020108553400700_btu611-B20","doi-asserted-by":"crossref","first-page":"6544","DOI":"10.1073\/pnas.0910200107","article-title":"Systematic discovery of nonobvious human disease models through orthologous phenotypes","volume":"107","author":"McGary","year":"2010","journal-title":"Proc. Natl Acad. Sci USA"},{"key":"2023020108553400700_btu611-B21","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1186\/1752-0509-5-107","article-title":"Combined logical and data-driven models for linking signalling pathways to cellular response","volume":"5","author":"Melas","year":"2011","journal-title":"BMC Syst. Biol."},{"key":"2023020108553400700_btu611-B22","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1093\/bioinformatics\/bts116","article-title":"Industrial methodology for process verification in research (IMPROVER): toward systems biology verification","volume":"28","author":"Meyer","year":"2012","journal-title":"Bioinformatics"},{"key":"2023020108553400700_btu611-B23","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1186\/1758-2946-5-30","article-title":"Drug repositioning: a machine-learning approach through data integration","volume":"5","author":"Napolitano","year":"2013","journal-title":"J. Cheminformatics"},{"key":"2023020108553400700_btu611-B24","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1038\/ng2047","article-title":"Tissue-specific transcriptional regulation has diverged significantly between human and mouse","volume":"39","author":"Odom","year":"2007","journal-title":"Nature Genet."},{"key":"2023020108553400700_btu611-B25","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1109\/TNN.2010.2091281","article-title":"Domain adaptation via transfer component analysis","volume":"22","author":"Pan","year":"2011","journal-title":"IEEE Trans. Neural. Netw."},{"key":"2023020108553400700_btu611-B26","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1038\/nrm1570","article-title":"Reconstruction of cellular signalling networks and analysis of their properties","volume":"6","author":"Papin","year":"2005","journal-title":"Nat. Rev."},{"key":"2023020108553400700_btu611-B27","doi-asserted-by":"crossref","DOI":"10.1038\/sdata.2014.9","article-title":"The species translation challenge\u2014a systems biology perspective on human and rat bronchial epithelial cells","volume":"1","author":"Poussin","year":"2014","journal-title":"Scientific Data"},{"key":"2023020108553400700_btu611-B28","doi-asserted-by":"crossref","first-page":"Article3","DOI":"10.2202\/1544-6115.1027","article-title":"Linear models and empirical bayes methods for assessing differential expression in microarray experiments","volume":"3","author":"Smyth","year":"2004","journal-title":"Stat. Appl. Genet. Mol. Biol."},{"key":"2023020108553400700_btu611-B29","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.tig.2009.03.004","article-title":"How confident can we be that orthologs are similar, but paralogs differ?","volume":"25","author":"Studer","year":"2009","journal-title":"Trends Genet:TIG"},{"key":"2023020108553400700_btu611-B30","doi-asserted-by":"crossref","first-page":"15545","DOI":"10.1073\/pnas.0506580102","article-title":"Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles","volume":"102","author":"Subramanian","year":"2005","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023020108553400700_btu611-B31","doi-asserted-by":"crossref","first-page":"2892","DOI":"10.1093\/bioinformatics\/btt492","article-title":"Strengths and limitations of microarray-based phenotype prediction: lessons learned from the IMPROVER Diagnostic Signature Challenge","volume":"29","author":"Tarca","year":"2013","journal-title":"Bioinformatics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/31\/4\/471\/49011441\/bioinformatics_31_4_471.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/31\/4\/471\/49011441\/bioinformatics_31_4_471.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,2]],"date-time":"2024-06-02T18:02:51Z","timestamp":1717351371000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/31\/4\/471\/2748150"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,9,17]]},"references-count":31,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2015,2,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btu611","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,9,17]]}}}