{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T08:24:21Z","timestamp":1759134261621,"version":"3.37.3"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"1","content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Biomed Semant"],"published-print":{"date-parts":[[2014,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Biological databases vary enormously in size and data complexity, from small databases that contain a few million Resource Description Framework (RDF) triples to large databases that contain billions of triples. In this paper, we evaluate whether RDF native stores can be used to meet the needs of a biological database provider. Prior evaluations have used synthetic data with a limited database size. For example, the largest BSBM benchmark uses 1 billion synthetic e-commerce knowledge RDF triples on a single node. However, real world biological data differs from the simple synthetic data much. It is difficult to determine whether the synthetic e-commerce data is efficient enough to represent biological databases. Therefore, for this evaluation, we used five real data sets from biological databases.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>We evaluated five triple stores, 4store, Bigdata, Mulgara, Virtuoso, and OWLIM-SE, with five biological data sets, Cell Cycle Ontology, Allie, PDBj, UniProt, and DDBJ, ranging in size from approximately 10 million to 8 billion triples.<\/jats:p>\n            <jats:p>For each database, we loaded all the data into our single node and prepared the database for use in a classical data warehouse scenario. Then, we ran a series of SPARQL queries against each endpoint and recorded the execution time and the accuracy of the query response.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions<\/jats:title>\n            <jats:p>Our paper shows that with appropriate configuration Virtuoso and OWLIM-SE can satisfy the basic requirements to load and query biological data less than 8 billion or so on a single node, for the simultaneous access of 64 clients.<\/jats:p>\n            <jats:p>OWLIM-SE performs best for databases with approximately 11 million triples; For data sets that contain 94 million and 590 million triples, OWLIM-SE and Virtuoso perform best. They do not show overwhelming advantage over each other; For data over 4 billion Virtuoso works best.<\/jats:p>\n            <jats:p>4store performs well on small data sets with limited features when the number of triples is less than 100 million, and our test shows its scalability is poor; Bigdata demonstrates average performance and is a good open source triple store for middle-sized (500 million or so) data set; Mulgara shows a little of fragility.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/2041-1480-5-32","type":"journal-article","created":{"date-parts":[[2014,7,10]],"date-time":"2014-07-10T15:30:05Z","timestamp":1405006205000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["BioBenchmark Toyama 2012: an evaluation of the performance of triple stores on biological data"],"prefix":"10.1186","volume":"5","author":[{"given":"Hongyan","family":"Wu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Toyofumi","family":"Fujiwara","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yasunori","family":"Yamamoto","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jerven","family":"Bolleman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Atsuko","family":"Yamaguchi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2014,7,10]]},"reference":[{"key":"178_CR1","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1038\/scientificamerican0501-34","volume":"284","author":"T Berners-lee","year":"2001","unstructured":"Berners-lee T, Hendler J, Lassila O:The semantic web-a new form of Web content that is meaningful to computers will unleash a revolution of new possibilities. Sci Am. 2001, 284: 34-432.","journal-title":"Sci Am"},{"key":"178_CR2","unstructured":"Semantic Web. [http:\/\/www.w3.org\/2001\/sw\/]"},{"issue":"2","key":"178_CR3","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1093\/bib\/bbp002","volume":"10","author":"H Chen","year":"2009","unstructured":"Chen H, Ding L, Wu Z, Yu T, Dhanapalan L, Chen JY:Semantic web for integrated network analysis in biomedicine. Brief Bioinform. 2009, 10 (2): 177-192.","journal-title":"Brief Bioinform"},{"key":"178_CR4","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-48438-9_2","volume-title":"Semantic web approach to database integration in the life sciences","author":"KH Cheung","year":"2007","unstructured":"Cheung KH, Smith AK, Yip KY, Baker CJ, Gerstein MB: Semantic web approach to database integration in the life sciences. 2007, Semantic, Web: Revolutionizing Knowl Discov Life Sci US: Springer, 11\u201330. http:\/\/dx.doi.org\/10.1007\/978-0-387-48438-9_2"},{"key":"178_CR5","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1126\/science.2181666","volume":"248","author":"C Cantor","year":"1990","unstructured":"Cantor C:Orchestrating the human genome project. Science. 1990, 248: 49-51.","journal-title":"Science"},{"issue":"1","key":"178_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/nar\/25.1.1","volume":"25","author":"DA Benson","year":"1997","unstructured":"Benson DA, Karsch-Mizrachi I, Lipman DJ, Ostell J, Wheeler DL:GenBank. Nucleic Acids Res. 1997, 25 (1): 1-6.","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"178_CR7","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1093\/nar\/gkg078","volume":"31","author":"J Gollub","year":"2003","unstructured":"Gollub J, Ball CA, Binkley G, Demeter J, Finkelstein DB, Hebert JM, Hernandez-Boussard T, Jin H, Kaloper M, Matese JC, Schroeder M, Brown PO, Botstein D, Sherlock G:The Stanford Microarray Database: data access and quality assessment tools. Nucleic Acids Res. 2003, 31 (1): 94-6.","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"178_CR8","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1093\/nar\/30.1.207","volume":"30","author":"R Edgar","year":"2002","unstructured":"Edgar R, Domrachev M, Lasha AE:Gene expression omnibus: NCBI gene expression and hybridization array data repository. Nucleic Acids Res. 2002, 30 (1): 207-110.","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"178_CR9","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1093\/nar\/gkg056","volume":"31","author":"GD Bader","year":"2003","unstructured":"Bader GD, Betel D, Hogue CWV:BIND: the Biomolecular Interaction Network Database. Nucleic Acids Res. 2003, 31 (1): 248-250.","journal-title":"Nucleic Acids Res"},{"issue":"Database Issue","key":"178_CR10","doi-asserted-by":"publisher","first-page":"655","DOI":"10.1093\/nar\/gkj040","volume":"34","author":"F Desiere","year":"2006","unstructured":"Desiere F, Deutsch EW, King NL, Nesvizhskii AI, Mallick P, Eng J, Chen S, Eddes J, Loevenich SN, Aebersold R:The PeptideAtlas project. Nucleic Acids Res. 2006, 34 (Database Issue): 655-658.","journal-title":"Nucleic Acids Res"},{"key":"178_CR11","first-page":"647","volume-title":"19th International Workshop on Database and Expert Systems Applications","author":"E Baralis","year":"2008","unstructured":"Baralis E, Fiori A:Exploring heterogeneous biological data sources. 19th International Workshop on Database and Expert Systems Applications. 2008, DEXA, 647-651. [http:\/\/ieeexplore.ieee.org\/stamp\/stamp.jsp?tp=&arnumber=4624791&isnumber=4624651]"},{"key":"178_CR12","first-page":"467","volume":"7","author":"ME Martone","year":"2004","unstructured":"Martone ME, Gupta A, Ellisman MH:e-Neuroscience: challenges and triumphs in integrating distributed data from molecules to brains. NatNeuroscience. 2004, 7: 467-472.","journal-title":"NatNeuroscience"},{"key":"178_CR13","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1093\/bib\/bbs014","volume":"14","author":"H Chen","year":"2013","unstructured":"Chen H, Yu T, Chen J:Semantic web meets integrative biology: a survey. Brief Bioinform. 2013, 14: 109-125.","journal-title":"Brief Bioinform"},{"key":"178_CR14","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1093\/bib\/bbp024","volume":"10","author":"E Antezana","year":"2009","unstructured":"Antezana E, Kuiper M, Mironov V:Biological knowledge management: the emerging role of the Semantic Web technologies. Brief Bioinform. 2009, 10: 392-407.","journal-title":"Brief Bioinform"},{"key":"178_CR15","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1186\/2041-1480-4-6","volume":"4","author":"T Katayama","year":"2013","unstructured":"Katayama T, Wilkinson MD, Micklem G, Kawashima S, Yamaguchi A, Nakao M, Yamamoto Y, Okamoto S, Oouchida K, Chun HW, Aerts J, Afzal H, Antezana E, Arakawa K, Aranda B, Belleau F, Bolleman J, Bonnal RJ, Chapman B, Cock P, Eriksson T, Gordon P, Goto N, Hayashi K, Horn H, Ishiwata R, Kaminuma E, Kasprzyk A, Kawaji H, Kido N:The 3rd DBCLS BioHackathon: improving life science data integration with semantic Web technologies. J Biomed Semant. 2013, 4: 6-","journal-title":"J Biomed Semant"},{"key":"178_CR16","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1093\/nar\/gks1068","volume":"41","author":"TU Consortium","year":"2013","unstructured":"Consortium TU:Update on activities at the Universal Protein Resource (UniProt) in 2013. Nucleic Acids Res. 2013, 41: 43-47.","journal-title":"Nucleic Acids Res"},{"key":"178_CR17","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1093\/nar\/gkr811","volume":"40","author":"AR Kinjo","year":"2012","unstructured":"Kinjo AR, Suzuki H, Yamashita R, Ikegawa Y, Kudou T, Igarashi R, Kengaku Y, Cho H, Standley DM, Nakagawa A, Nakamura H:Protein Data Bank Japan (PDBj): maintaining a structural data archive and resource description framework format. Nucleic Acids Res. 2012, 40: 453-460.","journal-title":"Nucleic Acids Res"},{"key":"178_CR18","unstructured":"wwpdb. [http:\/\/www.wwpdb.org\/]"},{"issue":"Database-Issue","key":"178_CR19","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1093\/nar\/gks1200","volume":"41","author":"PW Rose","year":"2013","unstructured":"Rose PW, Bi C, Bluhm W, Christie CH, Dimitropoulos D, Dutta S, Green RK, Goodsell DS, Prlic A, Quesada M, Quinn GB, Ramos AG, Westbrook JD, Young J, Zardecki C, Berman HM, Bourne PE:The RCSB Protein Data Bank: new resources for research and education. Nucleic Acids Res. 2013, 41 (Database-Issue): 475-482.","journal-title":"Nucleic Acids Res"},{"issue":"Database issue","key":"178_CR20","first-page":"D402","volume":"36","author":"EL Ulrich","year":"2008","unstructured":"Ulrich EL, Akutsu H, Doreleijers JF, Harano Y, Ioannidis YE, Lin J, Livny M, Mading S, Maziuk D, Miller Z, Nakatani E, Schulte CF, Tolmie DE, Kent Wenger R, Yao H, Markley JL:BioMagResBank. Nucleic Acids Res. 2008, 36 (Database issue): D402-D408. [http:\/\/dx.doi.org\/10.1093\/nar\/gkm957]","journal-title":"Nucleic Acids Res"},{"issue":"Database-Issue","key":"178_CR21","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1093\/nar\/gkr998","volume":"40","author":"S Velankar","year":"2012","unstructured":"Velankar S, Alhroub Y, Best C, Caboche S, Conroy MJ, Dana JM, Montecelo MAF, van Ginkel G, Golovin A, Gore SP, Gutmanas A, Haslam P, Hendrickx PMS, Heuson E, Hirshberg M, John M, Lagerstedt I, Mir S, Newman LE, Oldfield T, Patwardhan A, Rinaldi L, Sahni G, Sanz-Garc\u00eda E, Sen S, Slowley R, Suarez-Uruena A, Swaminathan GJ, Symmons MF, Vranken WF:PDBe: Protein Data Bank in Europe. Nucleic Acids Res. 2012, 40 (Database-Issue): 445-452.","journal-title":"Nucleic Acids Res"},{"key":"178_CR22","unstructured":"Rusher J:TripleStore. Semantic Web Advanced Development for Europe (SWAD-Europe), Workshop on Semantic Web Storage and Retrieval. [http:\/\/www.w3.org\/2001\/sw\/Europe\/events\/20031113-storage\/]"},{"key":"178_CR23","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1016\/j.websem.2005.06.005","volume":"3","author":"Y Guo","year":"2005","unstructured":"Guo Y, Pan Z, Heflin J:LUBM: A benchmark for OWL knowledge base systems. Web Semant Sci Serv Agents World Wide Web. 2005, 3: 158-182.","journal-title":"Web Semant Sci Serv Agents World Wide Web"},{"key":"178_CR24","unstructured":"BSBM V3 Results (February 2011). [http:\/\/www4.wiwiss.fu-berlin.de\/bizer\/BerlinSPARQLBenchmark\/results\/V6\/index.html]"},{"key":"178_CR25","volume-title":"SP2Bench: a SPARQL performance benchmark","author":"M Schmidt","year":"2008","unstructured":"Schmidt M, Hornung T, Lausen G, Pinkel C: SP2Bench: a SPARQL performance benchmark. 2008, Berlin: Springer"},{"key":"178_CR26","doi-asserted-by":"publisher","first-page":"S3","DOI":"10.1186\/1471-2105-13-S1-S3","volume":"13","author":"V Mironov","year":"2012","unstructured":"Mironov V, Seethappan N, Blond\u00e9 W, Antezana E, Splendiani A, Kuiper M:Gauging triple stores with actual biological data. BMC bioinformatics. 2012, 13: S3-","journal-title":"BMC bioinformatics"},{"key":"178_CR27","unstructured":"4store. [http:\/\/4store.org\/]"},{"key":"178_CR28","unstructured":"Harris S, Lamb N, Shadbolt N:4store: the design and implementation of a clustered rdf store. 5th International Workshop on Scalable Semantic Web Knowledge Base Systems (SSWS2009). [http:\/\/ceur-ws.org\/Vol-517\/SSWS09-Proceedings.pdf], 2009."},{"key":"178_CR29","unstructured":"bigdata. [http:\/\/www.systap.com\/bigdata.htm]"},{"key":"178_CR30","unstructured":"ontotext. [http:\/\/www.ontotext.com\/owlim]"},{"key":"178_CR31","doi-asserted-by":"publisher","DOI":"10.1007\/11581116_19","volume-title":"OWLIM \u2013 a Pragmatic Semantic Repository for OWL","author":"A Kiryakov","year":"2005","unstructured":"Kiryakov A, Ognyanov D, Manov D: OWLIM \u2013 a Pragmatic Semantic Repository for OWL. 2005, Berlin: Springer"},{"key":"178_CR32","unstructured":"mulgara SEMANTIC STORE. [http:\/\/www.mulgara.org\/]"},{"key":"178_CR33","unstructured":"OPENLINK SOFTWARE. [http:\/\/virtuoso.openlinksw.com\/]"},{"key":"178_CR34","volume-title":"Proceedings of the 1st Conference on Social Semantic Web CSSW","author":"O Erling","year":"2007","unstructured":"Erling O, Mikhailov I:RDF support in the virtuoso DBMS. Proceedings of the 1st Conference on Social Semantic Web CSSW. 2007, Berlin: Springer,"},{"key":"178_CR35","volume-title":"Database","author":"Y Yamamoto","year":"2011","unstructured":"Yamamoto Y, Yamaguchi A, Bono H, Takagi T:Allie: a database and a search service of abbreviations and long forms. Database. 2011. [http:\/\/dx.doi.org\/10.1093\/database\/bar013]"},{"key":"178_CR36","unstructured":"Allie: A Search Service for Abbreviation\/Long Form. [http:\/\/allie.dbcls.jp\/]"},{"key":"178_CR37","unstructured":"PDBj. [http:\/\/www.pdbj.org\/]"},{"key":"178_CR38","unstructured":"UniProt. [http:\/\/www.uniprot.org\/]"},{"issue":"Database-Issue","key":"178_CR39","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1093\/nar\/gkr994","volume":"40","author":"Y Kodama","year":"2012","unstructured":"Kodama Y, Mashima J, Kaminuma E, Gojobori T, Ogasawara O, Takagi T, Okubo K, Nakamura Y:The DNA Data Bank of Japan launches a new resource, the DDBJ omics archive of functional genomics experiments. Nucleic Acids Res. 2012, 40 (Database-Issue): 38-42.","journal-title":"Nucleic Acids Res"},{"key":"178_CR40","unstructured":"DDBJ:DNA Data Bank of Japan. [http:\/\/www.ddbj.nig.ac.jp\/]"},{"key":"178_CR41","unstructured":"RDF for life science. [http:\/\/kiban.dbcls.jp\/togordf\/]"},{"key":"178_CR42","unstructured":"RDF for life science. [http:\/\/kiban.dbcls.jp\/togordf\/wiki\/OwlimSe4.3]"},{"key":"178_CR43","first-page":"85","volume-title":"Semantic Digital Archives","author":"M Voigt","year":"2012","unstructured":"Voigt M, Mitschick A, Schulz J:Yet another triple store benchmark? Practical experiences with real-world data. Semantic Digital Archives. 2012, 85-94. [http:\/\/ceur-ws.org\/Vol-912\/paper7.pdf]"}],"container-title":["Journal of Biomedical Semantics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/2041-1480-5-32.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,2]],"date-time":"2021-09-02T05:17:05Z","timestamp":1630559825000},"score":1,"resource":{"primary":{"URL":"https:\/\/jbiomedsem.biomedcentral.com\/articles\/10.1186\/2041-1480-5-32"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,7,10]]},"references-count":43,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2014,12]]}},"alternative-id":["178"],"URL":"https:\/\/doi.org\/10.1186\/2041-1480-5-32","relation":{},"ISSN":["2041-1480"],"issn-type":[{"type":"electronic","value":"2041-1480"}],"subject":[],"published":{"date-parts":[[2014,7,10]]},"assertion":[{"value":"13 May 2013","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 April 2014","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 July 2014","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"32"}}