{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T19:03:52Z","timestamp":1772910232857,"version":"3.50.1"},"reference-count":89,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T00:00:00Z","timestamp":1696896000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T00:00:00Z","timestamp":1696896000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Manuf"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Demonstration Environments (DEs) are essential tools for testing and demonstrating new technologies, products, and services, and reducing uncertainties and risks in the innovation process. However, the terminology used to describe these environments is inconsistent, leading to heterogeneity in defining and characterizing them. This makes it difficult to establish a universal understanding of DEs and to differentiate between the different types of DEs, including testbeds, pilot-plants, and living labs. Moreover, existing literature lacks a holistic view of DEs, with studies focusing on specific types of DEs and not offering an integrated perspective on their characteristics and applicability in different contexts. This study proposes an ontology for knowledge representation related to DEs to address this gap. Using an ontology learning approach analyzing 3621 peer-reviewed journal articles, we develop a standardized framework for defining and characterizing DEs, providing a holistic view of these environments. The resulting ontology allows innovation managers and practitioners to select appropriate DEs for achieving their innovation goals, based on the characteristics and capabilities of the specific type of DE. The contributions of this study are significant in advancing the understanding and application of DEs in innovation processes. The proposed ontology provides a standardized approach for defining and characterizing DEs, reducing inconsistencies in terminology and establishing a common understanding of these environments. This enables innovation managers and practitioners to select appropriate DEs for their specific innovation goals, facilitating more efficient and effective innovation processes. Overall, this study provides a valuable resource for researchers, practitioners, and policymakers interested in the effective use of DEs in innovation.<\/jats:p>","DOI":"10.1007\/s10845-023-02213-1","type":"journal-article","created":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T17:01:52Z","timestamp":1696957312000},"page":"3501-3521","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["An ontology for defining and characterizing demonstration environments"],"prefix":"10.1007","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1419-2125","authenticated-orcid":false,"given":"Wei","family":"Nie","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5030-5588","authenticated-orcid":false,"given":"Katharina","family":"De Vita","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tariq","family":"Masood","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,10,10]]},"reference":[{"key":"2213_CR1","unstructured":"Abuarqoub, A., Al-Fayez, F., Alsboui, T., Hammoudeh, M., & Nisbet, A. (2012). Simulation issues in wireless sensor networks: a survey. In The sixth international conference on sensor technologies and applications (SENSORCOMM 2012) (pp. 222\u2013228)."},{"key":"2213_CR2","doi-asserted-by":"publisher","unstructured":"Ahmad, M.\u00a0A., Woodhead, S., & Gan, D. (2016). The v-network testbed for malware analysis. In 2016 international conference on advanced communication control and computing technologies (ICACCCT) (pp. 629\u2013635). https:\/\/doi.org\/10.1109\/ICACCCT.2016.7831716","DOI":"10.1109\/ICACCCT.2016.7831716"},{"key":"2213_CR3","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-019-09782-9","author":"FN Al-Aswadi","year":"2019","unstructured":"Al-Aswadi, F. N., Chan, H. Y., & Gan, K. H. (2019). Automatic ontology construction from text: A review from shallow to deep learning trend. Artificial Intelligence Review. https:\/\/doi.org\/10.1007\/s10462-019-09782-9","journal-title":"Artificial Intelligence Review"},{"key":"2213_CR4","doi-asserted-by":"publisher","unstructured":"Albukhitan, S. & Helmy, T. (2016). Arabic ontology learning from un-structured text. In 2016 IEEE\/WIC\/ACM international conference on web intelligence (WI) (pp. 492\u2013496). IEEE. https:\/\/doi.org\/10.1109\/WI.2016.0082","DOI":"10.1109\/WI.2016.0082"},{"key":"2213_CR5","doi-asserted-by":"publisher","first-page":"12","DOI":"10.22215\/timreview\/603","volume":"2","author":"E Almirall","year":"2012","unstructured":"Almirall, E., Lee, M., & Wareham, J. (2012). Mapping living labs in the landscape of innovation methodologies. Technology Innovation Management Review, 2, 12\u201318. https:\/\/doi.org\/10.22215\/timreview\/603","journal-title":"Technology Innovation Management Review"},{"key":"2213_CR6","doi-asserted-by":"publisher","first-page":"516","DOI":"10.3233\/978-1-61499-753-5-516","volume":"235","author":"M Arguello Casteleiro","year":"2017","unstructured":"Arguello Casteleiro, M., Maseda Fernandez, D., Demetriou, G., Read, W., Fernandez Prieto, M. J., Des Diz, J., Nenadic, G., Keane, J., & Stevens, R. (2017). A case study on sepsis using pubmed and deep learning for ontology learning. Studies in Health Technology and Informatics, 235, 516\u2013520. https:\/\/doi.org\/10.3233\/978-1-61499-753-5-516","journal-title":"Studies in Health Technology and Informatics"},{"key":"2213_CR7","doi-asserted-by":"publisher","first-page":"572","DOI":"10.1016\/j.procs.2019.09.212","volume":"159","author":"A Ayadi","year":"2019","unstructured":"Ayadi, A., Samet, A., de Beuvron, F., & Zanni-Merk, C. (2019). Ontology population with deep learning-based NLP: A case study on the Biomolecular Network Ontology. Procedia Computer Science, 159, 572\u2013581. https:\/\/doi.org\/10.1016\/j.procs.2019.09.212","journal-title":"Procedia Computer Science"},{"key":"2213_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2019.01.002","volume":"57","author":"A Ayadi","year":"2019","unstructured":"Ayadi, A., Zanni-Merk, C., de Beuvron, F., Thompson, D. B., & Krichen, S. (2019). BNO\u2014An ontology for understanding the transittability of complex biomolecular networks. Journal of Web Semantics, 57, 100495. https:\/\/doi.org\/10.1016\/j.websem.2019.01.002","journal-title":"Journal of Web Semantics"},{"key":"2213_CR9","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.1331557","author":"P Ballon","year":"2005","unstructured":"Ballon, P., Pierson, J., & Delaere, S. (2005). Test and experimentation platforms for broadband innovation: Examining European practice. SSRN Electronic Journal. https:\/\/doi.org\/10.2139\/ssrn.1331557","journal-title":"SSRN Electronic Journal"},{"issue":"4","key":"2213_CR10","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1504\/IJIRD.2009.022727","volume":"1","author":"B Bergvall-Kareborn","year":"2009","unstructured":"Bergvall-Kareborn, B., & Stahlbrost, A. (2009). Living lab: An open and citizen-centric approach for innovation. International Journal of Innovation and Regional Development, 1(4), 356\u2013370. https:\/\/doi.org\/10.1504\/IJIRD.2009.022727","journal-title":"International Journal of Innovation and Regional Development"},{"issue":"1","key":"2213_CR11","doi-asserted-by":"publisher","first-page":"320","DOI":"10.1016\/j.compchemeng.2007.04.013","volume":"32","author":"SC Brandt","year":"2008","unstructured":"Brandt, S. C., Morbach, J., Miatidis, M., Thei\u00dfen, M., Jarke, M., & Marquardt, W. (2008). An ontology-based approach to knowledge management in design processes. Computers & Chemical Engineering, 32(1), 320\u2013342. https:\/\/doi.org\/10.1016\/j.compchemeng.2007.04.013","journal-title":"Computers & Chemical Engineering"},{"key":"2213_CR12","unstructured":"Brewster, C., Alani, H., Dasmahapatra, S., & Wilks, Y. (2004). Data driven ontology evaluation. In Proceedings of the fourth international conference on language resources and evaluation (LREC\u201904). European Language Resources Association (ELRA)."},{"issue":"4","key":"2213_CR13","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1177\/0969776418787222","volume":"26","author":"H Bulkeley","year":"2019","unstructured":"Bulkeley, H., Marvin, S., Palgan, Y. V., McCormick, K., Breitfuss-Loidl, M., Mai, L., von Wirth, T., & Frantzeskaki, N. (2019). Urban living laboratories: Conducting the experimental city? European Urban and Regional Studies, 26(4), 317\u2013335. https:\/\/doi.org\/10.1177\/0969776418787222","journal-title":"European Urban and Regional Studies"},{"key":"2213_CR14","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-8349-9920-7","volume-title":"Innovation and ontologies: Structuring the early stages of innovation management","author":"AC Bullinger","year":"2008","unstructured":"Bullinger, A. C. (2008). Innovation and ontologies: Structuring the early stages of innovation management. Springer. https:\/\/doi.org\/10.1007\/978-3-8349-9920-7"},{"key":"2213_CR15","doi-asserted-by":"publisher","unstructured":"Caranica, A., Vulpe, A., Parvu, M.\u00a0E., Draghicescu, D., Fratu, O., & Lupan, T. (2019). ToR-SIM\u2014A mobile malware analysis platform. In 2019 international conference on speech technology and human-computer dialogue (SpeD) (pp. 1\u20138). https:\/\/doi.org\/10.1109\/SPED.2019.8906638","DOI":"10.1109\/SPED.2019.8906638"},{"key":"2213_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclepro.2022.131734","volume":"354","author":"J Carrera","year":"2022","unstructured":"Carrera, J., Carb\u00f3, O., Do\u00f1ate, S., Su\u00e1rez-Ojeda, M. E., & P\u00e9rez, J. (2022). Increasing the energy production in an urban wastewater treatment plant using a high-rate activated sludge: Pilot plant demonstration and energy balance. Journal of Cleaner Production, 354, 131734. https:\/\/doi.org\/10.1016\/j.jclepro.2022.131734","journal-title":"Journal of Cleaner Production"},{"issue":"5","key":"2213_CR17","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1007\/s10845-008-0151-z","volume":"20","author":"CE Catalano","year":"2009","unstructured":"Catalano, C. E., Camossi, E., Ferrandes, R., Cheutet, V., & Sevilmis, N. (2009). A product design ontology for enhancing shape processing in design workflows. Journal of Intelligent Manufacturing, 20(5), 553\u2013567. https:\/\/doi.org\/10.1007\/s10845-008-0151-z","journal-title":"Journal of Intelligent Manufacturing"},{"key":"2213_CR18","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2020.104332","volume":"145","author":"Y Chen","year":"2021","unstructured":"Chen, Y., Yu, C., Liu, X., Xi, T., Xu, G., Sun, Y., Zhu, F., & Shen, B. (2021). Pclion: An ontology for data standardization and sharing of prostate cancer associated lifestyles. International Journal of Medical Informatics, 145, 104332. https:\/\/doi.org\/10.1016\/j.ijmedinf.2020.104332","journal-title":"International Journal of Medical Informatics"},{"key":"2213_CR19","doi-asserted-by":"publisher","unstructured":"Clark, A. J., Jirak, I. L., Dembek, S. R., Creager, G. J., Kong, F., Thomas, K. W., Knopfmeier, K. H., Gallo, B. T., Melick, C. J., Xue, M., Brewster, K. A., Jung, Y., Kennedy, A., Dong, X., Markel, J., Gilmore, M., Romine, G. S., Fossell, K. R., Sobash, R. A., ... D. A. (2018). The community leveraged unified ensemble (clue) in the 2016 NOAA\/hazardous weather testbed spring forecasting experiment. Bulletin of the American Meteorological Society, 99(7), 1433\u20131448. https:\/\/doi.org\/10.1175\/BAMS-D-16-0309.1","DOI":"10.1175\/BAMS-D-16-0309.1"},{"issue":"1","key":"2213_CR20","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1007\/s10845-013-0856-5","volume":"27","author":"R Costa","year":"2016","unstructured":"Costa, R., Lima, C., Sarraipa, J., & Jardim-Gon\u00e7alves, R. (2016). Facilitating knowledge sharing and reuse in building and construction domain: An ontology-based approach. Journal of Intelligent Manufacturing, 27(1), 263\u2013282. https:\/\/doi.org\/10.1007\/s10845-013-0856-5","journal-title":"Journal of Intelligent Manufacturing"},{"issue":"6","key":"2213_CR21","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1080\/01900692.2020.1729181","volume":"44","author":"JI Criado","year":"2021","unstructured":"Criado, J. I., Dias, T. F., Sano, H., Rojas-Mart\u00edn, F., Silvan, A., & Filho, A. I. (2021). Public innovation and living labs in action: A comparative analysis in post-new public management contexts. International Journal of Public Administration, 44(6), 451\u2013464. https:\/\/doi.org\/10.1080\/01900692.2020.1729181","journal-title":"International Journal of Public Administration"},{"issue":"6","key":"2213_CR22","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1016\/j.respol.2010.01.013","volume":"39","author":"L Dahlander","year":"2010","unstructured":"Dahlander, L., & Gann, D. M. (2010). How open is innovation? Research Policy, 39(6), 699\u2013709. https:\/\/doi.org\/10.1016\/j.respol.2010.01.013","journal-title":"Research Policy"},{"key":"2213_CR23","doi-asserted-by":"publisher","first-page":"6","DOI":"10.22215\/timreview\/1461","volume":"11","author":"K De Vita","year":"2021","unstructured":"De Vita, K., & De Vita, R. (2021). Expect the unexpected: Investigating co-creation projects in a living lab. Technology Innovation Management Review, 11, 6\u201320. https:\/\/doi.org\/10.22215\/timreview\/1461","journal-title":"Technology Innovation Management Review"},{"issue":"4","key":"2213_CR24","doi-asserted-by":"publisher","first-page":"573","DOI":"10.4218\/etrij.2020-0439","volume":"44","author":"R Deepa","year":"2022","unstructured":"Deepa, R., & Vigneshwari, S. (2022). An effective automated ontology construction based on the agriculture domain. ETRI Journal, 44(4), 573\u2013587. https:\/\/doi.org\/10.4218\/etrij.2020-0439","journal-title":"ETRI Journal"},{"key":"2213_CR25","doi-asserted-by":"publisher","first-page":"663","DOI":"10.1016\/j.fuel.2017.05.066","volume":"207","author":"P Deiana","year":"2017","unstructured":"Deiana, P., Bassano, C., Cal\u00ec, G., Miraglia, P., & Maggio, E. (2017). Co2 capture and amine solvent regeneration in Sotacarbo pilot plant. Fuel, 207, 663\u2013670. https:\/\/doi.org\/10.1016\/j.fuel.2017.05.066","journal-title":"Fuel"},{"key":"2213_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13326-016-0088-7","volume":"7","author":"AD Diehl","year":"2016","unstructured":"Diehl, A. D., Meehan, T. F., Bradford, Y. M., Brush, M. H., Dahdul, W. M., Dougall, D. S., He, Y., Osumi-Sutherland, D., Ruttenberg, A., Sarntivijai, S., et al. (2016). The cell ontology 2016: Enhanced content, modularization, and ontology interoperability. Journal of Biomedical Semantics, 7, 1\u201310. https:\/\/doi.org\/10.1186\/s13326-016-0088-7","journal-title":"Journal of Biomedical Semantics"},{"issue":"2","key":"2213_CR27","doi-asserted-by":"publisher","first-page":"128","DOI":"10.12720\/joams.2.2.128-134","volume":"2","author":"L El Bassiti","year":"2014","unstructured":"El Bassiti, L., & Ajhoun, R. (2014). Semantic representation of innovation, generic ontology for idea management. Journal of Advanced Management Science, 2(2), 128\u2013134. https:\/\/doi.org\/10.12720\/joams.2.2.128-134","journal-title":"Journal of Advanced Management Science"},{"issue":"2","key":"2213_CR28","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1111\/1468-2427.12077","volume":"38","author":"J Evans","year":"2014","unstructured":"Evans, J., & Karvonen, A. (2014). \u2018Give me a laboratory and i will lower your carbon footprint!\u2019\u2014-Urban laboratories and the governance of low-carbon futures. International Journal of Urban and Regional Research, 38(2), 413\u2013430. https:\/\/doi.org\/10.1111\/1468-2427.12077","journal-title":"International Journal of Urban and Regional Research"},{"key":"2213_CR29","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1016\/j.scico.2013.12.005","volume":"95","author":"C Faria","year":"2014","unstructured":"Faria, C., Serra, I., & Girardi, R. (2014). A domain-independent process for automatic ontology population from text. Science of Computer Programming, 95, 26\u201343. https:\/\/doi.org\/10.1016\/j.scico.2013.12.005","journal-title":"Science of Computer Programming"},{"key":"2213_CR30","doi-asserted-by":"publisher","first-page":"567","DOI":"10.1016\/j.jbusres.2018.05.039","volume":"110","author":"F Fecher","year":"2020","unstructured":"Fecher, F., Winding, J., Hutter, K., & F\u00fcller, J. (2020). Innovation labs from a participants\u2019 perspective. Journal of Business Research, 110, 567\u2013576. https:\/\/doi.org\/10.1016\/j.jbusres.2018.05.039","journal-title":"Journal of Business Research"},{"key":"2213_CR31","unstructured":"Fern\u00e1ndez-L\u00f3pez, M., Gomez-Perez, A., & Juristo, N. (1997). Methontology: From ontological art towards ontological engineering. In 1997 AAAI spring symposium."},{"issue":"2","key":"2213_CR32","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1017\/S0890060419000088","volume":"33","author":"A Gabriel","year":"2019","unstructured":"Gabriel, A., Chavez, B. P., & Monticolo, D. (2019). Methodology to design ontologies from organizational models: Application to creativity workshops. AI EDAM, 33(2), 148\u2013159. https:\/\/doi.org\/10.1017\/S0890060419000088","journal-title":"AI EDAM"},{"key":"2213_CR33","unstructured":"Greenly, W. (2012). Ontology for innovation. Retrieved from http:\/\/www.lexicater.co.uk\/vocabularies\/innovation\/ns.html"},{"issue":"2","key":"2213_CR34","doi-asserted-by":"publisher","first-page":"791","DOI":"10.3390\/su13020791","volume":"13","author":"K Greve","year":"2021","unstructured":"Greve, K., De Vita, R., Leminen, S., & Westerlund, M. (2021). Living labs: From niche to mainstream innovation management. Sustainability, 13(2), 791. https:\/\/doi.org\/10.3390\/su13020791","journal-title":"Sustainability"},{"issue":"08","key":"2213_CR35","doi-asserted-by":"publisher","first-page":"2040003","DOI":"10.1142\/S1363919620400034","volume":"24","author":"K Greve","year":"2020","unstructured":"Greve, K., Leminen, S., De Vita, R., & Westerlund, M. (2020). Unveiling the diversity of scholarly debate on living labs: A bibliometric approach. International Journal of Innovation Management, 24(08), 2040003. https:\/\/doi.org\/10.1142\/S1363919620400034","journal-title":"International Journal of Innovation Management"},{"key":"2213_CR36","unstructured":"Greve, K., & O\u2019Sullivan, E. (2019). Demonstration environments for emerging technologies: Insights from a living lab. In ISPIM conference proceedings. The international society for professional innovation management (ISPIM) (pp. 1\u201313)."},{"issue":"2","key":"2213_CR37","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1006\/knac.1993.1008","volume":"5","author":"TR Gruber","year":"1993","unstructured":"Gruber, T. R. (1993). A translation approach to portable ontology specifications. Knowledge Acquisition, 5(2), 199\u2013220. https:\/\/doi.org\/10.1006\/knac.1993.1008","journal-title":"Knowledge Acquisition"},{"key":"2213_CR38","unstructured":"He, T., Zhang, X., & Ye, X. (2006). An approach to automatically constructing domain ontology. In Proceedings of the 20th pacific asia conference on language, information and computation (pp. 150\u2013157)."},{"issue":"9","key":"2213_CR39","doi-asserted-by":"publisher","first-page":"1743","DOI":"10.1016\/j.respol.2016.05.005","volume":"45","author":"H Hellsmark","year":"2016","unstructured":"Hellsmark, H., Frishammar, J., S\u00f6derholm, P., & Ylinenp\u00e4\u00e4, H. (2016). The role of pilot and demonstration plants in technology development and innovation policy. Research Policy, 45(9), 1743\u20131761. https:\/\/doi.org\/10.1016\/j.respol.2016.05.005","journal-title":"Research Policy"},{"issue":"3","key":"2213_CR40","doi-asserted-by":"publisher","first-page":"264","DOI":"10.1016\/j.jengtecman.2013.05.002","volume":"30","author":"U H\u00f6gman","year":"2013","unstructured":"H\u00f6gman, U., & Johannesson, H. (2013). Applying stage-gate processes to technology development-experience from six hardware-oriented companies. Journal of Engineering and Technology Management, 30(3), 264\u2013287. https:\/\/doi.org\/10.1016\/j.jengtecman.2013.05.002","journal-title":"Journal of Engineering and Technology Management"},{"issue":"2","key":"2213_CR41","doi-asserted-by":"publisher","first-page":"959","DOI":"10.1007\/s10845-018-1427-6","volume":"30","author":"E J\u00e4rvenp\u00e4\u00e4","year":"2019","unstructured":"J\u00e4rvenp\u00e4\u00e4, E., Siltala, N., Hylli, O., & Lanz, M. (2019). The development of an ontology for describing the capabilities of manufacturing resources. Journal of Intelligent Manufacturing, 30(2), 959\u2013978. https:\/\/doi.org\/10.1007\/s10845-018-1427-6","journal-title":"Journal of Intelligent Manufacturing"},{"issue":"2","key":"2213_CR42","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1016\/j.websem.2005.10.001","volume":"4","author":"A Kalyanpur","year":"2006","unstructured":"Kalyanpur, A., Parsia, B., Sirin, E., Grau, B. C., & Hendler, J. (2006). Swoop: A web ontology editing browser. Journal of Web Semantics, 4(2), 144\u2013153. https:\/\/doi.org\/10.1016\/j.websem.2005.10.001","journal-title":"Journal of Web Semantics"},{"issue":"3","key":"2213_CR43","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1007\/s10845-019-01471-2","volume":"31","author":"D-Y Kim","year":"2020","unstructured":"Kim, D.-Y., Park, J.-W., Baek, S., Park, K.-B., Kim, H.-R., Park, J.-I., Kim, H.-S., Kim, B.-B., Oh, H.-Y., Namgung, K., & Baek, W. (2020). A modular factory testbed for the rapid reconfiguration of manufacturing systems. Journal of Intelligent Manufacturing, 31(3), 661\u2013680. https:\/\/doi.org\/10.1007\/s10845-019-01471-2","journal-title":"Journal of Intelligent Manufacturing"},{"issue":"4","key":"2213_CR44","doi-asserted-by":"publisher","first-page":"bbaa199","DOI":"10.1093\/bib\/bbaa199","volume":"22","author":"M Kulmanov","year":"2020","unstructured":"Kulmanov, M., Smaili, F. Z., Gao, X., & Hoehndorf, R. (2020). Semantic similarity and machine learning with ontologies. Briefings in Bioinformatics, 22(4), bbaa199. https:\/\/doi.org\/10.1093\/bib\/bbaa199","journal-title":"Briefings in Bioinformatics"},{"key":"2213_CR45","doi-asserted-by":"publisher","DOI":"10.1007\/s10845-021-01807-x","author":"A Kumar","year":"2021","unstructured":"Kumar, A., & Starly, B. (2021). \u201cFabNER\u2019\u2019: Information extraction from manufacturing process science domain literature using named entity recognition. Journal of Intelligent Manufacturing. https:\/\/doi.org\/10.1007\/s10845-021-01807-x","journal-title":"Journal of Intelligent Manufacturing"},{"key":"2213_CR46","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1016\/j.jengtecman.2015.08.008","volume":"37","author":"S Leminen","year":"2015","unstructured":"Leminen, S., Nystr\u00f6m, A.-G., & Westerlund, M. (2015). A typology of creative consumers in living labs. Journal of Engineering and Technology Management, 37, 6\u201320. https:\/\/doi.org\/10.1016\/j.jengtecman.2015.08.008","journal-title":"Journal of Engineering and Technology Management"},{"key":"2213_CR47","doi-asserted-by":"publisher","first-page":"6","DOI":"10.22215\/timreview\/602","volume":"2","author":"S Leminen","year":"2012","unstructured":"Leminen, S., Westerlund, M., & Nystr\u00f6m, A.-G. (2012). Living labs as open-innovation networks. Technology Innovation Management Review, 2, 6\u201311.","journal-title":"Technology Innovation Management Review"},{"key":"2213_CR48","doi-asserted-by":"publisher","unstructured":"Liang, S., Du, X., Tan, C.\u00a0C., & Yu, W. (2014). An effective online scheme for detecting android malware. In 2014 23rd international conference on computer communication and networks (ICCCN) (pp. 1\u20138). https:\/\/doi.org\/10.1109\/ICCCN.2014.6911740","DOI":"10.1109\/ICCCN.2014.6911740"},{"issue":"2","key":"2213_CR49","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1609\/icwsm.v5i2.14205","volume":"5","author":"L Lorenzo","year":"2021","unstructured":"Lorenzo, L., Lizarralde, O., Santos, I., & Passant, A. (2021). Structuring e-brainstorming to better support innovation processes. Proceedings of the International AAAI Conference on Web and Social Media, 5(2), 20\u201323. https:\/\/doi.org\/10.1609\/icwsm.v5i2.14205","journal-title":"Proceedings of the International AAAI Conference on Web and Social Media"},{"issue":"2","key":"2213_CR50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4018\/jdm.2004040101","volume":"15","author":"A Lozano-Tello","year":"2004","unstructured":"Lozano-Tello, A., & Gomez-Perez, A. (2004). ONTOMETRIC: A method to choose the appropriate ontology. Journal of Database Management, 15(2), 1\u201318. https:\/\/doi.org\/10.4018\/jdm.2004040101","journal-title":"Journal of Database Management"},{"issue":"1","key":"2213_CR51","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1007\/s10845-016-1250-x","volume":"30","author":"Y Lu","year":"2019","unstructured":"Lu, Y., Wang, H., & Xu, X. (2019). ManuService ontology: A product data model for service-oriented business interactions in a cloud manufacturing environment. Journal of Intelligent Manufacturing, 30(1), 317\u2013334. https:\/\/doi.org\/10.1007\/s10845-016-1250-x","journal-title":"Journal of Intelligent Manufacturing"},{"key":"2213_CR52","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1007\/3-540-45810-7_24","volume-title":"Knowledge engineering and knowledge management: Ontologies and the semantic web","author":"A Maedche","year":"2002","unstructured":"Maedche, A., & Staab, S. (2002). Measuring similarity between ontologies. In A. G\u00f3mez-P\u00e9rez & V. R. Benjamins (Eds.), Knowledge engineering and knowledge management: Ontologies and the semantic web (pp. 251\u2013263). Springer. https:\/\/doi.org\/10.1007\/3-540-45810-7_24"},{"key":"2213_CR53","doi-asserted-by":"publisher","unstructured":"Mahmoud, N., Elbeh, H., & Abdlkader, H.\u00a0M. (2018). Ontology learning based on word embeddings for text big data extraction. In 2018 14th international computer engineering conference (ICENCO) (pp. 183\u2013188). IEEE. https:\/\/doi.org\/10.1109\/ICENCO.2018.8636154.","DOI":"10.1109\/ICENCO.2018.8636154"},{"key":"2213_CR54","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809071","volume-title":"Introduction to information retrieval","author":"CD Manning","year":"2008","unstructured":"Manning, C. D., Raghavan, P., & Sch\u00fctze, H. (2008). Introduction to information retrieval. Cambridge University Press. https:\/\/doi.org\/10.1017\/CBO9780511809071"},{"key":"2213_CR55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.technovation.2016.02.005","volume":"50\u201351","author":"S Mian","year":"2016","unstructured":"Mian, S., Lamine, W., & Fayolle, A. (2016). Technology business incubation: An overview of the state of knowledge. Technovation, 50\u201351, 1\u201312. https:\/\/doi.org\/10.1016\/j.technovation.2016.02.005","journal-title":"Technovation"},{"key":"2213_CR56","unstructured":"Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv:1301.3781"},{"key":"2213_CR57","unstructured":"Mizoguchi, R. & Ikeda, M. (1997). Towards ontology engineering. In Proceedings of joint pacific asian conference on expert systems: international conference on intelligent systems (pp. 259\u2013266). Singapore."},{"key":"2213_CR58","doi-asserted-by":"publisher","DOI":"10.1007\/s10845-021-01855-3","author":"JJ Montero Jim\u00e9nez","year":"2021","unstructured":"Montero Jim\u00e9nez, J. J., Vingerhoeds, R., Grabot, B., & Schwartz, S. (2021). An ontology model for maintenance strategy selection and assessment. Journal of Intelligent Manufacturing. https:\/\/doi.org\/10.1007\/s10845-021-01855-3","journal-title":"Journal of Intelligent Manufacturing"},{"key":"2213_CR59","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10845-021-01749-4","volume":"33","author":"X Ni","year":"2022","unstructured":"Ni, X., Samet, A., & Cavallucci, D. (2022). Similarity-based approach for inventive design solutions assistance. Journal of Intelligent Manufacturing, 33, 1\u201318. https:\/\/doi.org\/10.1007\/s10845-021-01749-4","journal-title":"Journal of Intelligent Manufacturing"},{"issue":"1\u20132","key":"2213_CR60","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1504\/IJISE.2006.009052","volume":"1","author":"K Ning","year":"2006","unstructured":"Ning, K., O\u2019Sullivan, D., Zhu, Q., & Decker, S. (2006). Semantic innovation management across the extended enterprise. International Journal of Industrial and Systems Engineering, 1(1\u20132), 109\u2013128. https:\/\/doi.org\/10.1504\/IJISE.2006.009052","journal-title":"International Journal of Industrial and Systems Engineering"},{"key":"2213_CR61","unstructured":"Noy, N.\u00a0F. & McGuinness, D.\u00a0L. (2001). Ontology development 101: A guide to creating your first ontology. Stanford Knowledge Systems Laboratory. Retrieved from http:\/\/protege.stanford.edu\/publications\/ontology_development\/ontology101.pdf"},{"issue":"1","key":"2213_CR62","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1111\/caim.12301","volume":"28","author":"F Osorio","year":"2019","unstructured":"Osorio, F., Dupont, L., Camargo, M., Palominos, P., Pe\u00f1a, J. I., & Alfaro, M. (2019). Design and management of innovation laboratories: Toward a performance assessment tool. Creativity and Innovation Management, 28(1), 82\u2013100. https:\/\/doi.org\/10.1111\/caim.12301","journal-title":"Creativity and Innovation Management"},{"key":"2213_CR63","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1016\/j.comnet.2017.03.012","volume":"119","author":"GZ Papadopoulos","year":"2017","unstructured":"Papadopoulos, G. Z., Gallais, A., Schreiner, G., Jou, E., & Noel, T. (2017). Thorough IoT testbed characterization: From proof-of-concept to repeatable experimentations. Computer Networks, 119, 86\u2013101. https:\/\/doi.org\/10.1016\/j.comnet.2017.03.012","journal-title":"Computer Networks"},{"key":"2213_CR64","unstructured":"Porzel, R. & Malaka, R. (2004). A task-based approach for ontology evaluation. In ECAI workshop on ontology learning and population (pp. 1\u20136)."},{"key":"2213_CR65","unstructured":"Prot\u00e9g\u00e9 (2000). The Prot\u00e9g\u00e9 Project. http:\/\/protege.stanford.edu."},{"key":"2213_CR66","doi-asserted-by":"publisher","unstructured":"Raad, J. & Cruz, C. (2015). A survey on ontology evaluation methods. In Proceedings of the international joint conference on knowledge discovery, knowledge engineering and knowledge management, IC3K 2015 (pp. 179\u2013186). SCITEPRESS\u2014Science and Technology Publications, Lda. https:\/\/doi.org\/10.5220\/0005591001790186","DOI":"10.5220\/0005591001790186"},{"key":"2213_CR67","doi-asserted-by":"publisher","unstructured":"Riedl, C., May, N., Finzen, J., Stathel, S., Kaufman, V., & Krcmar, H. (2011). An idea ontology for innovation management. In Sheth, A., (Ed.), Semantic services, interoperability and web applications: Emerging concepts (pp. 303\u2013321). IGI Global. https:\/\/doi.org\/10.4018\/978-1-60960-593-3.ch012","DOI":"10.4018\/978-1-60960-593-3.ch012"},{"key":"2213_CR68","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1016\/j.bjp.2013.12.020","volume":"61","author":"L Sanchez","year":"2014","unstructured":"Sanchez, L., Mu\u00f1oz, L., Galache, J. A., Sotres, P., Santana, J. R., Gutierrez, V., Ramdhany, R., Gluhak, A., Krco, S., Theodoridis, E., & Pfisterer, D. (2014). Smartsantander: Iot experimentation over a smart city testbed. Computer Networks, 61, 217\u2013238. https:\/\/doi.org\/10.1016\/j.bjp.2013.12.020","journal-title":"Computer Networks"},{"key":"2213_CR69","doi-asserted-by":"publisher","unstructured":"Schnabel, T., Labutov, I., Mimno, D., & Joachims, T. (2015). Evaluation methods for unsupervised word embeddings. In Proceedings of the 2015 conference on empirical methods in natural language processing (pp. 298\u2013307). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/D15-1036","DOI":"10.18653\/v1\/D15-1036"},{"key":"2213_CR70","doi-asserted-by":"publisher","first-page":"7","DOI":"10.22215\/timreview\/1045","volume":"7","author":"D Schuurman","year":"2017","unstructured":"Schuurman, D., & T\u00f5nurist, P. (2017). Innovation in the public sector: Exploring the characteristics and potential of living labs and innovation labs. Technology Innovation Management Review, 7, 7\u201314.","journal-title":"Technology Innovation Management Review"},{"key":"2213_CR71","unstructured":"Shearer, R.\u00a0D., Motik, B., & Horrocks, I. (2008). Hermit: A highly-efficient owl reasoner. In Owled (vol. 432, p.\u00a091)."},{"key":"2213_CR72","unstructured":"Stankovic, M. (2010). Open innovation and semantic web: Problem solver search on linked data. In Proceedings of international semantic web conference (ISWC) 7th\u201311th Novebmer."},{"issue":"1","key":"2213_CR73","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/S0169-023X(97)00056-6","volume":"25","author":"R Studer","year":"1998","unstructured":"Studer, R., Benjamins, V., & Fensel, D. (1998). Knowledge engineering: Principles and methods. Data & Knowledge Engineering, 25(1), 161\u2013197. https:\/\/doi.org\/10.1016\/S0169-023X(97)00056-6","journal-title":"Data & Knowledge Engineering"},{"issue":"5","key":"2213_CR74","doi-asserted-by":"publisher","first-page":"2171","DOI":"10.1007\/s10845-017-1376-5","volume":"30","author":"A Talhi","year":"2019","unstructured":"Talhi, A., Fortineau, V., Huet, J.-C., & Lamouri, S. (2019). Ontology for cloud manufacturing based Product Lifecycle Management. Journal of Intelligent Manufacturing, 30(5), 2171\u20132192. https:\/\/doi.org\/10.1007\/s10845-017-1376-5","journal-title":"Journal of Intelligent Manufacturing"},{"key":"2213_CR75","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2020.100548","volume":"60","author":"L Turchet","year":"2020","unstructured":"Turchet, L., Antoniazzi, F., Viola, F., Giunchiglia, F., & Fazekas, G. (2020). The internet of musical things ontology. Journal of Web Semantics, 60, 100548. https:\/\/doi.org\/10.1016\/j.websem.2020.100548","journal-title":"Journal of Web Semantics"},{"key":"2213_CR76","doi-asserted-by":"publisher","unstructured":"Turhan, A.-Y. (2011). Description logic reasoning for semantic web ontologies. In Proceedings of the international conference on web intelligence, mining and semantics, WIMS \u201911. Association for Computing Machinery. https:\/\/doi.org\/10.1145\/1988688.1988696","DOI":"10.1145\/1988688.1988696"},{"key":"2213_CR77","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.jclepro.2015.08.053","volume":"123","author":"Y Voytenko","year":"2016","unstructured":"Voytenko, Y., McCormick, K., Evans, J., & Schliwa, G. (2016). Urban living labs for sustainability and low carbon cities in Europe: Towards a research agenda. Advancing Sustainable Solutions: An Interdisciplinary and Collaborative Research Agenda, 123, 45\u201354. https:\/\/doi.org\/10.1016\/j.jclepro.2015.08.053","journal-title":"Advancing Sustainable Solutions: An Interdisciplinary and Collaborative Research Agenda"},{"key":"2213_CR78","doi-asserted-by":"publisher","unstructured":"Vrande\u010di\u0107, D. (2009). Ontology evaluation (pp. 293\u2013313). Springer. https:\/\/doi.org\/10.1007\/978-3-540-92673-3_13","DOI":"10.1007\/978-3-540-92673-3_13"},{"key":"2213_CR79","doi-asserted-by":"publisher","unstructured":"Walisadeera, A.\u00a0I., Ginige, A., & Wikramanayake, G.\u00a0N. (2016). Ontology evaluation approaches: A case study from agriculture domain. In Computational science and its applications\u2014ICCSA 2016, July 4\u20137 (vol. 9789, pp. 318\u2013333). Springer. https:\/\/doi.org\/10.1007\/978-3-319-42089-9_23","DOI":"10.1007\/978-3-319-42089-9_23"},{"key":"2213_CR80","doi-asserted-by":"publisher","unstructured":"Werner-Allen, G., Swieskowski, P., & Welsh, M. (2005). MoteLab: A wireless sensor network testbed. In IPSN 2005. In Fourth international symposium on information processing in sensor networks (pp. 483\u2013488). https:\/\/doi.org\/10.1109\/IPSN.2005.1440979","DOI":"10.1109\/IPSN.2005.1440979"},{"key":"2213_CR81","doi-asserted-by":"publisher","first-page":"40","DOI":"10.22215\/timreview\/1170","volume":"8","author":"M Westerlund","year":"2018","unstructured":"Westerlund, M., Leminen, S., & Rajahonka, M. (2018). A topic modelling analysis of living labs research. Technology Innovation Management Review, 8, 40\u201351. https:\/\/doi.org\/10.22215\/timreview\/1170","journal-title":"Technology Innovation Management Review"},{"key":"2213_CR82","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1007\/978-3-642-16552-8_18","volume-title":"Metadata and semantic research","author":"A Westerski","year":"2010","unstructured":"Westerski, A., Iglesias, C. A., & Rico, F. T. (2010). A model for integration and interlinking of idea management systems. In S. S\u00e1nchez-Alonso & I. N. Athanasiadis (Eds.), Metadata and semantic research (pp. 183\u2013194). Springer. https:\/\/doi.org\/10.1007\/978-3-642-16552-8_18"},{"issue":"4","key":"2213_CR83","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1080\/09540962.2019.1592920","volume":"39","author":"A Whicher","year":"2019","unstructured":"Whicher, A., & Crick, T. (2019). Co-design, evaluation and the northern Ireland innovation lab. Public Money & Management, 39(4), 290\u2013299. https:\/\/doi.org\/10.1080\/09540962.2019.1592920","journal-title":"Public Money & Management"},{"key":"2213_CR84","doi-asserted-by":"publisher","DOI":"10.1145\/2333112.2333115","author":"W Wong","year":"2012","unstructured":"Wong, W., Liu, W., & Bennamoun, M. (2012). Ontology learning from text: A look back and into the future. ACM Computing Surveys. https:\/\/doi.org\/10.1145\/2333112.2333115","journal-title":"ACM Computing Surveys"},{"issue":"4","key":"2213_CR85","doi-asserted-by":"publisher","first-page":"231","DOI":"10.3233\/AO-140128","volume":"8","author":"C Zanni-Merk","year":"2013","unstructured":"Zanni-Merk, C., de Bertrand de Beuvron, F., Rousselot, F., & Yan, W. (2013). A formal ontology for a generalized inventive design methodology. Applied Ontology, 8(4), 231\u2013273. https:\/\/doi.org\/10.3233\/AO-140128","journal-title":"Applied Ontology"},{"key":"2213_CR86","doi-asserted-by":"publisher","unstructured":"Zhang, P., Qu, Y., & Huang, C. (2011). Designing a multi-layered ontology for the science and technology innovation concept knowledge-base. In 2011 44th Hawaii international conference on system sciences (HICSS 2011) (pp. 1\u201310). IEEE Computer Society. https:\/\/doi.org\/10.1109\/HICSS.2011.147","DOI":"10.1109\/HICSS.2011.147"},{"issue":"2","key":"2213_CR87","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1145\/235968.233324","volume":"25","author":"T Zhang","year":"1996","unstructured":"Zhang, T., Ramakrishnan, R., & Livny, M. (1996). Birch: An efficient data clustering method for very large databases. ACM SIGMOD Record, 25(2), 103\u2013114. https:\/\/doi.org\/10.1145\/235968.233324","journal-title":"ACM SIGMOD Record"},{"issue":"3","key":"2213_CR88","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1007\/s10799-007-0019-5","volume":"8","author":"L Zhou","year":"2007","unstructured":"Zhou, L. (2007). Ontology learning: State of the art and open issues. Information Technology and Management, 8(3), 241\u2013252. https:\/\/doi.org\/10.1007\/s10799-007-0019-5","journal-title":"Information Technology and Management"},{"issue":"3","key":"2213_CR89","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1332\/174426419X15537488717501","volume":"15","author":"C Zurbriggen","year":"2019","unstructured":"Zurbriggen, C., & Lago, M. G. (2019). An experimental evaluation tool for the public innovation lab of the Uruguayan government. Evidence & Policy, 15(3), 437\u2013451. https:\/\/doi.org\/10.1332\/174426419X15537488717501","journal-title":"Evidence & Policy"}],"container-title":["Journal of Intelligent Manufacturing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10845-023-02213-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10845-023-02213-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10845-023-02213-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T12:07:54Z","timestamp":1725538074000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10845-023-02213-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,10]]},"references-count":89,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["2213"],"URL":"https:\/\/doi.org\/10.1007\/s10845-023-02213-1","relation":{},"ISSN":["0956-5515","1572-8145"],"issn-type":[{"value":"0956-5515","type":"print"},{"value":"1572-8145","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,10]]},"assertion":[{"value":"13 October 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 September 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}