{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T14:43:05Z","timestamp":1781102585791,"version":"3.54.1"},"reference-count":21,"publisher":"IGI Global Scientific Publishing","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,7]]},"abstract":"<jats:p>This article describes the process of developing a framework and an instrument for measuring and ascertaining the openness of a system applicable to system architectures and their implementations. Our process includes an in-depth review of pertinent literature in the areas of Open Systems and Open Architecture, followed by a selection of the appropriate methodology to use. We chose the Goal-Question-Metric (GQM) methodology to allow us to select relevant goals, factors and metric that can be used to measure a system's level of openness. The article details these goals, factors and metrics. We carried out studies of these factors with fourteen experts in open systems engineering: an initial study with seven of these experts helping us refine the selected goals, factors and metrics, with a second confirmatory study performed in conjunction with the remaining seven experts. The goals, questions and metrics are detailed in the appendices.<\/jats:p>","DOI":"10.4018\/ijoci.2020070104","type":"journal-article","created":{"date-parts":[[2020,6,17]],"date-time":"2020-06-17T10:02:30Z","timestamp":1592388150000},"page":"55-96","source":"Crossref","is-referenced-by-count":1,"title":["Developing a Framework and an Instrument for Measuring System Openness"],"prefix":"10.4018","volume":"10","author":[{"given":"Tope","family":"Omitola","sequence":"first","affiliation":[{"name":"University of Southampton, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5771-4088","authenticated-orcid":true,"given":"Gary","family":"Wills","sequence":"additional","affiliation":[{"name":"University of Southampton, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"IJOCI.2020070104-0","doi-asserted-by":"publisher","DOI":"10.5688\/aj7408141"},{"key":"IJOCI.2020070104-1","unstructured":"Basili, V. R. (1992). Software Modeling and Measurement: The Goal\/Question\/Metric Paradigm. University of Maryland."},{"key":"IJOCI.2020070104-2","unstructured":"Basili, V. R., Caldiera, G., & Rombach, H. D. (1994). Goal Question Metric Paradigm. In Encyclopedia of Software Engineering. Academic Press."},{"key":"IJOCI.2020070104-3","doi-asserted-by":"publisher","DOI":"10.2307\/2655606"},{"key":"IJOCI.2020070104-4","author":"N. K.Denzin","year":"1978","journal-title":"The Research Act"},{"key":"IJOCI.2020070104-5","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2929.2006.02418.x"},{"key":"IJOCI.2020070104-6","unstructured":"IEEE. (1990). IEEE Standard Glossary of Software Engineering Terminology."},{"key":"IJOCI.2020070104-7","unstructured":"Incose. (2015). Guide to the Systems Engineering Body of Knowledge (SEBoK)."},{"key":"IJOCI.2020070104-8","unstructured":"International Organization for Standardization (2011). ISO\/IEC\/IEEE Systems and software engineering -- Architecture description ISO\/IEC\/IEEE 42010:2011(E)."},{"key":"IJOCI.2020070104-9","doi-asserted-by":"publisher","DOI":"10.2307\/2392366"},{"key":"IJOCI.2020070104-10","doi-asserted-by":"publisher","DOI":"10.1177\/1558689810390217"},{"key":"IJOCI.2020070104-11","author":"T.Oberndorf","year":"2010","journal-title":"Open Systems"},{"key":"IJOCI.2020070104-12","unstructured":"Open Systems Joint Task Force. (2004). A Modular Open Systems Approach to Acquisition."},{"key":"IJOCI.2020070104-13","author":"U.Sekaran","year":"2016","journal-title":"Research Methods For Business: A Skill Building Approach"},{"key":"IJOCI.2020070104-14","author":"B.Sims","year":"2012","journal-title":"Approaches to Open Technology Systems Specification"},{"key":"IJOCI.2020070104-15","unstructured":"Sledge, C. (2015). A Discussion on Open-Systems Architecture."},{"key":"IJOCI.2020070104-16","doi-asserted-by":"publisher","DOI":"10.4135\/9781506335193.n1"},{"key":"IJOCI.2020070104-17","doi-asserted-by":"publisher","DOI":"10.4135\/9781412983525"},{"key":"IJOCI.2020070104-18","doi-asserted-by":"publisher","DOI":"10.1111\/j.1547-5069.2001.00253.x"},{"key":"IJOCI.2020070104-19","unstructured":"U.S. DoD. (2013). Open Systems Architecture Contract Guidebook for Program Managers (v.1.1)."},{"key":"IJOCI.2020070104-20","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2019.04.009"}],"container-title":["International Journal of Organizational and Collective Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=256981","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T10:08:48Z","timestamp":1651831728000},"score":1,"resource":{"primary":{"URL":"http:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/IJOCI.2020070104"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2020,7]]},"references-count":21,"journal-issue":{"issue":"3"},"URL":"https:\/\/doi.org\/10.4018\/ijoci.2020070104","relation":{},"ISSN":["1947-9344","1947-9352"],"issn-type":[{"value":"1947-9344","type":"print"},{"value":"1947-9352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7]]}}}