{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T00:17:12Z","timestamp":1781050632309,"version":"3.54.1"},"reference-count":49,"publisher":"SAGE Publications","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IP"],"published-print":{"date-parts":[[2020,9,4]]},"abstract":"<jats:p>The purpose of this paper is to provide an overview of how Estonia used action research and systems theory to improve the performance their Open Government Data (OGD) ecosystem. This paper understands performance of OGD ecosystems of as consisting of three parts: 1) OGD supply, 2) OGD usage, 3) communication, interaction, and linkages between OGD suppliers and users. It was believed that by taking a holistic approach, encouraging transparency and co-creation, and manipulating feedback loops it was possible to improve the performance of the ecosystem. The research uses and validates previous research on open government data ecosystems and by doing so also achieved increased levels of performance in Estonia\u2019s OGD ecosystem. The paper\u2019s main contributions are the creation of a framework based on systems theory, systems thinking, and action research for enacting strategic change in OGD ecosystems, conceptualizing feedback loops as a core part of OGD ecosystems, and the conceptualization of performance in OGD ecosystems. The paper concludes by offering nine core insights related to OGD ecosystems and their performance.<\/jats:p>","DOI":"10.3233\/ip-190195","type":"journal-article","created":{"date-parts":[[2020,6,19]],"date-time":"2020-06-19T12:09:21Z","timestamp":1592568561000},"page":"377-402","source":"Crossref","is-referenced-by-count":13,"title":["Systemic change, open data ecosystem performance improvements, and empirical insights from Estonia: A country-level action research study"],"prefix":"10.1177","volume":"25","author":[{"given":"Keegan","family":"McBride","sequence":"first","affiliation":[{"name":"Ragnar Nurkse Department of Innovation and Governance, Tallinn University of Technology, Tallinn, Estonia"},{"name":"Information Systems Research Group, Department of Software Science, Tallinn University of Technology, Tallinn, Estonia"},{"name":"GovAiLab, Tallinn University of Technology, Tallinn, Estonia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maarja","family":"Olesk","sequence":"additional","affiliation":[{"name":"Ragnar Nurkse Department of Innovation and Governance, Tallinn University of Technology, Tallinn, Estonia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andres","family":"K\u00fctt","sequence":"additional","affiliation":[{"name":"Proud Engineers, Tallinn, Estonia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diana","family":"Shysh","sequence":"additional","affiliation":[{"name":"Ragnar Nurkse Department of Innovation and Governance, Tallinn University of Technology, Tallinn, Estonia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","reference":[{"key":"10.3233\/IP-190195_ref1","doi-asserted-by":"crossref","unstructured":"Alexopoulos, C., Zuiderwijk, A., Charapabidis, Y., Loukis, E., & Janssen, M. (2014). Designing a Second Generation of Open Data Platforms: Integrating Open Data and Social Media. In Janssen, M., Scholl, H.J., Wimmer, M.A., & Bannister, F., (Eds.), Electronic Government: Proceedings of the 13th IFIP WG 8.5 International Conference, EGOV 2014, Vol. 8653, pp.\u00a0230\u2013241. Dublin, Ireland. Retrieved from http:\/\/link.springer.com\/chapter\/10.1007\/978-3-662-44426-9_19.","DOI":"10.1007\/978-3-662-44426-9_19"},{"issue":"1\/2","key":"10.3233\/IP-190195_ref2","doi-asserted-by":"publisher","first-page":"129","DOI":"10.3233\/IP-140327","article-title":"Barriers to open data release: a view from the top","volume":"19","author":"Barry","year":"2014","journal-title":"Information Polity"},{"key":"10.3233\/IP-190195_ref3","doi-asserted-by":"publisher","DOI":"10.17705\/1CAIS.00219"},{"issue":"3","key":"10.3233\/IP-190195_ref4","doi-asserted-by":"publisher","first-page":"329","DOI":"10.2307\/25148642","article-title":"Special issue on action research in information systems: making is research relevant to practice: foreword","volume":"28","author":"Baskerville","year":"2004","journal-title":"MIS Quarterly"},{"key":"10.3233\/IP-190195_ref5","doi-asserted-by":"publisher","DOI":"10.2830\/073835"},{"issue":"1","key":"10.3233\/IP-190195_ref6","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1108\/13683041011027490","article-title":"Rediscovering performance management: systems, learning and integration","volume":"14","author":"Brudan","year":"2010","journal-title":"Measuring Business Excellence"},{"issue":"S1","key":"10.3233\/IP-190195_ref7","doi-asserted-by":"publisher","first-page":"S10","DOI":"10.1016\/j.giq.2014.01.003","article-title":"On the barriers for local government releasing open data","volume":"31","author":"Conradie","year":"2014","journal-title":"Government Information Quarterly"},{"issue":"1","key":"10.3233\/IP-190195_ref8","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1108\/TG-12-2015-0052","article-title":"Transparency and open government data: a wide national assessment of data openness in Brazilian local governments","volume":"11","author":"Corr\u00eaa","year":"2017","journal-title":"Transforming Government: People, Process and Policy"},{"issue":"1","key":"10.3233\/IP-190195_ref10","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1111\/j.1365-2575.2004.00162.x","article-title":"Principles of canonical action research","volume":"14","author":"Davison","year":"2004","journal-title":"Information Systems Journal"},{"issue":"1","key":"10.3233\/IP-190195_ref11","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.giq.2016.01.003","article-title":"Planning and designing open government data programs: an ecosystem approach","volume":"33","author":"Dawes","year":"2016","journal-title":"Government Information Quarterly"},{"issue":"3","key":"10.3233\/IP-190195_ref12","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1080\/17538947.2016.1224938","article-title":"How to assess the success of the open data ecosystem","volume":"10","author":"Donker","year":"2017","journal-title":"International Journal of Digital Earth"},{"key":"10.3233\/IP-190195_ref18","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1007\/978-3-319-04810-9","article-title":"How open data are turned into services","volume":"169 LNBIP","author":"Foulonneau","year":"2014","journal-title":"Lecture Notes in Business Information Processing"},{"issue":"1","key":"10.3233\/IP-190195_ref20","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1177\/1476750308099596","article-title":"There is nothing so theoretical as good action research","volume":"7","author":"Friedman","year":"2009","journal-title":"Action Research"},{"issue":"2","key":"10.3233\/IP-190195_ref21","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1057\/ejis.2011.54","article-title":"Pragmatism vs interpretivism in qualitative information systems research","volume":"21","author":"Goldkuhl","year":"2012","journal-title":"European Journal of Information Systems"},{"issue":"4","key":"10.3233\/IP-190195_ref22","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1016\/j.giq.2015.09.001","article-title":"The multiple meanings of open government data: understanding different stakeholders and their perspectives","volume":"32","author":"Gonzalez-Zapata","year":"2015","journal-title":"Government Information Quarterly"},{"key":"10.3233\/IP-190195_ref23","unstructured":"Ham, J., Lee, J.-N., Kim, D., & Choi, B. (2015). Open Innovation Maturity Model for the Government: An Open System Perspective. In 36th International Conference on Information Systems (ICIS 2015). Fort Worth, TX, USA."},{"issue":"2","key":"10.3233\/IP-190195_ref24","doi-asserted-by":"crossref","first-page":"83","DOI":"10.3233\/IP-2012-0269","article-title":"Open government and e-government: democratic challenges from a public value perspective","volume":"17","author":"Harrison","year":"2012","journal-title":"Information Polity: The International Journal of Government & Democracy in the Information Age"},{"issue":"4","key":"10.3233\/IP-190195_ref25","doi-asserted-by":"publisher","first-page":"900","DOI":"10.3390\/fi4040900","article-title":"Creating open government ecosystems: a research and development agenda","volume":"4","author":"Harrison","year":"2012","journal-title":"Future Internet"},{"key":"10.3233\/IP-190195_ref26","unstructured":"Heimst\u00e4dt, M., Saunderson, F., & Heath, T. (2014a). Conceptualizing Open Data ecosystems: A timeline analysis of Open Data development in the UK. In Conference for E-Democracy and Open Governement, p. 245."},{"issue":"2","key":"10.3233\/IP-190195_ref27","doi-asserted-by":"publisher","first-page":"123","DOI":"10.29379\/jedem.v6i2.330","article-title":"From toddler to teen: growth of an open data ecosystem","volume":"6","author":"Heimst\u00e4dt","year":"2014","journal-title":"JeDEM \u2013 EJournal of EDemocracy and Open Government"},{"key":"10.3233\/IP-190195_ref28","unstructured":"Huber, S. (2012). Indicators For The Fitness Of Municipal Open Government Data (ogd) To Be Processed Into E-participation Innovations With Intended Societal Impacts. In Scholl, H.J., Flak, L.S., Janssen, M., Macintosh, A., Moe, C.E., S\u00e6b\u00f8, \u00d8, Wimmer, M.A., (Eds.), Electronic Government and Electronic Participation: Joint Proceedings of Ongoing Research and Projects of IFIP WG 8.5 EGOV and ePart 2012, Vol. 39, pp. 249\u2013258. Kristiansand, Norway."},{"key":"10.3233\/IP-190195_ref29","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1109\/ACCESS.2014.2302872","article-title":"Requirements of an open data based business ecosystem","volume":"2","author":"Immonen","year":"2014","journal-title":"IEEE Access"},{"key":"10.3233\/IP-190195_ref30","doi-asserted-by":"publisher","DOI":"10.17722\/ijrbt.v4i1.197"},{"issue":"4","key":"10.3233\/IP-190195_ref31","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1080\/10580530.2012.716740","article-title":"Benefits, adoption barriers and myths of open data and open government","volume":"29","author":"Janssen","year":"2012","journal-title":"Information Systems Management"},{"key":"10.3233\/IP-190195_ref32","doi-asserted-by":"crossref","unstructured":"Juell-Skielse, G., Hjalmarsson, A., Johannesson, P., & Rudmark, D. (2014). Is the Public Motivated to Engage in Open Data Innovation? In Janssen, M., Scholl, H.J., Wimmer, M.A., & Bannister, F., (Eds.), Electronic Government: Proceedings of the 13th IFIP WG 8.5 International Conference, EGOV 2014, Vol. 8653, pp. 277\u2013288. Dublin, Ireland. Retrieved from http:\/\/link.springer.com\/chapter\/10.1007\/978-3-662-44426-9_23.","DOI":"10.1007\/978-3-662-44426-9_23"},{"issue":"2","key":"10.3233\/IP-190195_ref33","doi-asserted-by":"publisher","first-page":"142","DOI":"10.1007\/s13398-014-0173-7.2","article-title":"Innovation: a factor explaining e-government success in estonia","volume":"9","author":"Kalvet","year":"2012","journal-title":"Electronic Government"},{"issue":"4","key":"10.3233\/IP-190195_ref34","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1016\/j.giq.2013.05.012","article-title":"A promising phenomenon of open data: a case study of the Chicago open data project","volume":"30","author":"Kassen","year":"2013","journal-title":"Government Information Quarterly"},{"issue":"4","key":"10.3233\/IP-190195_ref35","doi-asserted-by":"publisher","first-page":"211","DOI":"10.3233\/IP-170406","article-title":"Towards a model for facilitating and enabling co-creation using open government data","volume":"22","author":"Khayyat","year":"2017","journal-title":"Information Polity"},{"issue":"1","key":"10.3233\/IP-190195_ref36","doi-asserted-by":"publisher","first-page":"86","DOI":"10.2202\/1944-2866.1095","article-title":"Success without strategy: e-government development in estonia","volume":"3","author":"Kitsing","year":"2011","journal-title":"Policy & Internet"},{"key":"10.3233\/IP-190195_ref37","doi-asserted-by":"publisher","DOI":"10.1108\/978-1-78714-501-620171020"},{"key":"10.3233\/IP-190195_ref38","doi-asserted-by":"publisher","DOI":"10.1109\/CBI.2017.51"},{"key":"10.3233\/IP-190195_ref40","doi-asserted-by":"publisher","DOI":"10.1145\/2691195.2691258"},{"key":"10.3233\/IP-190195_ref43","doi-asserted-by":"crossref","unstructured":"Najafabadi, M., & Luna-Reyes, L. (2017). Open Government Data Ecosystems: A Closed-Loop Perspective. In Proceedings of the 50th Hawaii International Conference on System Science (HICSS-50). Waikoloa Village, Hawaii, USA. https:\/\/doi.org\/http:\/\/hdl.handle.net\/10125\/41483.","DOI":"10.24251\/HICSS.2017.327"},{"key":"10.3233\/IP-190195_ref44","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2018.11.006"},{"key":"10.3233\/IP-190195_ref45","doi-asserted-by":"publisher","DOI":"10.3917\/rfap.167.0613"},{"key":"10.3233\/IP-190195_ref46","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-98690-6_16"},{"key":"10.3233\/IP-190195_ref50","doi-asserted-by":"crossref","unstructured":"Nardi, B., & O\u2019Day, V. (1999). Information ecologies: using technology with heart: chapter four: information ecologies. First Monday, 4(5). Retrieved May 29, 2020, from https:\/\/firstmonday.org\/ojs\/index.php\/fm\/article\/view\/672\/582.","DOI":"10.5210\/fm.v4i5.672"},{"key":"10.3233\/IP-190195_ref54","doi-asserted-by":"crossref","unstructured":"Reggi, L., & Dawes, S. (2016). Open Government Data Ecosystems: Linking Transparency for Innovation with Transparency for Participation and Accountability. In: Hans Jochen Scholl, Glassey, O., Janssen, M., Klievink, B., Lindgren, I., Parycek, P., Sa Soare. D., (Eds.), Electronic Government: Proceedings of the 15th IFIP WG 8.5 International Conference, EGOV 2016. Guimar\u00e3es, Portugal: Springer International Publishing.","DOI":"10.1007\/978-3-319-44421-5_6"},{"issue":"1","key":"10.3233\/IP-190195_ref55","first-page":"30","article-title":"Comparative analysis of state administrations: the size of state as an independent","volume":"11","author":"Sarapuu","year":"2010","journal-title":"Halduskultuur \u2013 Administrative Culture"},{"issue":"1","key":"10.3233\/IP-190195_ref56","doi-asserted-by":"publisher","first-page":"205395171769075","DOI":"10.1177\/2053951717690750","article-title":"Data ideologies of an interested public: a study of grassroots open government data intermediaries","volume":"4","author":"Schrock","year":"2017","journal-title":"Big Data & Society"},{"issue":"1","key":"10.3233\/IP-190195_ref57","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1108\/TG-01-2017-0006","article-title":"Open data ecosystems: an international comparison","volume":"11","author":"Styrin","year":"2017","journal-title":"Transforming Government: People, Process and Policy"},{"issue":"4","key":"10.3233\/IP-190195_ref58","doi-asserted-by":"publisher","first-page":"582","DOI":"10.2307\/2392581","article-title":"An assessment of the scientific merits of action research","volume":"23","author":"Susman","year":"1978","journal-title":"Administrative Science Quarterly"},{"key":"10.3233\/IP-190195_ref60","doi-asserted-by":"publisher","DOI":"10.1109\/CeDEM.2017.12"},{"issue":"1","key":"10.3233\/IP-190195_ref62","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1016\/j.giq.2015.11.004","article-title":"Adoption of open government data among government agencies","volume":"33","author":"Wang","year":"2016","journal-title":"Government Information Quarterly"},{"issue":"2","key":"10.3233\/IP-190195_ref63","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1177\/109821409601700206","article-title":"Formative and summative evaluation: related issues in performance measurement","volume":"17","author":"Wholey","year":"1996","journal-title":"American Journal of Evaluation"},{"key":"10.3233\/IP-190195_ref64","doi-asserted-by":"crossref","unstructured":"Young, M., & Yan, A. (2017). Civic Hackers\u2019 User Experiences and Expectations of Seattle\u2019s Open Municipal Data Program. In Proceedings of the 50th Hawaii International Conference on System Science (HICSS-50), pp. 2681\u20132690. https:\/\/doi.org\/http:\/\/hdl.handle.net\/10125\/41480.","DOI":"10.24251\/HICSS.2017.324"},{"issue":"1","key":"10.3233\/IP-190195_ref65","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.giq.2013.04.003","article-title":"Open data policies, their implementation and impact: a framework for comparison","volume":"31","author":"Zuiderwijk","year":"2014","journal-title":"Government Information Quarterly"},{"issue":"2","key":"10.3233\/IP-190195_ref66","first-page":"156","article-title":"Socio-technical impediments of open data","volume":"10","author":"Zuiderwijk","year":"2012","journal-title":"Electronic Journal of Electronic Government"},{"issue":"1\u20132","key":"10.3233\/IP-190195_ref67","doi-asserted-by":"publisher","first-page":"17","DOI":"10.3233\/IP-140329","article-title":"Innovation with open data: essential elements of open data ecosystems","volume":"19","author":"Zuiderwijk","year":"2014","journal-title":"Information Polity"}],"container-title":["Information Polity"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IP-190195","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T11:28:22Z","timestamp":1777462102000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IP-190195"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,4]]},"references-count":49,"journal-issue":{"issue":"3"},"URL":"https:\/\/doi.org\/10.3233\/ip-190195","relation":{},"ISSN":["1570-1255","1875-8754"],"issn-type":[{"value":"1570-1255","type":"print"},{"value":"1875-8754","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,4]]}}}