{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,26]],"date-time":"2026-04-26T05:38:55Z","timestamp":1777181935185,"version":"3.51.4"},"reference-count":13,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2019,1,20]],"date-time":"2019-01-20T00:00:00Z","timestamp":1547942400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["645198"],"award-info":[{"award-number":["645198"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Under the smart city paradigm, cities are changing at a rapid pace. In this context, it is necessary to develop tools that allow service providers to perform rapid deployments of novel solutions that can be validated by citizens. In this sense, the OrganiCity experimentation-as-a-service platform brings about a unique solution to experiment with new urban services in a co-creative way, among all the involved stakeholders. On top of this, it is also necessary to ensure that users are engaged in the experimentation process, so as to guarantee that the resulting services actually fulfill their needs. In this work, we present the engagement monitoring framework that has been developed within the OrganiCity platform. This framework permits the tailored definition of metrics according to the experiment characteristics and provides valuable information about how citizens react to service modifications and incentivization campaigns.<\/jats:p>","DOI":"10.3390\/s19020411","type":"journal-article","created":{"date-parts":[[2019,1,22]],"date-time":"2019-01-22T03:08:22Z","timestamp":1548126502000},"page":"411","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Experimentation Management in the Co-Created Smart-City: Incentivization and Citizen Engagement"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6049-8280","authenticated-orcid":false,"given":"Johnny","family":"Choque","sequence":"first","affiliation":[{"name":"Communications Department, University of Cantabria, Santander 39005, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5817-3308","authenticated-orcid":false,"given":"Luis","family":"Diez","sequence":"additional","affiliation":[{"name":"Communications Department, University of Cantabria, Santander 39005, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Arturo","family":"Medela","sequence":"additional","affiliation":[{"name":"Tecnolog\u00edas, Servicios Telem\u00e1ticos y Sistemas S.A., Santander 39011, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luis","family":"Mu\u00f1oz","sequence":"additional","affiliation":[{"name":"Communications Department, University of Cantabria, Santander 39005, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Al-Nasrawi, S., El-Zaart, A., and Adams, C. (2017, January 6\u20137). The Anatomy of Smartness of Smart Sustainable Cities: An Inclusive Approach. Proceedings of the 2017 International Conference on Computer and Applications (ICCA), Doha, UAE.","DOI":"10.1109\/COMAPP.2017.8079774"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Pallot, M., and Pawar, K. (2012, January 18\u201320). A holistic model of user experience for living lab experiential design. Proceedings of the 2012 18th International ICE Conference on Engineering, Technology and Innovation, Munich, Germany.","DOI":"10.1109\/ICE.2012.6297648"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Pokri\u0107, B., Kr\u010do, S., Pokri\u0107, M., Kne\u017eevi\u0107, P., and Jovanovi\u0107, D. (2015, January 7\u20139). Engaging citizen communities in smart cities using IoT, serious gaming and fast markerless Augmented Reality. Proceedings of the 2015 International Conference on Recent Advances in Internet of Things (RIoT), Singapore.","DOI":"10.1109\/RIOT.2015.7104905"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Phuluwa, L., and Hattingh, M. (June, January 30). Understanding how the City of Johannesburg Metropolitan Municipality\u2019s social media platforms are perceived by young citizens. Proceedings of the 2017 IST-Africa Week Conference (IST-Africa), Windhoek, Namibia.","DOI":"10.23919\/ISTAFRICA.2017.8102337"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Alba, M., Avalos, M., Guzm\u00e1n, C., and Larios, V.M. (2016, January 12\u201315). Synergy between smart cities\u2019 hackathons and living labs as a vehicle for accelerating tangible innovations on cities. Proceedings of the 2016 IEEE International Smart Cities Conference (ISC2), Trento, Italy.","DOI":"10.1109\/ISC2.2016.7580877"},{"key":"ref_6","unstructured":"Schaffers, H., S\u00e4llstr\u00f6m, A., Pallot, M., Hern\u00e1ndez-Mu\u00f1oz, J.M., Santoro, R., and Trousse, B. (2011, January 20\u201322). Integrating Living Labs with Future Internet experimental platforms for co-creating services within Smart Cities. Proceedings of the 2011 17th International Conference on Concurrent Enterprising, Aachen, Germany."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Celino, I., Calegari, G.R., and Fiano, A. (2016, January 12\u201315). Towards Talkin\u2019Piazza: Engaging citizens through playful interaction with urban objects. Proceedings of the 2016 IEEE International Smart Cities Conference (ISC2), Trento, Italy.","DOI":"10.1109\/ISC2.2016.7580809"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Choque, J., Medela, A., Echevarria, J., Diez, L., and Munoz, L. (2018, January 4\u20137). Enabling incentivization and citizen engagement in the smart-city co-creation paradigm. Proceedings of the 2018 Global Internet of Things Summit (GIoTS), Bilbao, Spain.","DOI":"10.1109\/GIOTS.2018.8534567"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ceballos, G.R., and Larios, V.M. (2016, January 12\u201315). A model to promote citizen driven government in a smart city: Use case at GDL smart city. Proceedings of the 2016 IEEE International Smart Cities Conference (ISC2), Trento, Italy.","DOI":"10.1109\/ISC2.2016.7580873"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Guti\u00e9rrez, V., Theodoridis, E., Mylonas, G., Shi, F., Adeel, U., Diez, L., Amaxilatis, D., Choque, J., Camprodom, G., and McCann, J. (2016). Co-Creating the Cities of the Future. Sensors, 16.","DOI":"10.3390\/s16111971"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Amaxilatis, D., Boldt, D., Choque, J., Diez, L., Gandrille, E., Kartakis, S., Mylonas, G., and Vestergaard, L.S. (2018). Advancing Experimentation-as-a-Service Through Urban IoT Experiments. IEEE Internet Things J.","DOI":"10.1109\/JIOT.2018.2871766"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Amaxilatis, D., Mylonas, G., Diez, L., Theodoridis, E., Guti\u00e9rrez, V., and Mu\u00f1oz, L. (2018). Managing Pervasive Sensing Campaigns via an Experimentation-as-a-Service Platform for Smart Cities. Sensors, 18.","DOI":"10.3390\/s18072125"},{"key":"ref_13","unstructured":"NGSI Context Management (2012). Technical Report, Open Mobile Alliance (OMA)."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/2\/411\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:27:29Z","timestamp":1760185649000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/2\/411"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,20]]},"references-count":13,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,1]]}},"alternative-id":["s19020411"],"URL":"https:\/\/doi.org\/10.3390\/s19020411","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,20]]}}}