{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,19]],"date-time":"2026-01-19T06:07:25Z","timestamp":1768802845491,"version":"3.49.0"},"reference-count":44,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2018,7,2]],"date-time":"2018-07-02T00:00:00Z","timestamp":1530489600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["645198"],"award-info":[{"award-number":["645198"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The adoption of technologies like the IoT in urban environments, together with the intensive use of smartphones, is driving transformation towards smart cities. Under this perspective, Experimentation-as-a-Service within OrganiCity aims to create an experimental facility with technologies, services, and applications that simplify innovation within urban ecosystems. We discuss here tools that facilitate experimentation, implementing ways to organize, execute, and administer experimentation campaigns in a smart city context. We discuss the benefits of our framework, presenting some preliminary results. This is the first time such tools are paired with large-scale smart city infrastructures, enabling both city-scale experimentation and cross-site experimentation.<\/jats:p>","DOI":"10.3390\/s18072125","type":"journal-article","created":{"date-parts":[[2018,7,2]],"date-time":"2018-07-02T10:56:52Z","timestamp":1530529012000},"page":"2125","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Managing Pervasive Sensing Campaigns via an Experimentation-as-a-Service Platform for Smart Cities"],"prefix":"10.3390","volume":"18","author":[{"given":"Dimitrios","family":"Amaxilatis","sequence":"first","affiliation":[{"name":"Computer Technology Institute &amp; Press, \u201cDiophantus\u201d, 26504 Patras, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2128-720X","authenticated-orcid":false,"given":"Georgios","family":"Mylonas","sequence":"additional","affiliation":[{"name":"Computer Technology Institute &amp; Press, \u201cDiophantus\u201d, 26504 Patras, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5817-3308","authenticated-orcid":false,"given":"Luis","family":"Diez","sequence":"additional","affiliation":[{"name":"Engineering Communications Department, University of Cantabria, 39005 Santander, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6012-7538","authenticated-orcid":false,"given":"Evangelos","family":"Theodoridis","sequence":"additional","affiliation":[{"name":"Dynamo Ltd., London W6 9DL, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ver\u00f3nica","family":"Guti\u00e9rrez","sequence":"additional","affiliation":[{"name":"Telef\u00f3nica, 39003 Santander, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luis","family":"Mu\u00f1oz","sequence":"additional","affiliation":[{"name":"Engineering Communications Department, University of Cantabria, 39005 Santander, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,7,2]]},"reference":[{"key":"ref_1","unstructured":"(2018, April 27). OrganiCity EU Project. Available online: http:\/\/organicity.eu\/."},{"key":"ref_2","unstructured":"(2018, June 27). SmartSantander EU Project. Available online: www.smartsantander.eu."},{"key":"ref_3","unstructured":"S\u00e1nchez, L., Guti\u00e9rrez, V., Galache, J.A., Sotres, P., Santana, J.R., Casanueva, J., and Mu\u00f1oz, L. (2013, January 24\u201327). SmartSantander: Experimentation and Service Provision in the Smart City. Proceedings of the 16th International Symposium on Wireless Personal Multimedia Communications (WPMC), Atlantic City, NJ, USA. Available online: http:\/\/ieeexplore.ieee.org\/stamp\/stamp.jsp?tp=&arnumber=6618633&isnumber=6618502."},{"key":"ref_4","unstructured":"(2018, June 27). FIWARE EU Project. Available online: https:\/\/www.fiware.org\/."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zahariadis, T., Papadakis, A., Alvarez, F., Gonzalez, J., Lopez, F., Facca, F., and Al-Hazmi, Y. (2014, January 8\u201311). FIWARE Lab: Managing Resources and Services in a Cloud Federation Supporting Future Internet Applications. Proceedings of the IEEE\/ACM 7th International Conference on Utility and Cloud Computing, London, UK.","DOI":"10.1109\/UCC.2014.129"},{"key":"ref_6","unstructured":"Van Ooteghem, J., Taylor, S., Grace, P., Lobillo, F., Smirnov, M., and Demeester, P. (2014, January 22\u201325). Sustaining a federation of future internet experimental facilities. Proceedings of the 25th European Regional Conference of the International Telecommunications Society, Brussels, Belgium."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1109\/MIC.2015.25","article-title":"Integrating Smartphones into the SmartSantander Infrastructure","volume":"19","author":"Mylonas","year":"2015","journal-title":"IEEE Internet Comput."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1145\/2794400","article-title":"Mobile Crowd Sensing and Computing: The Review of an Emerging Human-Powered Sensing Paradigm","volume":"48","author":"Guo","year":"2015","journal-title":"ACM Comput. Surv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"D\u2019Hondt, E., Zaman, J., Philips, E., Gonzalez Boix, E., and De Meuter, W. (2014, January 12\u201316). Orchestration support for participatory sensing campaigns. Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany.","DOI":"10.1145\/2632048.2632105"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1080\/10630732.2014.888216","article-title":"Managed Participatory Sensing with YouSense","volume":"21","author":"Linnap","year":"2014","journal-title":"J. Urban Technol."},{"key":"ref_11","unstructured":"Zaman, J., and De Meuter, W. (July, January 27). Crowd Sensing Applications: A Distributed Flow-Based Programming Approach. Proceedings of the IEEE International Conference on Mobile Services (MS), San Francisco, CA, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Tian, R., Dierk, C., Myers, C., and Paulos, E. (2016, January 7\u201312). MyPart: Personal, Portable, Accurate, Airborne Particle Counting. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.","DOI":"10.1145\/2858036.2858571"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1109\/MCOM.2016.7402272","article-title":"Mobile crowd sensing and computing: When participatory sensing meets participatory social media","volume":"54","author":"Guo","year":"2016","journal-title":"IEEE Commun. Mag."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1109\/MPRV.2016.18","article-title":"Crowdsensing in the Wild with Aliens and Micropayments","volume":"15","author":"Talasila","year":"2016","journal-title":"IEEE Pervasive Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"18613","DOI":"10.3390\/s150818613","article-title":"Scalable and Cost-Effective Assignment of Mobile Crowdsensing Tasks Based on Profiling Trends and Prediction: The ParticipAct Living Lab Experience","volume":"15","author":"Bellavista","year":"2015","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1109\/JIOT.2015.2409151","article-title":"A Survey of Incentive Techniques for Mobile Crowd Sensing","volume":"2","author":"Jaimes","year":"2015","journal-title":"IEEE Internet Things J."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1109\/MCOM.2017.1600719","article-title":"Mobile Crowdsensing in Software Defined Opportunistic Networks","volume":"55","author":"Li","year":"2017","journal-title":"IEEE Commun. Mag."},{"key":"ref_18","first-page":"463","article-title":"People-Centric Internet of Things-Challenges, Approach, and Enabling Technologies","volume":"616","author":"Boavida","year":"2016","journal-title":"Intell. Distrib. Comput. IX"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wiggins, A., and Crowston, K. (2011, January 4\u20137). From Conservation to Crowdsourcing: A Typology of Citizen Science. Proceedings of the 44th Hawaii International Conference on System Sciences, Kauai, HI, USA.","DOI":"10.1109\/HICSS.2011.207"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Balestrini, M., Diez, T., Marshall, P., Gluhak, A., and Rogers, Y. (2015). IoT community technologies: Leaving users to their own devices or orchestration of engagement?. EAI Endorsed Trans. Internet Things, 1.","DOI":"10.4108\/eai.26-10-2015.150601"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Diez, T., and Posada, A. (2014, January 10\u201313). The fab and the smart city: The use of machines and technology for the city production by its citizens. Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI), Barcelona, Spain.","DOI":"10.1145\/2460625.2460725"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Le Dantec, C.A., Asad, M., Misra, A., and Watkins, K.E. (2015, January 14\u201318). Planning with Crowdsourced Data: Rhetoric and Representation in Transportation planning. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW), Vancouver, BC, Canada.","DOI":"10.1145\/2675133.2675212"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ag\u00fcero, R., Zinner, T., Garc\u00eda-Lozano, M., Wenning, B.L., and Timm-Giel, A. (2015). FESTIVAL: Towards an Intercontinental Federation Approach. Mobile Networks and Management, Springer. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.","DOI":"10.1007\/978-3-319-26925-2"},{"key":"ref_24","first-page":"278","article-title":"Festival: Design and Implementation of Federated Interoperable Smart ICT Services Development and Testing Platform","volume":"25","author":"Akiyama","year":"2017","journal-title":"J. Inf. Process."},{"key":"ref_25","unstructured":"(2018, June 27). City Platform as a Service. Available online: https:\/\/cpaas.bfh.ch\/."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1109\/JIOT.2017.2747214","article-title":"FogFlow: Easy Programming of IoT Services Over Cloud and Edges for Smart Cities","volume":"5","author":"Cheng","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_27","unstructured":"(2018, June 27). IoT Lab Project. Available online: http:\/\/www.iotlab.eu\/."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Fernandes, J., Nati, M., Loumis, N.S., Nikoletseas, S., Raptis, T.P., Krco, S., Rankov, A., Jokic, S., Angelopoulos, C.M., and Ziegler, S. (2015, January 7\u20139). IoT Lab: Towards co-design and IoT solution testing using the crowd. Proceedings of the 2015 International Conference on Recent Advances in Internet of Things (RIoT), Singapore.","DOI":"10.1109\/RIOT.2015.7104907"},{"key":"ref_29","unstructured":"(2018, June 27). Synchronicity Project. Available online: http:\/\/synchronicity-iot.eu\/."},{"key":"ref_30","unstructured":"(2018, June 27). IoT Analytics, Thingspeak Internet of Things. Available online: https:\/\/thingspeak.com\/."},{"key":"ref_31","unstructured":"(2018, June 27). Array of Things. Available online: http:\/\/arrayofthings.github.io\/."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.jss.2015.03.067","article-title":"Privacy in mobile participatory sensing: Current trends and future challenges","volume":"116","author":"Christin","year":"2016","journal-title":"J. Syst. Softw."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Li, T., Jung, T., Li, H., Cao, L., Wang, W., Li, X.-Y., and Wang, Y. (2017, January 13\u201317). Scalable privacy-preserving participant selection in mobile crowd sensing. Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom), Kona, HI, USA.","DOI":"10.1109\/PERCOM.2017.7917851"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Liu, R., Cao, J., VanSyckel, S., and Gao, W. (2016, January 14\u201319). PriMe: Human-centric privacy measurement based on user preferences towards data sharing in mobile participatory sensing systems. Proceedings of the International Conference on Pervasive Computing and Communications (PerCom), Sydney, Australia.","DOI":"10.1109\/PERCOM.2016.7456518"},{"key":"ref_35","unstructured":"(2018, April 16). OSGi Alliance, the Dynamic Module System for Java. Available online: https:\/\/www.osgi.org\/."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Carlson, D., and Schrader, A. (2012, January 24\u201326). Dynamix: A Plug-and-Play Context Framework for Android. Proceedings of the 3rd International Conference on the Internet of Things (IoT), Wuxi, China.","DOI":"10.1109\/IOT.2012.6402317"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Guti\u00e9rrez, V., Theodoridis, E., Mylonas, G., Shi, F., Adeel, U., Diez, L., Amaxilatis, D., Choque, J., Camprodom, G., McCann, J., and Mu\u00f1oz, L. (2016). Co-creating the Cities of the Future. Sensors, 16.","DOI":"10.3390\/s16111971"},{"key":"ref_38","first-page":"668","article-title":"Empowering citizens towards the co-creation of sustainable cities","volume":"5","author":"Amaxilatis","year":"2017","journal-title":"IEEE Internet Things J."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Gutierrez, F. (2017). Spring Boot. Spring Boot Messaging, Apress.","DOI":"10.1007\/978-1-4842-1224-0"},{"key":"ref_40","unstructured":"(2018, June 27). Google Push. Available online: https:\/\/developers.google.com\/drive\/v3\/web\/push."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Rana, R.K., Chou, C.T., Kanhere, S.S., Bulusu, N., and Hu, W. (2010, January 12\u201315). Ear-phone: An end-to-end participatory urban noise mapping system. Proceedings of the 9th ACM\/IEEE International Conference on Information Processing in Sensor Networks (IPSN\u201910), Stockholm, Sweden.","DOI":"10.1145\/1791212.1791226"},{"key":"ref_42","unstructured":"(2018, June 27). OrganiCity Open Call. Available online: http:\/\/organicity.eu\/open-call\/."},{"key":"ref_43","unstructured":"(2018, June 27). OrganiCity Urban Data Observatory. Available online: https:\/\/observatory.organicity.eu."},{"key":"ref_44","unstructured":"(2018, June 27). FIWARE Cosmos Ecosystem. Available online: https:\/\/catalogue.fiware.org\/enablers\/bigdata-analysis-cosmos."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/7\/2125\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:11:03Z","timestamp":1760195463000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/7\/2125"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,2]]},"references-count":44,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2018,7]]}},"alternative-id":["s18072125"],"URL":"https:\/\/doi.org\/10.3390\/s18072125","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,2]]}}}