{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,26]],"date-time":"2025-11-26T21:29:56Z","timestamp":1764192596943,"version":"build-2065373602"},"reference-count":44,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2022,12,5]],"date-time":"2022-12-05T00:00:00Z","timestamp":1670198400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Generalitat Valenciana","award":["AICO\/2021\/138","AICO\/2021\/138","PID2021-123168NB-I00","PID2021-123168NB-I00","TED2021-131387B-I00"],"award-info":[{"award-number":["AICO\/2021\/138","AICO\/2021\/138","PID2021-123168NB-I00","PID2021-123168NB-I00","TED2021-131387B-I00"]}]},{"name":"Subvenciones para grupos de investigaci\u00f3n consolidados","award":["AICO\/2021\/138","AICO\/2021\/138","PID2021-123168NB-I00","PID2021-123168NB-I00","TED2021-131387B-I00"],"award-info":[{"award-number":["AICO\/2021\/138","AICO\/2021\/138","PID2021-123168NB-I00","PID2021-123168NB-I00","TED2021-131387B-I00"]}]},{"name":"MCIN\/AEI\/10.13039\/501100011033","award":["AICO\/2021\/138","AICO\/2021\/138","PID2021-123168NB-I00","PID2021-123168NB-I00","TED2021-131387B-I00"],"award-info":[{"award-number":["AICO\/2021\/138","AICO\/2021\/138","PID2021-123168NB-I00","PID2021-123168NB-I00","TED2021-131387B-I00"]}]},{"name":"ERDF A way of making Europe","award":["AICO\/2021\/138","AICO\/2021\/138","PID2021-123168NB-I00","PID2021-123168NB-I00","TED2021-131387B-I00"],"award-info":[{"award-number":["AICO\/2021\/138","AICO\/2021\/138","PID2021-123168NB-I00","PID2021-123168NB-I00","TED2021-131387B-I00"]}]},{"name":"Green Networks: Towards environmental-friendly 6G Networks","award":["AICO\/2021\/138","AICO\/2021\/138","PID2021-123168NB-I00","PID2021-123168NB-I00","TED2021-131387B-I00"],"award-info":[{"award-number":["AICO\/2021\/138","AICO\/2021\/138","PID2021-123168NB-I00","PID2021-123168NB-I00","TED2021-131387B-I00"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Determining the temporal behavior of an IoT platform is of utmost importance as IoT systems are time-sensitive. IoT platforms play a central role in the operation of an IoT system, impacting the overall performance. As a result, initiating an IoT project without the exhaustive knowledge of such a core software piece may lead to a failed project if the finished systems do not meet the needed temporal response and scalability levels. Despite this fact, existing works on IoT software systems focus on the design and implementation of a particular system, providing a final evaluation as the validation. This is a risky approach as an incorrect decision on the core IoT platform may involve great monetary loss if the final evaluation proves that the system does not meet the expected validation criteria. To overcome this, we provide an evaluation process to determine the temporal behavior of IoT platforms to support early design decisions with respect to the appropriateness of the particular platform in its application as an IoT project. The process defines the steps towards the early evaluation of IoT platforms, ranging from the identification of the potential software items and the determination of the validation criteria to running the experiments and obtaining results. The process is exemplified on an exhaustive evaluation of a particular mainstream IoT platform for the case of a medical system for patient monitoring. In this time-sensitive scenario, results report the temporal behavior of the platform regarding the validation parameters expressed at the initial steps.<\/jats:p>","DOI":"10.3390\/s22239501","type":"journal-article","created":{"date-parts":[[2022,12,5]],"date-time":"2022-12-05T08:10:57Z","timestamp":1670227857000},"page":"9501","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["An Evaluation Process for IoT Platforms in Time-Sensitive Domains"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2383-5310","authenticated-orcid":false,"given":"Marisol","family":"Garc\u00eda-Valls","sequence":"first","affiliation":[{"name":"Universitat Polit\u00e8cnica de Val\u00e8ncia, 46022 Valencia, Spain"}]},{"given":"Eva","family":"Palomar-Cos\u00edn","sequence":"additional","affiliation":[{"name":"Universitat Polit\u00e8cnica de Val\u00e8ncia, 46022 Valencia, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"129551","DOI":"10.1109\/ACCESS.2019.2932609","article-title":"Internet-of-Things (IoT)-Based Smart Agriculture: Toward making the fields talk","volume":"7","author":"Ayaz","year":"2019","journal-title":"IEEE Access"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.procir.2014.03.115","article-title":"Cyber-physical production systems: Roots, expectations and R&D challenges","volume":"17","author":"Monostori","year":"2014","journal-title":"Procedia CIRP"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"125488","DOI":"10.1109\/ACCESS.2020.3007955","article-title":"An Intelligent IoT-Based System Design for Controlling and Monitoring Greenhouse Temperature","volume":"8","author":"Subahi","year":"2020","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Munir, M.S., Bajwa, I.S., Naem, M.A., and Ramzan, B. (2018). Design and implementation of an IoT system for smart energy consumption and smart irrigation in tunnel farming. Energies, 11.","DOI":"10.3390\/en11123427"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Acharya, A.D., and Patil, S.N. (2020, January 11\u201313). IoT based Health Care Monitoring Kit. Proceedings of the 4th International Conference on Computing Methodologies and Communication (ICCMC), Erode, India.","DOI":"10.1109\/ICCMC48092.2020.ICCMC-00068"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Pinto, S., Cabral, J., and Gomes, T. (2017, January 22\u201325). We-care: An IoT-based health care system for elderly people. Proceedings of the IEEE International Conference on Industrial Technology (ICIT), Toronto, ON, Canada.","DOI":"10.1109\/ICIT.2017.7915565"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1016\/j.future.2018.07.001","article-title":"Accelerating smart eHealth services execution at the fog computing infrastructure","volume":"108","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_8","first-page":"140","article-title":"The internet of thing (IoT) and industrial automation: A future perspective","volume":"15","author":"Mondal","year":"2019","journal-title":"World J. Model. Simul."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.comcom.2019.12.035","article-title":"Intelligent manufacturing production line data monitoring system for industrial internet of things","volume":"151","author":"Chen","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sarin, G. (2016, January 16\u201318). Developing smart cities using Internet of Things: An empirical study. Proceedings of the 3rd International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India.","DOI":"10.2139\/ssrn.2780756"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"AlZoman, R.M., and Alenazi, M.J.F. (2021). A Comparative Study of Traffic Classification Techniques for Smart City Networks. Sensors, 21.","DOI":"10.3390\/s21144677"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.sysarc.2018.05.007","article-title":"Introducing the new paradigm of Social Dispersed Computing: Applications, Technologies and Challenges","volume":"91","author":"Dubey","year":"2018","journal-title":"J. Syst. Archit."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/MITP.2016.90","article-title":"Monitoring Internet of Things application ecosystems for failure","volume":"18","author":"Solaiman","year":"2016","journal-title":"IT Prof."},{"key":"ref_14","unstructured":"(2022, October 29). Thingsboard IoT Platform. Available online: https:\/\/thingsboard.io\/."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Salvi, S., Jain, S.A.F., Sanjay, H.A., Harshita, T.K., Farhana, M., Jain, N., and Suhas, M.V. (2017, January 10\u201311). Cloud based data analysis and monitoring of smart multi-level irrigation system using IoT. Proceedings of the International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), Palladam, India.","DOI":"10.1109\/I-SMAC.2017.8058279"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kumar, R., and Paiva, S. (2020). Design of a Low-Cost Sensor-Based IoT System for Smart Irrigation. Applications in Ubiquitous Computing. EAI\/Springer Innovations in Communication and Computing, Springer.","DOI":"10.1007\/978-3-030-35280-6"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2180","DOI":"10.1109\/TII.2014.2307795","article-title":"A Health-IoT Platform Based on the Integration of Intelligent Packaging, Unobtrusive Bio-Sensor, and Intelligent Medicine Box","volume":"10","author":"Yang","year":"2014","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Saraf, S.B., and Gawali, D.H. (2017, January 19\u201320). IoT based smart irrigation monitoring and controlling system. Proceedings of the 2nd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT), Bangalore, India.","DOI":"10.1109\/RTEICT.2017.8256711"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Dattatraya, P.Y., Agarkhed, J., and Patil, S. (2016, January 23\u201325). Cloud assisted performance enhancement of smart applications in Wireless Sensor Networks. Proceedings of the International Conference on Wireless Communications Signal Processing and Networking (WiSPNET), Chennai, India.","DOI":"10.1109\/WiSPNET.2016.7566153"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Fraga-Lamas, P., Celaya-Echarri, M., Azpilicueta, L., Lopez-Iturri, P., Falcone, F., and Fernandez-Camares, T.M. (2020). Design and empirical validation of a LoRaWAN IoT smart irrigation system. Proceedings, 42.","DOI":"10.3390\/ecsa-6-06540"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"97658","DOI":"10.1109\/ACCESS.2020.2995938","article-title":"The Narrowband Internet of Things (NB-IoT) Resources Management Performance State of Art, Challenges, and Opportunities","volume":"8","author":"Migabo","year":"2020","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1724","DOI":"10.1109\/ACCESS.2017.2664418","article-title":"Uplink scheduling and link adaptation for narrowband Internet of Things systems","volume":"5","author":"Yu","year":"2017","journal-title":"IEEE Access"},{"key":"ref_23","unstructured":"Huusko, J. (2016). Communication Performance Prediction and Link Adaptation Based on a Statistical Radio Channel Model, University of Oulu Graduate School, Center Wireless Communication. Tech. Rep. C563."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1186\/s13677-022-00278-6","article-title":"Performance evaluation of publish-subscribe systems in IoT using energy-efficient and context-aware secure messages","volume":"11","author":"Junior","year":"2022","journal-title":"J. Cloud Comput."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Vandikas, K., and Tsiatsis, V. (2014, January 10\u201312). Performance Evaluation of an IoT Platform. Proceedings of the 8th International Conference on Next Generation Mobile Apps, Services and Technologies, Oxford, UK.","DOI":"10.1109\/NGMAST.2014.66"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1016\/j.jpdc.2018.12.010","article-title":"Performance evaluation of FIWARE: A cloud-based IoT platform for smart cities","volume":"132","author":"Araujo","year":"2019","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_27","first-page":"588","article-title":"A Comprehensive Framework for Analyzing IoT Platforms: A Smart City Industrial Experience","volume":"4","author":"Fahmideh","year":"2021","journal-title":"Sensors"},{"key":"ref_28","unstructured":"Diggity, M. (2022, May 01). Reduce Your Server Response Time for Happy Users, Higher Rankings. Available online: https:\/\/clx.com\/server-response-time."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1993). Usability Engineering, AP Professional.","DOI":"10.1016\/B978-0-08-052029-2.50007-3"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/TII.2012.2198662","article-title":"iLAND: An Enhanced Middleware for Real-Time Reconfiguration of Service Oriented Distributed Real-Time Systems","volume":"9","year":"2013","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Song, L., and Garc\u00eda-Valls, M. (2022). Improving Security of Web Servers in Critical IoT Systems through Self-Monitoring of Vulnerabilities. Sensors, 22.","DOI":"10.3390\/s22135004"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Shelby, Z., Hartke, K., and Bormann, C. (2022, October 29). The Constrained Application Protocol (CoAP). RFC 7252. June 2014. Available online: https:\/\/www.rfc-editor.org\/rfc\/rfc7252.","DOI":"10.17487\/rfc7252"},{"key":"ref_33","unstructured":"OASIS Consortium (2022, October 29). MQTT Version 5.0. March 2019. Available online: https:\/\/mqtt.org\/mqtt-specification\/."},{"key":"ref_34","unstructured":"OASIS Consortium (2012, October 28). Advanced Message Queuing Protocol (AMQP), Version 1.0. Available online: https:\/\/mqtt.org\/mqtt-specification\/."},{"key":"ref_35","unstructured":"Fielding, R.T. (2000). Chapter 5: Representational State Transfer (REST). Architectural Styles and the Design of Network-based Software Architectures. [Ph.D. Thesis, University of California]."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Fielding, R., Gettys, J., Mogul, J., Frystyk, H., Masinter, L., Leach, P., and Berners-Lee, T. (2022, October 29). HyperText Transfer Protocol v1.1\u2014HTTP (RFC 2616). June 1999. Available online: https:\/\/www.rfc-editor.org\/rfc\/rfc2616.","DOI":"10.17487\/rfc2616"},{"key":"ref_37","unstructured":"OMG (The Object Management Group) (2022, October 29). Data Distribution Service (DDS), Version 1.4. March 2015. Available online: https:\/\/www.omgwiki.org\/dido\/doku.php?id=dido:public:ra:xapend:xapend.b_stds:tech:omg:dds."},{"key":"ref_38","unstructured":"Kaa Enterprise (2022, October 29). Enterprise IoT Platform. Available online: https:\/\/www.kaaiot.com."},{"key":"ref_39","unstructured":"Losant (2022, October 29). Losant Enterprise IoT Platform. Available online: https:\/\/www.losant.com."},{"key":"ref_40","unstructured":"Google (2022, October 29). Cloud IoT Core\u2014Google Cloud. Available online: https:\/\/cloud.google.com\/solutions\/iot#section-1."},{"key":"ref_41","unstructured":"(2022, October 29). What is ThingsBoard Cloud?. Available online: https:\/\/thingsboard.io\/products\/paas\/what-is-thingsboard-cloud\/."},{"key":"ref_42","unstructured":"Amazon (2022, October 29). Amazon Web Services IoT. Available online: https:\/\/aws.amazon.com\/es\/iot\/."},{"key":"ref_43","unstructured":"(2022, October 29). HyperSQL Database. Available online: https:\/\/hsqldb.org\/."},{"key":"ref_44","unstructured":"(2022, October 29). PostgreSQL 15.1 Documentation. The PostgreSQL Global Development Group. Available online: https:\/\/www.postgresql.org\/files\/documentation\/pdf\/15\/postgresql-15-A4.pdf."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9501\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:34:15Z","timestamp":1760146455000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9501"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,5]]},"references-count":44,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22239501"],"URL":"https:\/\/doi.org\/10.3390\/s22239501","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,12,5]]}}}