{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T19:11:16Z","timestamp":1782846676360,"version":"3.54.5"},"reference-count":54,"publisher":"Sociedade Brasileira de Computa\u00e7\u00e3o","issue":"1","license":[{"start":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T00:00:00Z","timestamp":1782691200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JBCS"],"abstract":"Technology has significantly transformed human interactions with everyday objects, expanding their communication capabilities. This broad connectivity to the Internet has given rise to the \"Internet of Things (IoT)\", extending the boundaries of the Internet and evolving those objects into smart objects. When interconnected, these smart objects can collect and share information to provide services effectively. However, the intense data traffic and the diversity of interaction methods among these objects bring challenges related to interoperability. Interoperability refers to the ability of distinct systems to communicate effectively, ensuring data integrity. In this context, interoperability testing assesses the capability of systems and devices to cooperate efficiently. Regarding the testing challenges faced in IoT, we can highlight (i) the complexity of the IoT architecture, which involves multiple layers and system components; (ii) the diversity of IoT protocols; and (iii) the heterogeneity of devices, which poses challenges in testing their compatibility and managing their integration to ensure effective connectivity. To address these challenges, this paper proposes a guide-based approach designed to systematize IoT interoperability testing. The guide was developed following a systematic methodology, including literature reviews, data extraction and analysis, and observations in real IoT environments. The guide covers 12 topics, such as the definition and correlation of IoT characteristics, subcharacteristics, abstract test cases, measures, cost-benefit analysis, and tool suggestions. The guide evaluation was conducted in three stages: (1) a structural evaluation using the Technology Acceptance Model (TAM); (2) a controlled experiment applying the guide to test the interoperability of a real IoT application; and (3) an evaluation of the guide with domain experts. The results of the three evaluations were positive, indicating that the guide is effective in test planning, execution, and identifying IoT-specific failures.<\/jats:p>","DOI":"10.5753\/jbcs.2026.5473","type":"journal-article","created":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:24:36Z","timestamp":1782843876000},"page":"1699-1730","source":"Crossref","is-referenced-by-count":0,"title":["A Guide-based Approach for IoT Interoperability Testing"],"prefix":"10.5753","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4752-2653","authenticated-orcid":false,"given":"Karina da Silva Castelo","family":"Branco","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1210-7935","authenticated-orcid":false,"given":"Val\u00e9ria Lelli Leit\u00e3o","family":"Dantas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2329-8343","authenticated-orcid":false,"given":"Lav\u00ednia Matoso","family":"Freitas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4582-6765","authenticated-orcid":false,"given":"Liana Mara","family":"Carvalho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-8200-0837","authenticated-orcid":false,"given":"Paulo Ricardo Fernandes","family":"Rodrigues","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"3742","published-online":{"date-parts":[[2026,6,29]]},"reference":[{"key":"1","unstructured":"Almeida, R. L. A. (2018). CHASE: checklist para avalia\u00e7\u00e3o da experi\u00eancia do usu\u00e1rio em ambientes de internet das coisas<\/i>. Disserta\u00e7\u00e3o (mestrado em ci\u00eancia da computa\u00e7\u00e3o), Universidade Federal do Cear\u00e1, Fortaleza. Avaialable at:[link<\/a>]."},{"key":"2","doi-asserted-by":"crossref","unstructured":"Andrade, S. and Luque, D. (2022). Interoperabilidade de sistemas aplicados \u00e0s cidades inteligentes: Um estudo de mapeamento sistem\u00e1tico. In Anais do X Workshop de Computa\u00e7\u00e3o Aplicada em Governo Eletr\u00f4nico<\/i>, pages 97-108. SBC. DOI: 10.5753\/wcge.2022.222970<\/a>.","DOI":"10.5753\/wcge.2022.222970"},{"key":"3","doi-asserted-by":"crossref","unstructured":"Atzori, L., Iera, A., and Morabito, G. (2010). The internet of things: A survey. Computer networks<\/i>, 54(15):2787-2805. DOI: 10.1016\/j.comnet.2010.05.010<\/a>.","DOI":"10.1016\/j.comnet.2010.05.010"},{"key":"4","doi-asserted-by":"crossref","unstructured":"Branco, K. C., Dantas, V., and Carvalho, L. (2024). Interoperability testing guide for the internet of things. In Proceedings of the 30th Brazilian Symposium on Multimedia and the Web<\/i>, pages 188-196, Porto Alegre, RS, Brasil. SBC. DOI: 10.5753\/webmedia.2024.242058<\/a>.","DOI":"10.5753\/webmedia.2024.242058"},{"key":"5","unstructured":"Caldas, E. A. L. (2023). Checklist para avalia\u00e7\u00e3o da interoperabilidade em dispositivos iot com foco em casas inteligentes<\/i>. Trabalho de conclus\u00e3o de curso, Universidade Federal do Cear\u00e1, Campus de Quixad\u00e1, Quixad\u00e1. Available at:[link<\/a>]."},{"key":"6","doi-asserted-by":"crossref","unstructured":"Ca\u00f1as Betancur, D. C. and Hern\u00e1ndez S\u00e1nchez, J. (2019). Comunica\u00e7\u00e3o assertiva em professores: diagn\u00f3stico e proposta educativa. Praxis & Saber<\/i>, 10(24):143-165. DOI: 10.19053\/22160159.v10.n25.2019.8936<\/a>.","DOI":"10.19053\/22160159.v10.n25.2019.8936"},{"key":"7","unstructured":"Carvalho, L. (2022). Wiki of the Performance Testing Guide for IoT Applications. Available at:[link<\/a>]. Accessed on: April 29, 2025."},{"key":"8","doi-asserted-by":"crossref","unstructured":"Carvalho, L. M., Lelli, V., and Andrade, R. M. (2022). Performance testing guide for iot applications. In ICEIS (1)<\/i>, pages 667-678. INSTICC, SciTePress. DOI: 10.5220\/0011090800003179<\/a>.","DOI":"10.5220\/0011090800003179"},{"key":"9","unstructured":"Coutinho, A., Carneiro, E. O., and Greve, F. G. P. (2016). Computa\u00e7ao em n\u00e9voa: Conceitos, aplica\u00e7\u00f5es e desafios. Minicursos do XXXIV SBRC<\/i>, pages 266-315. Available at:[link<\/a>]."},{"key":"10","doi-asserted-by":"crossref","unstructured":"Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly<\/i>, 13(3):319-340. DOI: 10.2307\/249008<\/a>.","DOI":"10.2307\/249008"},{"key":"11","doi-asserted-by":"crossref","unstructured":"dos Santos, M. C. (2016). Internet das coisas e sistemas inteligentes no jornalismo: o conceito de presen\u00e7a dilu\u00eddo entre as narrativas da complexidade urbana. Comunica\u00e7\u00e3o & Inova\u00e7\u00e3o<\/i>, 17(34):21-39. DOI: 10.13037\/ci.vol17n34.3769<\/a>.","DOI":"10.13037\/ci.vol17n34.3769"},{"key":"12","unstructured":"Ferreira, H. G. C. (2014). Arquitetura de middleware para Internet das Coisas<\/i>. PhD thesis, University of Bras\u00edlia Bras\u00edlia, Brazil. Available at:[link<\/a>]."},{"key":"13","doi-asserted-by":"crossref","unstructured":"Fienberg, S. E. (2006). When did bayesian inference become\" bayesian\"?. DOI: 10.1214\/06-ba101<\/a>.","DOI":"10.1214\/06-BA101"},{"key":"14","doi-asserted-by":"crossref","unstructured":"Filho, F. G. S., Lelli, V., Santos, I. d. S., and Andrade, R. M. C. (2021). Correlations among software testability metrics. In Proceedings of the XIX Brazilian Symposium on Software Quality<\/i>, SBQS '20, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145\/3439961.3439972<\/a>.","DOI":"10.1145\/3439961.3439972"},{"key":"15","doi-asserted-by":"crossref","unstructured":"Ghasemi, A. and Zahediasl, S. (2012). Normality tests for statistical analysis: a guide for non-statisticians. International Journal of Endocrinology and Metabolism<\/i>, 10(2):486-489. DOI: 10.5812\/ijem.3505<\/a>.","DOI":"10.5812\/ijem.3505"},{"key":"16","doi-asserted-by":"crossref","unstructured":"Giusto, D., Iera, A., Morabito, G., and Atzori, L. (2010). The internet of things: 20th Tyrrhenian workshop on digital communications<\/i>. Springer Science & Business Media. DOI: 10.1007\/978-1-4419-1674-7<\/a>.","DOI":"10.1007\/978-1-4419-1674-7"},{"key":"17","unstructured":"Gulla, J. A., Tomassen, S. L., and Strasunskas, D. (2006). Semantic interoperability in the norwegian petroleum industry. In ISTA<\/i>, pages 81-93. Available at:[link<\/a>]."},{"key":"18","doi-asserted-by":"crossref","unstructured":"Gunathilaka, P., Mashima, D., and Chen, B. (2016). Softgrid: A software-based smart grid testbed for evaluating substation cybersecurity solutions. In Proceedings of the 2nd ACM Workshop on Cyber-Physical Systems Security and Privacy<\/i>, pages 113-124. DOI: 10.1145\/2994487.2994494<\/a>.","DOI":"10.1145\/2994487.2994494"},{"key":"19","unstructured":"ISO 15926 (2011). Iso 15926 - industrial automation systems and integration - integration of life-cycle data for process plants including oil and gas production facilities. Available at:[link<\/a>]. Accessed on 28 Mar. 2023."},{"key":"20","doi-asserted-by":"crossref","unstructured":"ISO\/IEC 21823 (2022). Internet of Things (IoT) - Interoperability for IoT systems. (ISO\/IEC 21823:2022). DOI: 10.3403\/bsisoiec21823<\/a>.","DOI":"10.3403\/BSISOIEC21823"},{"key":"21","unstructured":"ISO\/IEC 25000 (2005). ISO\/IEC 25000:2005, software engineering - software product quality requirements and evaluation (SQuaRE). Available at:[link<\/a>]."},{"key":"22","doi-asserted-by":"crossref","unstructured":"ISO\/IEC 25010 (2011). Systems and software engineering \u2014 systems and software quality requirements and evaluation (square) \u2014 system and software quality models. DOI: 10.3403\/30215101<\/a>.","DOI":"10.3403\/30215101"},{"key":"23","doi-asserted-by":"crossref","unstructured":"ISO\/IEC 25019 (2023). Systems and software engineering \u2014 systems and software quality requirements and evaluation (square) \u2014 quality-in-use model. DOI: 10.3403\/30421230u<\/a>.","DOI":"10.3403\/30421230U"},{"key":"24","unstructured":"ISO\/IEC 30141 (2018). Information technology - Internet of Things (IoT) - Reference architecture. Available at:[link<\/a>]."},{"key":"25","doi-asserted-by":"crossref","unstructured":"Kim, T. K. (2015). T test as a parametric statistic. Korean Journal of Anesthesiology<\/i>, 68(6):540-546. DOI: 10.4097\/kjae.2015.68.6.540<\/a>.","DOI":"10.4097\/kjae.2015.68.6.540"},{"key":"26","doi-asserted-by":"crossref","unstructured":"Kitchenham, B., Brereton, O. P., Budgen, D., Turner, M., Bailey, J., and Linkman, S. (2009). Systematic literature reviews in software engineering-a systematic literature review. Information and software technology<\/i>, 51(1):7-15. DOI: 10.1016\/j.infsof.2008.09.009<\/a>.","DOI":"10.1016\/j.infsof.2008.09.009"},{"key":"27","doi-asserted-by":"crossref","unstructured":"Kuzniar, M., Peresini, P., Canini, M., Venzano, D., and Kostic, D. (2012). A soft way for openflow switch interoperability testing. In Proceedings of the 8th international conference on Emerging networking experiments and technologies<\/i>, pages 265-276. DOI: 10.1145\/2413176.2413207<\/a>.","DOI":"10.1145\/2413176.2413207"},{"key":"28","unstructured":"Legner, C. and Wende, K. (2006). Towards an excellence framework for business interoperability. In 19th Bled eConference eValues<\/i>, Bled, Slovenia. Available at:[link<\/a>]."},{"key":"29","doi-asserted-by":"crossref","unstructured":"Levene, H. (1960). Robust tests for equality of variances. pages 278-292. DOI: 10.2307\/2285659<\/a>.","DOI":"10.2307\/2285659"},{"key":"30","unstructured":"Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology<\/i>, 22(140):1-55. Available at:[link<\/a>]."},{"key":"31","doi-asserted-by":"crossref","unstructured":"Maia, N., Macedo, G., Collins, E., and Dias-Neto, A. (2012). Aplicando testes \u00e1geis com equipes distribu\u00eddas: Um relato de experi\u00eancia. In Anais do XI Simp\u00f3sio Brasileiro de Qualidade de Software<\/i>, pages 365-372. SBC. DOI: 10.5753\/sbqs.2012.15330<\/a>.","DOI":"10.5753\/sbqs.2012.15330"},{"key":"32","doi-asserted-by":"crossref","unstructured":"Mann, H. B. and Whitney, D. R. (1947). On a test of whether one of two random variables is stochastically larger than the other. The Annals of Mathematical Statistics<\/i>, 18(1):50-60. DOI: 10.1214\/aoms\/1177730491<\/a>.","DOI":"10.1214\/aoms\/1177730491"},{"key":"33","doi-asserted-by":"crossref","unstructured":"Mattern, F. and Floerkemeier, C. (2010). From the internet of computers to the internet of things. In From active data management to event-based systems and more<\/i>, pages 242-259. Springer. DOI: 10.1007\/978-3-642-17226-7_15<\/a>.","DOI":"10.1007\/978-3-642-17226-7_15"},{"key":"34","unstructured":"Mattiello-Francisco, M. d. F. (2009). Inrob-uma abordagem para testes de interoperabilidade e de robustez de subsistemas de temporeal intensivos em software. Doutorado em engenharia eletr\u00f4nica e computa\u00e7\u00e3o, Instituto de Tecnol\u00f3gico de Aeron\u00e1utica, S\u00e3o Jos\u00e9 dos Campos, SP<\/i>. Available at:[link<\/a>]."},{"key":"35","doi-asserted-by":"crossref","unstructured":"Motta, R. C., De Oliveira, K. M., and Travassos, G. H. (2017). Rethinking interoperability in contemporary software systems. In 2017 IEEE\/ACM Joint 5th International Workshop on Software Engineering for Systems-of-Systems and 11th Workshop on Distributed Software Development, Software Ecosystems and Systems-of-Systems (JSOS)<\/i>, pages 9-15. IEEE. DOI: 10.1109\/jsos.2017.5<\/a>.","DOI":"10.1109\/JSOS.2017.5"},{"key":"36","doi-asserted-by":"crossref","unstructured":"Mujjiga, S. and Sukumaran, S. (2007). Modelling and test generation using sal for interoperability testing in consumer electronics. In Proceedings of the second workshop on Automated formal methods<\/i>, pages 32-40. DOI: 10.1145\/1345169.1345173<\/a>.","DOI":"10.1145\/1345169.1345173"},{"key":"37","doi-asserted-by":"crossref","unstructured":"Myers, G. J., Sandler, C., and Badgett, T. (2011). The art of software testing<\/i>. John Wiley & Sons. DOI: 10.1002\/9781119202486<\/a>.","DOI":"10.1002\/9781119202486"},{"key":"38","doi-asserted-by":"crossref","unstructured":"Noura, M., Atiquzzaman, M., and Gaedke, M. (2019). Interoperability in internet of things: Taxonomies and open challenges. Mobile networks and applications<\/i>, 24:796-809. DOI: 10.1007\/s11036-018-1089-9<\/a>.","DOI":"10.1007\/s11036-018-1089-9"},{"key":"39","unstructured":"Nunes, P. R. d. A. F. (2011). Valida\u00e7\u00e3o de padr\u00f5es de web services transacionais<\/i>. PhD thesis, Universidade de S\u00e3o Paulo. Avaialable at:[link<\/a>]."},{"key":"40","doi-asserted-by":"crossref","unstructured":"Perera, C., Zaslavsky, A., Christen, P., and Georgakopoulos, D. (2014). Context aware computing for the internet of things: A survey. IEEE Communications Surveys & Tutorials<\/i>, 16(1):414-454. DOI: 10.1109\/surv.2013.042313.00197<\/a>.","DOI":"10.1109\/SURV.2013.042313.00197"},{"key":"41","doi-asserted-by":"crossref","unstructured":"Rath, F., Schemmel, D., and Wehrle, K. (2018). Interoperability-guided testing of quic implementations using symbolic execution. In Proceedings of the Workshop on the Evolution, Performance, and Interoperability of QUIC<\/i>, pages 15-21. DOI: 10.1145\/3284850.3284853<\/a>.","DOI":"10.1145\/3284850.3284853"},{"key":"42","doi-asserted-by":"crossref","unstructured":"Rayes, A. and Salam, S. (2019). Internet of things from hype to reality: The road to digitization<\/i>. Springer. Book.","DOI":"10.1007\/978-3-319-99516-8"},{"key":"43","unstructured":"Rowland, C., Goodman, E., Charlier, M., Light, A., and Lui, A. (2015). Designing Connected Products: UX for the Consumer Internet of Things<\/i>. O'Reilly Media, Inc., first edition. Book."},{"key":"44","doi-asserted-by":"crossref","unstructured":"Shapiro, S. S. and Wilk, M. B. (1965). An analysis of variance test for normality (complete samples). Biometrika<\/i>, 52(3-4):591-611. DOI: 10.1093\/biomet\/52.3-4.591<\/a>.","DOI":"10.1093\/biomet\/52.3-4.591"},{"key":"45","doi-asserted-by":"crossref","unstructured":"Sicari, S., Rizzardi, A., Grieco, L. A., and Coen-Porisini, A. (2015). Security, privacy and trust in internet of things: The road ahead. Computer networks<\/i>, 76:146-164. DOI: 10.1016\/j.comnet.2014.11.008<\/a>.","DOI":"10.1016\/j.comnet.2014.11.008"},{"key":"46","doi-asserted-by":"crossref","unstructured":"Silva, V. M. d. (2019). Scenariot: support for scenario specification of internet of things-based software systems. DOI: 10.5753\/cbsoft_estendido.2020.14628<\/a>.","DOI":"10.5753\/cbsoft_estendido.2020.14628"},{"key":"47","unstructured":"Soares, D. (2009). Interoperabilidade entre sistemas de informa\u00e7\u00e3o na administra\u00e7\u00e3o p\u00fablica. sl] Universidade do Minho<\/i>. Available at:[link<\/a>]."},{"key":"48","doi-asserted-by":"crossref","unstructured":"Venkatesh, V. and Davis, F. D. (2000). A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management science<\/i>, 46(2):186-204. DOI: 10.1287\/mnsc.46.2.186.11926<\/a>.","DOI":"10.1287\/mnsc.46.2.186.11926"},{"key":"49","doi-asserted-by":"crossref","unstructured":"Venkatesh, V., Morris, M. G., Davis, G. B., and Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS quarterly<\/i>, pages 425-478. Available at:[link<\/a>].","DOI":"10.2307\/30036540"},{"key":"50","unstructured":"Vermesan, O. and Friess, P. (2011). Internet of Things: Global technological and societal trends<\/i>. River Publishers. Book."},{"key":"51","unstructured":"Weiss, L. C. et al<\/i>. (2019). Interoperabilidade sem\u00e2ntica: uma an\u00e1lise sob a perspectiva da abordagem ontol\u00f3gica de willard van orman quine. Available at:[link<\/a>]."},{"key":"52","doi-asserted-by":"crossref","unstructured":"Wohlin, C., Runeson, P., H\u00f6st, M., Ohlsson, M. C., Regnell, B., and Wessl\u00e9n, A. (2012). Experimentation in Software Engineering<\/i>. Springer Science & Business Media. DOI: 10.1007\/978-1-4615-4625-2<\/a>.","DOI":"10.1007\/978-1-4615-4625-2"},{"key":"53","doi-asserted-by":"crossref","unstructured":"Zaidi, F., Bayse, E., and Cavalli, A. (2009). Network protocol interoperability testing based on contextual signatures and passive testing. In Proceedings of the 2009 ACM symposium on Applied Computing<\/i>, pages 2-7. DOI: 10.1145\/1529282.1529284<\/a>.","DOI":"10.1145\/1529282.1529284"},{"key":"54","doi-asserted-by":"crossref","unstructured":"Zanella, A., Bui, N., Castellani, A., Vangelista, L., and Zorzi, M. (2014). Internet of things for smart cities. IEEE Internet of Things journal<\/i>, 1(1):22-32. DOI: 10.1109\/jiot.2014.2306328<\/a>.","DOI":"10.1109\/JIOT.2014.2306328"}],"container-title":["Journal of the Brazilian Computer Society"],"original-title":[],"link":[{"URL":"https:\/\/journals-sol.sbc.org.br\/index.php\/jbcs\/article\/download\/5473\/4084","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals-sol.sbc.org.br\/index.php\/jbcs\/article\/download\/5473\/4084","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:25:59Z","timestamp":1782843959000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals-sol.sbc.org.br\/index.php\/jbcs\/article\/view\/5473"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,29]]},"references-count":54,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1,20]]}},"URL":"https:\/\/doi.org\/10.5753\/jbcs.2026.5473","relation":{},"ISSN":["1678-4804"],"issn-type":[{"value":"1678-4804","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,29]]}}}