{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:35:12Z","timestamp":1760240112944,"version":"build-2065373602"},"reference-count":20,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2019,3,22]],"date-time":"2019-03-22T00:00:00Z","timestamp":1553212800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Joint Research Centre, European Commission","award":["H3478"],"award-info":[{"award-number":["H3478"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>Interoperability is a challenge for the realisation of smart grids. In this work, we apply the methodology for interoperability testing and the design of experiments developed at the Smart Grids Interoperability Laboratory of the Joint Research Centre of the European Commission on a simple use case. The methodology is based on the Smart Grid Architecture Model (SGAM) of CEN\/CENELEC\/ETSI and includes the concept of Basic Application Profiles (BAP) and Basic Application Interoperability Profiles (BAIOP). The relevant elements of the methodology are the design of experiments and the sensitivity\/uncertainty analysis, which can reveal the limits of a system under test and give valuable feedback about the critical conditions which do not guarantee interoperability. The design and analysis of experiments employed in the Joint Research Centre (JRC) methodology supply information about the crucial parameters that either lead to an acceptable system performance or to a failure of interoperability. The use case on which the methodology is applied describes the interaction between a data concentrator and one or more smart meters. Experimental results are presented that show the applicability of the methodology and the design of experiments in practice. The system is tested under different conditions by varying two parameters: the rate at which meter data are requested by the data concentrator and the number of smart meters connected to the data concentrator. With this use case example the JRC methodology is illustrated at work, and its effectiveness for testing interoperability of a system under stress conditions is highlighted.<\/jats:p>","DOI":"10.3390\/app9061221","type":"journal-article","created":{"date-parts":[[2019,3,25]],"date-time":"2019-03-25T06:56:52Z","timestamp":1553497012000},"page":"1221","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Design of Experiments in the Methodology for Interoperability Testing: Evaluating AMI Message Exchange"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3114-8994","authenticated-orcid":false,"given":"Nikoleta","family":"Andreadou","sequence":"first","affiliation":[{"name":"Energy Security, Distribution and Markets Unit, Directorate of Energy, Transport and Climate, Joint Research Centre, 21027 Ispra, Italy"}]},{"given":"Alexandre","family":"Lucas","sequence":"additional","affiliation":[{"name":"Energy Security, Distribution and Markets Unit, Directorate of Energy, Transport and Climate, Joint Research Centre, 21027 Ispra, Italy"}]},{"given":"Stefano","family":"Tarantola","sequence":"additional","affiliation":[{"name":"Energy Security, Distribution and Markets Unit, Directorate of Energy, Transport and Climate, Joint Research Centre, 21027 Ispra, Italy"}]},{"given":"Ioannis","family":"Poursanidis","sequence":"additional","affiliation":[{"name":"Energy Security, Distribution and Markets Unit, Directorate of Energy, Transport and Climate, Joint Research Centre, 21027 Ispra, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2019,3,22]]},"reference":[{"key":"ref_1","unstructured":"Papaioannou, I., Tarantola, S., Lucas, A., Kotsakis, E., Marinopoulos, A., Ginocchi, M., Olariaga-Guardiola, M., and Masera, M. (2018). Smart Grid Interoperability TestingMethodology."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Sendin, A., Berganza, I., Arzuaga, A., Pulkkinen, A., and Kim, I.H. (2012, January 5\u20138). Performance results from 100,000+ PRIME smart meters deployment in Spain. Proceedings of the IEEE Third International Conference on Smart Grid Communications (SmartGridComm), Tainan, Taiwan.","DOI":"10.1109\/SmartGridComm.2012.6485974"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Aruzuaga, A., Berganza, I., Sendin, A., Sharma, M., and Varadarajan, B. (2010, January 4\u20136). PRIME Interoperability Tests and Results from Field. Proceedings of the First IEEE International Conference on Smart Grid Communications, Gaithersburg, MD, USA.","DOI":"10.1109\/SMARTGRID.2010.5622029"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Uribe-P\u00e9rez, N., Angulo, I., De la Vega, D., Arzuaga, T., Fern\u00e1ndez, I., and Arrinda, A. (2017). Smart Grid Applications for a Practical Implementation of IP over Narrowband Power Line Communications. Energies, 10.","DOI":"10.3390\/en10111782"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Uribe-P\u00e9rez, N., Hern\u00e1ndez, L., De la Vega, D., and Angulo, I. (2016). State of the Art and Trends Review of Smart Metering in Electricity Grids. Appl. Sci., 6.","DOI":"10.3390\/app6030068"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Dehalwar, V., Kalam, A., Lal Kolhe, M., and Zayegh, A. (2015, January 16\u201319). Review of IEEE 802.22 and IEC 61850 for real-time communication in Smart Grid. Proceedings of the International Conference on Computing and Network Communications (CoCoNet), Trivandrum, India.","DOI":"10.1109\/CoCoNet.2015.7411245"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ke, C.H., Hsieh, S.Y., Lin, T.C., and Ho, T.H. (2018). Efficiency network construction of advanced metering infrastructure using Zigbee. IEEE Trans. Mob. Comput.","DOI":"10.1109\/TMC.2018.2848237"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2002","DOI":"10.1109\/TSG.2014.2371853","article-title":"Real-Time Low Voltage Network Monitoring\u2014ICT Architecture and Field Test Experience","volume":"6","author":"Lu","year":"2015","journal-title":"IEEE Trans. Smart Grid"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Pau, M., Patti, E., Barbierato, L., Estebsari, A., Pons, E., Ponci, F., and Monti, A. (2016, January 28\u201330). Low voltage system state estimation based on smart metering infrastructure. Proceedings of the IEEE International Workshop on Applied Measurements for Power Systems (AMPS), Aachen, Germany.","DOI":"10.1109\/AMPS.2016.7602804"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Jayashree, L., and Sandanalakshmi, R. (2017, January 22\u201324). Priority based routing framework for neighborhood area network in smart grid communication. Proceedings of the International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET), Chennai, India.","DOI":"10.1109\/WiSPNET.2017.8300009"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tanakornpintong, S., Tangsunantham, N., Sangsuwan, T., and Pirak, C. (2017, January 25\u201327). Location optimization for data concentrator unit in IEEE 802.15.4 smart grid networks. Proceedings of the 17th International Symposium on Communications and Information Technologies (ISCIT), Cairns, QLD, Australia.","DOI":"10.1109\/ISCIT.2017.8261218"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Pit\u00ec, A., Verticale, G., Rottondi, C., Capone, A., and Lo Schiavo, L. (2017). The Role of Smart Meters in Enabling Real-Time Energy Services for Households: The Italian Case. Energies, 10.","DOI":"10.3390\/en10020199"},{"key":"ref_13","unstructured":"(2019, March 13). CEN\/CENELEC-ETSI Smart Grid Set of Standards version 4.0 Final Oct 2016, Available online: https:\/\/www.cencenelec.eu\/standards\/Sectors\/SustainableEnergy\/SmartGrids\/Pages\/default.aspx."},{"key":"ref_14","unstructured":"(2019, March 13). CEN\/CENELEC-ETSI Functional Reference Architecture for Communications in Smart Metering Systems. Available online: ftp:\/\/ftp.cen.eu\/cen\/Sectors\/List\/Measurement\/Smartmeters\/CENCLCETSI_TR50572.pdf."},{"key":"ref_15","unstructured":"(2019, March 13). Sustainable Processes, CEN-CENELEC-ETSI Smart Grid Coordination Group. Available online: ftp:\/\/ftp.cen.eu\/EN\/EuropeanStandardization\/HotTopics\/SmartGrids\/Sustainable%20Processes.pdf."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Konstantinou, C., and Maniatakos, M. (2017). Security analysis of Smart Grid. Communication Control Security Challenges for the Smart Grid, ebooks IET.","DOI":"10.1049\/PBPO095E_ch15"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Bhattarai, B.P., Paudyal, S., Luo, Y., Mohanpurkar, M., Cheung, K., Tonkoski, R., Hovsapian, R., Myers, K.S., Zhang, R., and Zhao, P. (2019). Big data analytics in smart grids: State-of-the-art, challenges, opportunities, and future directions. IET Smart Grid.","DOI":"10.1049\/iet-stg.2018.0261"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Andreadou, N., Papaioannou, I., and Masera, M. (2019). Interoperability Testing Methodology for Smart Grids and Its Application on a DSM Use Case\u2014A Tutorial. Energies, 12.","DOI":"10.3390\/en12010008"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Poursanidis, I., Kotsakis, E., Andreadou, N., and Masera, M. (2018, January 12\u201315). Evaluation of Interoperability in the Context of Advanced Metering Infrastructure. Proceedings of the IEEE International Conference on Smart Energy Grid Engineering (SEGE), Oshawa, ON, Canada.","DOI":"10.1109\/SEGE.2018.8499375"},{"key":"ref_20","unstructured":"(2010). Draft Standard for PoweRline Intelligent Metering Evolution (PRIME), PRIME Alliance Technical Working Group."}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/9\/6\/1221\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:40:07Z","timestamp":1760186407000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/9\/6\/1221"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,22]]},"references-count":20,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["app9061221"],"URL":"https:\/\/doi.org\/10.3390\/app9061221","relation":{},"ISSN":["2076-3417"],"issn-type":[{"type":"electronic","value":"2076-3417"}],"subject":[],"published":{"date-parts":[[2019,3,22]]}}}