{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T21:30:39Z","timestamp":1778707839415,"version":"3.51.4"},"reference-count":53,"publisher":"Springer Science and Business Media LLC","issue":"S3","license":[{"start":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T00:00:00Z","timestamp":1630454400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T00:00:00Z","timestamp":1631491200000},"content-version":"vor","delay-in-days":12,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Energy Inform"],"published-print":{"date-parts":[[2021,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>With increasing digitization, new opportunities emerge concerning the availability and use of data in the energy sector. A comprehensive literature review shows an abundance in available unsupervised clustering algorithms as well as internal, relative and external cluster validation indices (cvi) to evaluate the results. Yet, the comparison of different clustering results on the same dataset, executed with different algorithms and a specific practical goal in mind still proves scientifically challenging. A large variety of cvi are described and consolidated in commonly used composite indices (e.g. Davies-Bouldin-Index, silhouette-Index, Dunn-Index). Previous works show the challenges surrounding these composite indices since they serve a generalized cluster quality evaluation. However, this does not suit individual clustering goals in many cases. The presented paper introduces the current state of science, existing cluster validation indices and proposes a practical method to combine them to an individual composite index, using Multi Criteria Decision Analysis (mcda). The methodology is applied on two energy economic use cases for clustering load profiles of bidirectional electric vehicles and municipalities.<\/jats:p>","DOI":"10.1186\/s42162-021-00177-1","type":"journal-article","created":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T16:03:19Z","timestamp":1631548999000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A practical approach to cluster validation in the energy sector"],"prefix":"10.1186","volume":"4","author":[{"given":"Alexander","family":"Bogensperger","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yann","family":"Fabel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,9,13]]},"reference":[{"key":"177_CR1","unstructured":"Ackerman, M, Ben-David S (2009) Clusterability: A theoretical study In: Proceedings of the 12th International Conference on Artificial Intelligence and Statistics, PMLR 5, 1\u20138."},{"issue":"5","key":"177_CR2","doi-asserted-by":"publisher","first-page":"1523","DOI":"10.1007\/s11222-020-09958-2","volume":"30","author":"SE Akhanli","year":"2020","unstructured":"Akhanli, SE, Hennig C (2020) Comparing clusterings and numbers of clusters by aggregation of calibrated clustering validity indexes. Stat Comput 30(5):1523\u20131544.","journal-title":"Stat Comput"},{"key":"177_CR3","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/j.egypro.2017.07.341","volume":"122","author":"HM Bittel","year":"2017","unstructured":"Bittel, HM, Perera ATD, Mauree D, Scartezzini J-L (2017) Locating multi energy systems for a neighborhood in geneva using k-means clustering. Energy Procedia 122:169\u2013174.","journal-title":"Energy Procedia"},{"key":"177_CR4","first-page":"30","volume-title":"Journal of Physics: Conference Series","author":"F B\u00f6ing","year":"2018","unstructured":"B\u00f6ing, F, Murmann A, Pellinger C, Bruckmeier A, Kern T, Mongin T (2018) Assessment of grid optimisation measures for the German transmission grid using open source grid data In: Journal of Physics: Conference Series, 30\u201331.. SciGRID International Conference on Power Grid Modelling, Oldenburg."},{"key":"177_CR5","unstructured":"Brickey, J, Walczak S, Burgess T (2010) A comparative analysis of persona clustering methods. AMCIS 2010 Proc:217."},{"key":"177_CR6","doi-asserted-by":"publisher","first-page":"88200","DOI":"10.1109\/ACCESS.2020.2992903","volume":"8","author":"J Cai","year":"2020","unstructured":"Cai, J, Wei H, Yang H (2020) A novel clustering algorithm based on DPC and PSO. IEEE Access 8:88200\u201388214.","journal-title":"IEEE Access"},{"issue":"21","key":"177_CR7","doi-asserted-by":"publisher","first-page":"7746","DOI":"10.1016\/j.eswa.2015.05.007","volume":"42","author":"X Chen","year":"2015","unstructured":"Chen, X (2015) A new clustering algorithm based on near neighbor influence. Expert Syst Appl 42(21):7746\u20137758.","journal-title":"Expert Syst Appl"},{"key":"177_CR8","unstructured":"Chou, CH, Su MC, Lai E (2002) Symmetry as a new measure for cluster validity In: 2nd WSEAS Conference on Scientific Compuation and Soft Computing, 209\u2013213."},{"key":"177_CR9","doi-asserted-by":"publisher","first-page":"109964","DOI":"10.1016\/j.rser.2020.109964","volume":"130","author":"C-C Cormos","year":"2020","unstructured":"Cormos, C-C, Petrescu L, Chisalita D-A (2020) Environmental evaluation of european ammonia production considering various hydrogen supply chains. Renew Sust Energ Rev 130:109964.","journal-title":"Renew Sust Energ Rev"},{"issue":"5","key":"177_CR10","doi-asserted-by":"publisher","first-page":"688","DOI":"10.1016\/j.patrec.2007.12.002","volume":"29","author":"S Das","year":"2008","unstructured":"Das, S, Abraham A, Konar A (2008) Automatic kernel clustering with a multi-elitist particle swarm optimization algorithm. Pattern Recogn Lett 29(5):688\u2013699.","journal-title":"Pattern Recogn Lett"},{"issue":"2","key":"177_CR11","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1016\/S0377-2217(01)00370-8","volume":"139","author":"J Figueira","year":"2002","unstructured":"Figueira, J, Roy B (2002) Determining the weights of criteria in the ELECTRE type methods with a revised Simos\u2019 procedure. Eur J Oper Res 139(2):317\u2013326.","journal-title":"Eur J Oper Res"},{"key":"177_CR12","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898718348","volume-title":"Data Clustering: Theory, Algorithms, and Applications","author":"G Gan","year":"2007","unstructured":"Gan, G, Ma C, Wu J (2007) Data Clustering: Theory, Algorithms, and Applications. York University, Toronto, Canada."},{"key":"177_CR13","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1016\/j.energy.2014.12.054","volume":"81","author":"G Gheorghe","year":"2015","unstructured":"Gheorghe, G, Scarlatache F (2015) An assessment of the renewable energy potential using a clustering based data mining method. Case study in Romania. Energy 81:416\u2013429. https:\/\/doi.org\/10.1016\/j.energy.2014.12.054.","journal-title":"Energy"},{"key":"177_CR14","volume-title":"Method-Independent Indices for Cluster Validation and Estimating the Number of Clusters","author":"M Halkidi","year":"2016","unstructured":"Halkidi, M, Vazirgiannis M, Hennig C (2016) Method-Independent Indices for Cluster Validation and Estimating the Number of Clusters. Chapman and Hall\/CRC, Boca Raton."},{"key":"177_CR15","doi-asserted-by":"publisher","unstructured":"Hennig, C (2015) Clustering strategy and method selection. In: Rocci R, Murtagh F, Meila M, Hennig C (eds)Handbook of Cluster Analysis, 1st ed.. Chapman and Hall\/CRC. https:\/\/doi.org\/10.1201\/b19706.","DOI":"10.1201\/b19706"},{"key":"177_CR16","first-page":"1","volume":"2","author":"C Hennig","year":"2020","unstructured":"Hennig, C (2020) Cluster validation by measurement of clustering characteristics relevant to the user. Data Anal Appl 1: Clustering Regression, Modeling-estimating, Forecast Data Mining 2:1\u201324.","journal-title":"Data Anal Appl 1: Clustering Regression, Modeling-estimating, Forecast Data Mining"},{"key":"177_CR17","volume-title":"Comparing latent class and dissimilarity based clustering for mixed type variables with application to social stratification (Research Report No. 308)","author":"C Hennig","year":"2010","unstructured":"Hennig, C, Liao TF (2010) Comparing latent class and dissimilarity based clustering for mixed type variables with application to social stratification (Research Report No. 308). Department of Statistical Science, University College London, London."},{"key":"177_CR18","unstructured":"Kleinberg, J (2002) An impossibility theorem for clustering In: Proceedings of the 15th International Conference on Neural Information Processing Systems (NIPS\u2019 02), 463\u2013470."},{"key":"177_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ins.2014.02.137","volume":"275","author":"G Kou","year":"2014","unstructured":"Kou, G, Peng Y, Wang G (2014) Evaluation of clustering algorithms for financial risk analysis using MCDM methods. Inf Sci 275:1\u201312.","journal-title":"Inf Sci"},{"key":"177_CR20","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1016\/j.eswa.2019.03.051","volume":"129","author":"FH Kuwil","year":"2019","unstructured":"Kuwil, FH, Shaar F, Topcu AE, Murtagh F, Applications ES (2019) A new data clustering algorithm based on critical distance methodology. Expert Syst Appl 129:296\u2013310.","journal-title":"Expert Syst Appl"},{"key":"177_CR21","unstructured":"Leijten, F, Boland M, Tsiachristas A, Hoedemakers M, Verbeek N, Islam K, Askildsen JE, de Bont A, Bal R, Rutten-van M\u00f6lken M (2017) Development of an analytical framework to perform a comprehensive evaluation of integrated care. 53\u201356."},{"key":"177_CR22","doi-asserted-by":"publisher","unstructured":"Liu, Y, Li Z, Xiong H, Gao X, Wu J (2010) Understanding of internal clustering validation measures In: 2010 IEEE International Conference on Data Mining, 911\u2013916. https:\/\/doi.org\/10.1109\/ICDM.2010.35.","DOI":"10.1109\/ICDM.2010.35"},{"key":"177_CR23","volume-title":"Cluster Analysis for Social Scientists","author":"M Lorr","year":"1983","unstructured":"Lorr, M (1983) Cluster Analysis for Social Scientists. Jossey-Bass Inc.,U.S., San Francisco, USA."},{"key":"177_CR24","doi-asserted-by":"publisher","DOI":"10.1201\/b10434","volume-title":"Exploratory Data Analysis with MATLAB","author":"WL Martinez","year":"2010","unstructured":"Martinez, WL, Martinez AR, Solka JL (2010) Exploratory Data Analysis with MATLAB. Chapman and Hall\/CRC Computer Science and Data Analysis, Boca Raton."},{"issue":"11","key":"177_CR25","doi-asserted-by":"publisher","first-page":"205","DOI":"10.21105\/joss.00205","volume":"2","author":"L McInnes","year":"2017","unstructured":"McInnes, L, Healy J, Astels S (2017) hdbscan: Hierarchical density based clustering. J Open Source Softw 2(11):205.","journal-title":"J Open Source Softw"},{"key":"177_CR26","unstructured":"Metwalli, SA (2020) Clustering 101: How to Choose the Right Algorithm for Your Application - An Introduction to different types of clustering algorithms. towards data science, Toronto, Canada. https:\/\/towardsdatascience.com\/clustering-101-how-to-choose-the-right-algorithm-for-your-application-fb1521ea13fc. Accessed 01 Mar 2021."},{"key":"177_CR27","volume-title":"Multikriterielle Bewertung von Technologien zur Bereitstellung von Strom und W\u00e4rme","author":"J Oberschmidt","year":"2010","unstructured":"Oberschmidt, J (2010) Multikriterielle Bewertung von Technologien zur Bereitstellung von Strom und W\u00e4rme. Universit\u00e4t G\u00f6ttingen, G\u00f6ttingen."},{"key":"177_CR28","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1002\/mcda.392","volume":"13","author":"J Pictet","year":"2005","unstructured":"Pictet, J, Bollinger D (2005) The silent negotiation or How to elicit collective information for group MCDA without excessive discussion. J Multi-Criteria Decis Anal 13:199\u2013211. Lausanne.","journal-title":"J Multi-Criteria Decis Anal"},{"issue":"4","key":"177_CR29","doi-asserted-by":"publisher","first-page":"617","DOI":"10.1016\/S0031-3203(99)00076-X","volume":"33","author":"J Puzicha","year":"2000","unstructured":"Puzicha, J, Hofmann T, Buhmann JM, Letters P (2000) A theory of proximity based clustering: structure detection by optimization. Pattern Recogn 33(4):617\u2013634.","journal-title":"Pattern Recogn"},{"issue":"1","key":"177_CR30","first-page":"27","volume":"5","author":"E Rend\u00f3n","year":"2011","unstructured":"Rend\u00f3n, E, Abundez I, Arizmendi A, Quiroz EM (2011) Internal versus external cluster validation indexes. Int J Comput Commun 5(1):27\u201334.","journal-title":"Int J Comput Commun"},{"key":"177_CR31","unstructured":"Rend\u00f3n, E, Abundez IM, Gutierrez C, Zagal SD, Arizmendi A, Quiroz EM, Arzate HE (2011) A comparison of internal and external cluster validation indexes In: Proceedings of the 2011 American conference on applied mathematics and the 5th WSEAS international conference on Computer engineering and applications, 158\u2013163."},{"key":"177_CR32","unstructured":"Rend\u00f3n, E, Garcia R, Abundez I, Gutierrez C, Gasca E, Del Razo F, Gonzalez A (2008) Niva: a robust cluster validity In: Proceedings of the 12th WSEAS International Conference on Communications (ICCOM\u201908), 241\u2013248."},{"key":"177_CR33","unstructured":"Samweber, F (2017) Systematischer Vergleich Netzoptimierender Ma\u00dfnahmen zur Integration elektrischer W\u00e4rmeerzeuger und Fahrzeuge in Niederspannungsnetze (Doctoral Thesis). Technical University of Munich, 104."},{"key":"177_CR34","unstructured":"Samweber, F, K\u00f6ppl S, Bogensperger A, B\u00f6ing F, Bruckmeier A, Estermann T, M\u00fcller M, Zeiselmair A (2017) Abschlussbericht Einsatzreihenfolgen - Projekt MONA 2030: Ganzheitliche Bewertung Netzoptimierender Ma\u00dfnahmen gem\u00e4\u00df technischer, \u00f6konomischer, \u00f6kologischer, gesellschaftlicher und rechtlicher Kriterien, 125\u2013127."},{"issue":"4","key":"177_CR35","doi-asserted-by":"publisher","first-page":"604","DOI":"10.3390\/su4040604","volume":"4","author":"P Schmuck","year":"2012","unstructured":"Schmuck, P (2012) Transdisciplinary Evaluation of Energy Scenarios for a German Village Using Multi-Criteria Decision Analysis. Sustainability 4(4):604\u2013629.","journal-title":"Sustainability"},{"key":"177_CR36","doi-asserted-by":"publisher","first-page":"570","DOI":"10.1016\/j.renene.2018.06.028","volume":"129","author":"T Sch\u00fctz","year":"2018","unstructured":"Sch\u00fctz, T, Schraven MH, Fuchs M, Remmen P, M\u00fcller D (2018) Comparison of clustering algorithms for the selection of typical demand days for energy system synthesis. Renew Energy 129:570\u2013582.","journal-title":"Renew Energy"},{"key":"177_CR37","unstructured":"Sharma, P (2020) What is Predictive Power Score (PPS) \u2013 Is it better than Correlation ? [With Python Code]. Machine Learning Knowledge, Carlsbad. https:\/\/machinelearningknowledge.ai\/predictive-power-score-vs-correlation-with-python-implementation\/. Accessed 01 Mar 2021."},{"key":"177_CR38","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1016\/j.esr.2019.100362","volume":"25","author":"K Siala","year":"2019","unstructured":"Siala, K, Mahfouz MY (2019) Impact of the choice of regions on energy system models. Energy Strateg Rev 25:75\u201385.","journal-title":"Energy Strateg Rev"},{"key":"177_CR39","volume-title":"Evaluer l\u2019impact sur l\u2019environnement. Une approche originale par l\u2019analyse multicrit\u00e8re et la n\u00e9gociation","author":"J Simos","year":"1990","unstructured":"Simos, J (1990) Evaluer l\u2019impact sur l\u2019environnement. Une approche originale par l\u2019analyse multicrit\u00e8re et la n\u00e9gociation. Presses polytechniques et universitaires romandes, Lausanne."},{"key":"177_CR40","doi-asserted-by":"crossref","unstructured":"Syakur, MA, Khotimah BK, Rochman EMS, Satoto BD (2018) Integration k-means clustering method and elbow method for identification of the best customer profile cluster In: IOP Conference Series: Materials Science and Engineering, 012017.","DOI":"10.1088\/1757-899X\/336\/1\/012017"},{"key":"177_CR41","doi-asserted-by":"crossref","unstructured":"Tanwar, AK, Crisostomi E, Raugi M, Tucci M, Giunta G (2015) Clustering analysis of the electrical load in european countries In: 2015 International Joint Conference on Neural Networks (IJCNN), 1\u20138.","DOI":"10.1109\/IJCNN.2015.7280329"},{"key":"177_CR42","volume-title":"SAC \u201916: Proceedings of the 31st Annual ACM Symposium on Applied Computing","author":"C Tomasini","year":"2016","unstructured":"Tomasini, C, Emmendorfer L, Borges EN, Machado K (2016) A methodology for selecting the most suitable cluster validation internal indices. In: Tomasini C et al (eds)SAC \u201916: Proceedings of the 31st Annual ACM Symposium on Applied Computing.. Association for Computing Machinery, New York."},{"key":"177_CR43","unstructured":"Toussaint, W, Moodley DComparison of clustering techniques for residential load profiles in South Africa? In: Toussaint W et al (eds)Proceedings of the South African Forum for Artificial Intelligence Research Fair.. CEUR Workshop Proceedings, 2019."},{"key":"177_CR44","volume-title":"Exploratory Data Analysis","author":"JW Tukey","year":"1977","unstructured":"Tukey, JW (1977) Exploratory Data Analysis. Addison-Wesley Publishing Company, Boston."},{"key":"177_CR45","volume-title":"Categories and Concepts: Theoretical Views and Inductive Data Analysis","author":"I Van Mechelen","year":"1993","unstructured":"Van Mechelen, I, Hampton JA (1993) Categories and Concepts: Theoretical Views and Inductive Data Analysis. Academic Press, New York, USA."},{"issue":"4","key":"177_CR46","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1002\/sam.10080","volume":"3","author":"L Vendramin","year":"2010","unstructured":"Vendramin, L, Campello RJGB, Hruschka ER (2010) Relative clustering validity criteria: A comparative overview. Stat Anal Data Mining: ASA Data Sci J 3(4):209\u2013235.","journal-title":"Stat Anal Data Mining: ASA Data Sci J"},{"issue":"9","key":"177_CR47","doi-asserted-by":"publisher","first-page":"2263","DOI":"10.1016\/j.rser.2009.06.021","volume":"13","author":"J Wang","year":"2009","unstructured":"Wang, J, You-Yin J, Chun-Fa Z, Jun-Hong Z (2009) Review on multi-criteria decision analysis aid in sustainable energy decision-making. Renew Sust Energ Rev 13(9):2263\u20132278. Amsterdam.","journal-title":"Renew Sust Energ Rev"},{"key":"177_CR48","unstructured":"Wilkens, I (2012) Multikriterielle Analyse zur Nachhaltigkeitsbewertung von Energiesystemen - Von der Theorie zur praktischen Anwendung. Technische Universit\u00e4t Berlin, Berlin."},{"key":"177_CR49","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-45640-8","volume-title":"Uncertain Multi-Attribute Decision Making: Methods and Applications","author":"Z Xu","year":"2015","unstructured":"Xu, Z (2015) Uncertain Multi-Attribute Decision Making: Methods and Applications. Springer, Berlin; Heidelberg."},{"key":"177_CR50","doi-asserted-by":"publisher","unstructured":"Wang, X, Xu Y (2019) An improved index for clustering validation based on Silhouette index and Calinski-Harabasz index In: IOP Conference Series: Materials Science and Engineering. 569. 052024. https:\/\/doi.org\/10.1088\/1757-899X\/569\/5\/052024.","DOI":"10.1088\/1757-899X\/569\/5\/052024"},{"key":"177_CR51","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.enbuild.2017.03.071","volume":"146","author":"J Yang","year":"2017","unstructured":"Yang, J, Ning C, Deb C, Fan Z, Cheong D, Eang Lee S, Sekhar C, Tham KW (2017) K-Shape clustering algorithm for building energy usage patterns analysis and forecasting model accuracy improvement. Energy Build 146:27\u201337.","journal-title":"Energy Build"},{"key":"177_CR52","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-12586-2","volume-title":"Weighting Methods and their Effects on Multi-Criteria Decision Making Model Outcomes in Water Resources Management","author":"NH Zardari","year":"2015","unstructured":"Zardari, NH, Ahmed K, Shirazi SM, Yusop ZB (2015) Weighting Methods and their Effects on Multi-Criteria Decision Making Model Outcomes in Water Resources Management. Springer, Basel."},{"key":"177_CR53","doi-asserted-by":"publisher","first-page":"900","DOI":"10.1016\/j.jclepro.2016.09.165","volume":"141","author":"K Zhou","year":"2017","unstructured":"Zhou, K, Yang S, Shao Z (2017) Household monthly electricity consumption pattern mining: A fuzzy clustering-based model and a case study. J Clean Prod 141:900\u2013908.","journal-title":"J Clean Prod"}],"container-title":["Energy Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42162-021-00177-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s42162-021-00177-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42162-021-00177-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T16:14:42Z","timestamp":1631549682000},"score":1,"resource":{"primary":{"URL":"https:\/\/energyinformatics.springeropen.com\/articles\/10.1186\/s42162-021-00177-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9]]},"references-count":53,"journal-issue":{"issue":"S3","published-print":{"date-parts":[[2021,9]]}},"alternative-id":["177"],"URL":"https:\/\/doi.org\/10.1186\/s42162-021-00177-1","relation":{},"ISSN":["2520-8942"],"issn-type":[{"value":"2520-8942","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9]]},"assertion":[{"value":"13 September 2021","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"18"}}