{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T00:53:29Z","timestamp":1780707209622,"version":"3.54.1"},"reference-count":63,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2020,6,20]],"date-time":"2020-06-20T00:00:00Z","timestamp":1592611200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010198","name":"Ministerio de Econom\u00eda, Industria y Competitividad, Gobierno de Espa\u00f1a","doi-asserted-by":"publisher","award":["TEC2017-84395-P."],"award-info":[{"award-number":["TEC2017-84395-P."]}],"id":[{"id":"10.13039\/501100010198","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>This paper proposes a speech-based method for automatic depression classification. The system is based on ensemble learning for Convolutional Neural Networks (CNNs) and is evaluated using the data and the experimental protocol provided in the Depression Classification Sub-Challenge (DCC) at the 2016 Audio\u2013Visual Emotion Challenge (AVEC-2016). In the pre-processing phase, speech files are represented as a sequence of log-spectrograms and randomly sampled to balance positive and negative samples. For the classification task itself, first, a more suitable architecture for this task, based on One-Dimensional Convolutional Neural Networks, is built. Secondly, several of these CNN-based models are trained with different initializations and then the corresponding individual predictions are fused by using an Ensemble Averaging algorithm and combined per speaker to get an appropriate final decision. The proposed ensemble system achieves satisfactory results on the DCC at the AVEC-2016 in comparison with a reference system based on Support Vector Machines and hand-crafted features, with a CNN+LSTM-based system called DepAudionet, and with the case of a single CNN-based classifier.<\/jats:p>","DOI":"10.3390\/e22060688","type":"journal-article","created":{"date-parts":[[2020,6,22]],"date-time":"2020-06-22T06:46:12Z","timestamp":1592808372000},"page":"688","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":108,"title":["Automatic Detection of Depression in Speech Using Ensemble Convolutional Neural Networks"],"prefix":"10.3390","volume":"22","author":[{"given":"Adri\u00e1n","family":"V\u00e1zquez-Romero","sequence":"first","affiliation":[{"name":"Department of Signal Theory and Communications, Universidad Carlos III de Madrid, Avda. de la Universidad, 30, Legan\u00e9s, 28911 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9322-3128","authenticated-orcid":false,"given":"Ascensi\u00f3n","family":"Gallardo-Antol\u00edn","sequence":"additional","affiliation":[{"name":"Department of Signal Theory and Communications, Universidad Carlos III de Madrid, Avda. de la Universidad, 30, Legan\u00e9s, 28911 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,20]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (2017). Depression and Other Common Mental Disorders: Global Health Estimates, World Health Organization. Technical Report."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bachmann, S. (2018). Epidemiology of suicide and the psychiatric perspective. Int. J. Environ. Res. Public Health, 15.","DOI":"10.3390\/ijerph15071425"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/0272-7358(88)90050-5","article-title":"Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation","volume":"8","author":"Beck","year":"1988","journal-title":"Clin. Psychol. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/0022-3956(82)90033-4","article-title":"Development and validation of a geriatric depression screening scale: A preliminary report","volume":"17","author":"Yesavage","year":"1982","journal-title":"J. Psychiatr. Res."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hamilton, M. (1986). The Hamilton rating scale for depression. Assessment of Depression, Springer.","DOI":"10.1007\/978-3-642-70486-4_14"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.jad.2008.06.026","article-title":"The PHQ-8 as a measure of current depression in the general population","volume":"114","author":"Kroenke","year":"2009","journal-title":"J. Affect. Disord."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cohn, J.F., Kruez, T.S., Matthews, I., Yang, Y., Nguyen, M.H., Padilla, M.T., Zhou, F., and De la Torre, F. (2009, January 10\u201312). Detecting depression from facial actions and vocal prosody. Proceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, Amsterdam, The Netherlands.","DOI":"10.1109\/ACII.2009.5349358"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Valstar, M., Schuller, B., Smith, K., Eyben, F., Jiang, B., Bilakhia, S., Schnieder, S., Cowie, R., and Pantic, M. (2013, January 21\u201325). AVEC 2013: The continuous audio\/visual emotion and depression recognition challenge. Proceedings of the 3rd ACM International Workshop on Audio\/Visual Emotion Challenge, Barcelona, Spain.","DOI":"10.1145\/2512530.2512533"},{"key":"ref_9","unstructured":"Valstar, M., Schuller, B., Smith, K., Almaev, T., Eyben, F., Krajewski, J., Cowie, R., and Pantic, M. (2014, January 3\u20137). AVEC 2014: 3d dimensional affect and depression recognition challenge. Proceedings of the 4th International Workshop on Audio\/Visual Emotion Challenge, Orlando, FL, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Valstar, M., Gratch, J., Schuller, B., Ringeval, F., Cowie, R., and Pantic, M. (2016, January 15\u201319). Summary for AVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge. Proceedings of the 24th ACM International Conference on Multimedia, Amsterdam, The Netherlands.","DOI":"10.1145\/2964284.2980532"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ringeval, F., Schuller, B., Valstar, M., Cowie, R., Kaya, H., Schmitt, M., Amiriparian, S., Cummins, N., Lalanne, D., and Michaud, A. (2018, January 22\u201326). AVEC 2018 workshop and challenge: Bipolar disorder and cross-cultural affect recognition. Proceedings of the 2018 on Audio\/Visual Emotion Challenge and Workshop, Seoul, Korea.","DOI":"10.1145\/3266302.3266316"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Schuller, B., Valstar, M., Eyben, F., McKeown, G., Cowie, R., and Pantic, M. (2011, January 9\u201312). AVEC 2011\u2013the first international audio\/visual emotion challenge. Proceedings of the International Conference on Affective Computing and Intelligent Interaction, Memphis, TN, USA.","DOI":"10.1007\/978-3-642-24571-8_53"},{"key":"ref_13","unstructured":"Gratch, J., Artstein, R., Lucas, G., Stratou, G., Scherer, S., Nazarian, A., Wood, R., Boberg, J., DeVault, D., and Marsella, S. (2014, January 26\u201331). The Distress Analysis Interview Corpus of human and computer interviews. Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC), Reykjavik, Iceland."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1109\/TCYB.2013.2249063","article-title":"A dynamic appearance descriptor approach to facial actions temporal modeling","volume":"44","author":"Jiang","year":"2013","journal-title":"IEEE Trans. Cybern."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Cummins, N., Joshi, J., Dhall, A., Sethu, V., Goecke, R., and Epps, J. (2013, January 21\u201325). Diagnosis of depression by behavioural signals: A multimodal approach. Proceedings of the 3rd ACM International Workshop on Audio\/Visual Emotion Challenge, Barcelona, Spain.","DOI":"10.1145\/2512530.2512535"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1432","DOI":"10.1109\/TIFS.2015.2414392","article-title":"Automated depression diagnosis based on facial dynamic analysis and sparse coding","volume":"10","author":"Wen","year":"2015","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_17","unstructured":"Ooi, K.E.B., Low, L.S.A., Lech, M., and Allen, N. (2011, January 13\u201315). Prediction of clinical depression in adolescents using facial image analysis. Proceedings of the 12th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2011), Delft, The Netherlands."},{"key":"ref_18","unstructured":"K\u00e4chele, M., Glodek, M., Zharkov, D., Meudt, S., and Schwenker, F. (2014, January 6\u20138). Fusion of audio-visual features using hierarchical classifier systems for the recognition of affective states and the state of depression. Proceedings of the 3rd International Conference on Pattern Recognition Applications and Methods, Angers, France."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Yang, L., Jiang, D., He, L., Pei, E., Oveneke, M.C., and Sahli, H. (2016, January 16). Decision tree based depression classification from audio video and language information. Proceedings of the 6th International Workshop on Audio\/Visual Emotion Challenge, Amsterdam, The Netherlands.","DOI":"10.1145\/2988257.2988269"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.ymeth.2018.07.007","article-title":"Speech analysis for health: Current state-of-the-art and the increasing impact of deep learning","volume":"151","author":"Cummins","year":"2018","journal-title":"Methods"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1016\/j.jvoice.2018.02.003","article-title":"Detection of pathological voice using cepstrum vectors: A deep learning approach","volume":"33","author":"Fang","year":"2019","journal-title":"J. Voice"},{"key":"ref_22","first-page":"503","article-title":"Random Forest-based prediction of Parkinson\u2019s disease progression using acoustic, ASR and intelligibility features","volume":"2015","author":"Zlotnik","year":"2015","journal-title":"Proc. Interspeech"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.engappai.2018.09.018","article-title":"Automatic detection of Parkinson\u2019s disease based on acoustic analysis of speech","volume":"77","author":"Braga","year":"2019","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.csl.2018.07.007","article-title":"Identifying Mild Cognitive Impairment and mild Alzheimer\u2019s disease based on spontaneous speech using ASR and linguistic features","volume":"53","author":"Gosztolya","year":"2019","journal-title":"Comput. Speech Lang."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"139","DOI":"10.2174\/1567205014666171120143800","article-title":"Advances on automatic speech analysis for early detection of Alzheimer disease: A non-linear multi-task approach","volume":"15","author":"Calvo","year":"2018","journal-title":"Curr. Alzheimer Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1913","DOI":"10.21437\/Interspeech.2018-2496","article-title":"Automatic early detection of amyotrophic lateral sclerosis from intelligible speech using convolutional neural networks","volume":"2018","author":"An","year":"2018","journal-title":"Proc. Interspeech"},{"key":"ref_27","first-page":"216","article-title":"A saliency-based attention LSTM model for cognitive load classification from speech","volume":"2019","author":"Montero","year":"2019","journal-title":"Proc. Interspeech"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gallardo-Antol\u00edn, A., and Montero, J.M. (2019). External attention LSTM models for cognitive load classification from speech. International Conference on Statistical Language and Speech Processing, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-030-31372-2_12"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2513","DOI":"10.21437\/Interspeech.2019-1452","article-title":"Automatic detection of autism spectrum disorder in children using acoustic and text features from brief natural conversations","volume":"2019","author":"Cho","year":"2019","journal-title":"Proc. Interspeech"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.specom.2015.03.004","article-title":"A review of depression and suicide risk assessment using speech analysis","volume":"71","author":"Cummins","year":"2015","journal-title":"Speech Commun."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Asgari, M., Shafran, I., and Sheeber, L.B. (2014, January 21\u201324). Inferring clinical depression from speech and spoken utterances. Proceedings of the 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP), Reims, France.","DOI":"10.1109\/MLSP.2014.6958856"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Quatieri, T.F., and Malyska, N. (2012, January 9\u201313). Vocal-source biomarkers for depression: A link to psychomotor activity. Proceedings of the Thirteenth Annual Conference of the International Speech Communication Association, Portland, OR, USA.","DOI":"10.21437\/Interspeech.2012-311"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/0021-9924(84)90013-3","article-title":"Speech and voice parameters of depression: A pilot study","volume":"17","author":"Darby","year":"1984","journal-title":"J. Commun. Disord."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/BF00344251","article-title":"Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position","volume":"36","author":"Fukushima","year":"1980","journal-title":"Biol. Cybern."},{"key":"ref_35","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, Curran Associates Inc."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1533","DOI":"10.1109\/TASLP.2014.2339736","article-title":"Convolutional neural networks for speech recognition","volume":"22","author":"Mohamed","year":"2014","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Golik, P., T\u00fcske, Z., Schl\u00fcter, R., and Ney, H. (2015, January 6\u201310). Convolutional neural networks for acoustic modeling of raw time signal in LVCSR. Proceedings of the Sixteenth Annual Conference of the International Speech Communication Association, Dresden, Germany.","DOI":"10.21437\/Interspeech.2015-6"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Deng, L., Li, J., Huang, J.T., Yao, K., Yu, D., Seide, F., Seltzer, M., Zweig, G., He, X., and Williams, J. (2013, January 26\u201331). Recent advances in deep learning for speech research at Microsoft. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2013), Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6639345"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.dsp.2018.11.005","article-title":"Ensemble of jointly trained deep neural network-based acoustic models for reverberant speech recognition","volume":"85","author":"Lee","year":"2019","journal-title":"Digit. Signal Process."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zheng, C., Wang, C., and Jia, N. (2019). An ensemble model for multi-level speech emotion recognition. Appl. Sci., 10.","DOI":"10.3390\/app10010205"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Hajarolasvadi, N., and Demirel, H. (2019). 3D CNN-based speech emotion recognition using k-means clustering and spectrograms. Entropy, 21.","DOI":"10.3390\/e21050479"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Piczak, K.J. (2015, January 17\u201320). Environmental sound classification with convolutional neural networks. Proceedings of the 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), Boston, MA, USA.","DOI":"10.1109\/MLSP.2015.7324337"},{"key":"ref_43","unstructured":"Nguyen, T., and Pernkopf, F. (2018, January 19\u201320). Acoustic scene classification using a convolutional neural network ensemble and nearest neighbor filters. Proceedings of the Detection and Classification of Acoustic Scenes and Events 2018 Workshop (DCASE2018), Surrey, UK."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Ma, X., Yang, H., Chen, Q., Huang, D., and Wang, Y. (2016, January 16). DepAudioNet: An Efficient Deep Model for Audio Based Depression Classification. Proceedings of the 6th International Workshop on Audio\/Visual Emotion Challenge, AVEC \u201916, Amsterdam, The Netherlands.","DOI":"10.1145\/2988257.2988267"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/34.58871","article-title":"Neural network ensembles","volume":"12","author":"Hansen","year":"1990","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1109\/JBHI.2016.2635663","article-title":"An ensemble of fine-tuned convolutional neural networks for medical image classification","volume":"21","author":"Kumar","year":"2016","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.neucom.2016.09.117","article-title":"Ensemble application of convolutional neural networks and multiple kernel learning for multimodal sentiment analysis","volume":"261","author":"Poria","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.csl.2015.11.003","article-title":"Ensemble of deep neural networks using acoustic environment classification for statistical model-based voice activity detection","volume":"38","author":"Hwang","year":"2016","journal-title":"Comput. Speech Lang."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"e856","DOI":"10.1038\/tp.2016.123","article-title":"Voice analysis as an objective state marker in bipolar disorder","volume":"6","author":"Busk","year":"2016","journal-title":"Transl. Psychiatry"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1002\/lio2.354","article-title":"Automated assessment of psychiatric disorders using speech: A systematic review","volume":"5","author":"Low","year":"2020","journal-title":"Laryngoscope Investig. Otolaryngol."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Little, B., Alshabrawy, O., Stow, D., Ferrier, I.N., McNaney, R., Jackson, D.G., Ladha, K., Ladha, C., Ploetz, T., and Bacardit, J. (2020). Deep learning-based automated speech detection as a marker of social functioning in late-life depression. Psychol. Med., 1\u201310.","DOI":"10.1017\/S0033291719003994"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Giannakopoulos, T. (2015). pyAudioAnalysis: An Open-Source Python Library for Audio Signal Analysis. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0144610"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Degottex, G., Kane, J., Drugman, T., Raitio, T., and Scherer, S. (2014, January 4\u20139). COVAREP, A collaborative voice analysis repository for speech technologies. Proceedings of the 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy.","DOI":"10.1109\/ICASSP.2014.6853739"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Nasir, M., Jati, A., Shivakumar, P.G., Nallan Chakravarthula, S., and Georgiou, P. (2016, January 16). Multimodal and multiresolution depression detection from speech and facial landmark features. Proceedings of the 6th International Workshop on Audio\/Visual Emotion Challenge, Amsterdam, The Netherlands.","DOI":"10.1145\/2988257.2988261"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1109\/TAFFC.2015.2457417","article-title":"The Geneva minimalistic acoustic parameter set (GeMAPS) for voice research and affective computing","volume":"7","author":"Eyben","year":"2015","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_56","unstructured":"Gurney, K. (2014). An Introduction to Neural Networks, CRC Press."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Deng, L., Abdel-Hamid, O., and Yu, D. (2013, January 26\u201331). A deep convolutional neural network using heterogeneous pooling for trading acoustic invariance with phonetic confusion. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2013), Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6638952"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1177\/0049124105283119","article-title":"An introduction to ensemble methods for data analysis","volume":"34","author":"Berk","year":"2006","journal-title":"Sociol. Methods Res."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"McFee, B., Raffel, C., Liang, D., Ellis, D.P., McVicar, M., Battenberg, E., and Nieto, O. (2015, January 6\u201312). LibROSA: Audio and music signal analysis in Python. Proceedings of the 14th Python in Science Conference, Austin, TX, USA.","DOI":"10.25080\/Majora-7b98e3ed-003"},{"key":"ref_60","unstructured":"Chollet, F. (2020, June 19). Keras. Available online: https:\/\/keras.io."},{"key":"ref_61","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_62","unstructured":"Jones, E., Oliphant, T., and Peterson, P. (2020, June 19). SciPy: Open Source Scientific Tools for Python. Available online: https:\/\/www.scipy.org."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/MCSE.2007.55","article-title":"Matplotlib: A 2D graphics environment","volume":"9","author":"Hunter","year":"2007","journal-title":"Comput. Sci. Eng."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/6\/688\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:41:07Z","timestamp":1760175667000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/6\/688"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,20]]},"references-count":63,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["e22060688"],"URL":"https:\/\/doi.org\/10.3390\/e22060688","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,20]]}}}