{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T11:50:25Z","timestamp":1783079425726,"version":"3.54.6"},"reference-count":60,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2019,12,7]],"date-time":"2019-12-07T00:00:00Z","timestamp":1575676800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Portuguese Foundation for Science and Technology","award":["LA 9 - UID\/EEA\/50009\/2019"],"award-info":[{"award-number":["LA 9 - UID\/EEA\/50009\/2019"]}]},{"name":"ARDITI \u2013 Ag\u00eancia Regional para o Desenvolvimento da Investiga\u00e7\u00e3o, Tecnologia e Inova\u00e7\u00e3o","award":["M1420-09-5369-FSE-000001 - PhD Studentship"],"award-info":[{"award-number":["M1420-09-5369-FSE-000001 - PhD Studentship"]}]},{"name":"MITIExcell - EXCELENCIA INTERNACIONAL DE IDT&amp;I NAS TIC","award":["M1420-01-01450FEDER0000002"],"award-info":[{"award-number":["M1420-01-01450FEDER0000002"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Quality of sleep can be assessed by analyzing the cyclic alternating pattern, a long-lasting periodic activity that is composed of two alternate electroencephalogram patterns, which is considered to be a marker of sleep instability. Experts usually score this pattern through a visual examination of each one-second epoch of an electroencephalogram signal, a repetitive and time-consuming task that is prone to errors. To address these issues, a home monitoring device was developed for automatic scoring of the cyclic alternating pattern by analyzing the signal from one electroencephalogram derivation. Three classifiers, specifically, two recurrent networks (long short-term memory and gated recurrent unit) and one one-dimension convolutional neural network, were developed and tested to determine which was more suitable for the cyclic alternating pattern phase\u2019s classification. It was verified that the network based on the long short-term memory attained the best results with an average accuracy, sensitivity, specificity and area under the receiver operating characteristic curve of, respectively, 76%, 75%, 77% and 0.752. The classified epochs were then fed to a finite state machine to determine the cyclic alternating pattern cycles and the performance metrics were 76%, 71%, 84% and 0.778, respectively. The performance achieved is in the higher bound of the experts\u2019 expected agreement range and considerably higher than the inter-scorer agreement of multiple experts, implying the usability of the device developed for clinical analysis.<\/jats:p>","DOI":"10.3390\/e21121203","type":"journal-article","created":{"date-parts":[[2019,12,9]],"date-time":"2019-12-09T05:54:51Z","timestamp":1575870891000},"page":"1203","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["A Portable Wireless Device for Cyclic Alternating Pattern Estimation from an EEG Monopolar Derivation"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5107-3248","authenticated-orcid":false,"given":"F\u00e1bio","family":"Mendon\u00e7a","sequence":"first","affiliation":[{"name":"Instituto Superior T\u00e9cnico, University of Lisbon, 1049-001 Lisbon, Portugal"},{"name":"Madeira Interactive Technologies Institute (ITI\/Larsys\/M-ITI), 9020-105 Funchal, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7677-0971","authenticated-orcid":false,"given":"Sheikh Shanawaz","family":"Mostafa","sequence":"additional","affiliation":[{"name":"Instituto Superior T\u00e9cnico, University of Lisbon, 1049-001 Lisbon, Portugal"},{"name":"Madeira Interactive Technologies Institute (ITI\/Larsys\/M-ITI), 9020-105 Funchal, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7334-3993","authenticated-orcid":false,"given":"Fernando","family":"Morgado-Dias","sequence":"additional","affiliation":[{"name":"Madeira Interactive Technologies Institute (ITI\/Larsys\/M-ITI), 9020-105 Funchal, Portugal"},{"name":"Faculty of Exact Sciences and Engineering, University of Madeira, 9000-082 Funchal, Portugal"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8512-965X","authenticated-orcid":false,"given":"Antonio G.","family":"Ravelo-Garc\u00eda","sequence":"additional","affiliation":[{"name":"Institute for Technological Development and Innovation in Communications, Universidad de Las Palmas de Gran Canaria, 35001 Las Palmas de Gran Canaria, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,12,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.smrv.2011.05.006","article-title":"Forerunners of REM sleep","volume":"16","author":"Schulz","year":"2012","journal-title":"Sleep Med. Rev."},{"key":"ref_2","unstructured":"Berry, R., Brooks, R., Gamaldo, C., Harding, S., Lloyd, R., Marcus, C., and Vaughn, B. (2017). The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications, American Academy of Sleep Medicine."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.smrv.2018.02.004","article-title":"Devices for home detection of obstructive sleep apnea: A review","volume":"41","author":"Mostafa","year":"2018","journal-title":"Sleep Med. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1097\/00004691-199607000-00003","article-title":"The Future of Computer-Assisted Investigation of the Polysomnogram: Sleep Microstructure","volume":"13","author":"Kubicki","year":"1996","journal-title":"J. Clin. Neurophysiol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1016\/S1389-9457(01)00149-6","article-title":"Atlas, rules, and recording techniques for the scoring of cyclic alternating pattern (CAP) in human sleep","volume":"2","author":"Terzano","year":"2001","journal-title":"Sleep Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/S1567-4231(09)70033-4","article-title":"Chapter 8 The cyclic alternating pattern (CAP) in human sleep","volume":"6","author":"Terzano","year":"2005","journal-title":"Handb. Clin. Neurophysiol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2305","DOI":"10.1016\/j.clinph.2007.07.001","article-title":"Cyclic alternating pattern sequences and non-cyclic alternating pattern periods in human sleep","volume":"118","author":"Smerieri","year":"2007","journal-title":"Clin. Neurophysiol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1815","DOI":"10.1016\/j.clinph.2013.04.005","article-title":"EEG segmentation for improving automatic CAP detection","volume":"124","author":"Mariani","year":"2013","journal-title":"Clin. Neurophysiol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1695","DOI":"10.1109\/TNSRE.2019.2934828","article-title":"Automatic A-Phase Detection of Cyclic Alternating Patterns in Sleep Using Dynamic Temporal Information","volume":"27","author":"Hartmann","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hartmann, S., and Baumert, M. (2019, January 23\u201327). Improved A-phase Detection of Cyclic Alternating Pattern Using Deep Learning. Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany.","DOI":"10.1109\/EMBC.2019.8857006"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"24527","DOI":"10.1109\/ACCESS.2019.2900345","article-title":"A Review of Approaches for Sleep Quality Analysis","volume":"7","author":"Mostafa","year":"2019","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.smrv.2011.02.003","article-title":"Cyclic alternating pattern (CAP): The marker of sleep instability","volume":"16","author":"Parrino","year":"2012","journal-title":"Sleep Med. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Niknazar, H., Seifpour, S., Mikaili, M., Nasrabadi, A., and Banaraki, A. (2015, January 10\u201314). A Novel Method to Detect the A Phases of Cyclic Alternating Pattern (CAP) Using Similarity Index. Proceedings of the 2015 23rd Iranian Conference on Electrical Engineering, Tehran, Iran.","DOI":"10.1109\/IranianCEE.2015.7146184"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1590\/S0004-282X2006000400008","article-title":"Visual and automatic cyclic alternating pattern (CAP) scoring: Inter-rater reliability study","volume":"64","author":"Rosa","year":"2006","journal-title":"Arq. Neuro-Psiquiatr."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e8059","DOI":"10.1590\/1414-431x20188059","article-title":"Visual and automatic classification of the cyclic alternating pattern in electroencephalography during sleep","volume":"52","author":"Largo","year":"2019","journal-title":"Braz. J. Med Biol. Res."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mendon\u00e7a, F., Fred, A., Mostafa, S., Morgado-Dias, F., and Ravelo-Garc\u00eda, A. (2018). Automatic detection of cyclic alternating pattern. Neural Comput. Appl., 1\u201311.","DOI":"10.1007\/s00521-018-3474-5"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Karimzadeh, F., Seraj, E., Boostani, R., and Torabi-Nami, M. (2015, January 9\u201311). Presenting Efficient Features for Automatic CAP Detection in Sleep EEG Signals. Proceedings of the 38th International Conference on Telecommunications and Signal Processing, Prague, Czech Republic.","DOI":"10.1109\/TSP.2015.7296302"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1016\/j.sleep.2004.07.012","article-title":"A general automatic method for the analysis of NREM sleep microstructure","volume":"5","author":"Barcaro","year":"2004","journal-title":"Sleep Med."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1826","DOI":"10.1016\/S1388-2457(02)00284-5","article-title":"An automatic method for the recognition and classification of the A-phases of the cyclic alternating pattern","volume":"113","author":"Navona","year":"2002","journal-title":"Clin. Neurophysiol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2016","DOI":"10.1016\/j.clinph.2011.02.031","article-title":"Characterization of A phases during the Cyclic Alternating Pattern of sleep","volume":"122","author":"Mariani","year":"2011","journal-title":"Clin. Neurophysiol."},{"key":"ref_21","unstructured":"Largo, R., Munteanu, C., and Rosa, A. (2005, January 1\u20133). CAP Event Detection by Wavelets and GA Tuning. Proceedings of the IEEE International Workshop on Intelligent Signal Processing, Faro, Portugal."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1016\/j.clinph.2004.09.021","article-title":"Inter-rater reliability of sleep cyclic alternating pattern (CAP) scoring and validation of a new computer-assisted CAP scoring method","volume":"116","author":"Ferri","year":"2005","journal-title":"Clin. Neurophysiol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Mariani, S., Bianchi, A., Manfredini, E., Rosso, V., Mendez, M., Parrino, L., Matteucci, M., Grassi, A., Cerutti, S., and Terzano, M. (September, January 31). Automatic detection of A phases of the Cyclic Alternating Pattern during sleep. Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, Buenos Aires, Argentina.","DOI":"10.1109\/IEMBS.2010.5626211"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Machado, F., Sales, F., Bento, C., Dourado, A., and Teixeira, C. (2015, January 25\u201329). Automatic identification of Cyclic Alternating Pattern (CAP) sequences based on the Teager Energy Operator. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy.","DOI":"10.1109\/EMBC.2015.7319617"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Mendez, M., Alba, A., Chouvarda, I., Milioli, G., Grassi, A., Terzano, M., and Parrino, L. (2014, January 26\u201330). On separability of A-phases during the cyclic alternating pattern. Proceedings of the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA.","DOI":"10.1109\/EMBC.2014.6944068"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Machado, F., Teixeira, C., Santos, C., Bento, C., Sales, F., and Dourado, A. (2016, January 16\u201320). A-phases subtype detection using different classification methods. Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA.","DOI":"10.1109\/EMBC.2016.7590877"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Mostafa, S., Mendon\u00e7a, F., Ravelo-Garc\u00eda, A., and Morgado-Dias, F. (2018, January 4\u20136). Combination of Deep and Shallow Networks for Cyclic Alternating Patterns Detection. Proceedings of the 2018 13th APCA International Conference on Automatic Control and Soft Computing (CONTROLO), Ponta Delgada, Portugal.","DOI":"10.1109\/CONTROLO.2018.8516418"},{"key":"ref_28","first-page":"877","article-title":"Consumer Sleep Technology: An American Academy of Sleep Medicine Position Statement","volume":"14","author":"Khosla","year":"2018","journal-title":"J. Clin. Med."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.biopsycho.2016.11.010","article-title":"When a gold standard isn\u2019t so golden: Lack of prediction of subjective sleep quality from sleep polysomnography","volume":"123","author":"Kaplan","year":"2017","journal-title":"Biol. Psychol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"S10","DOI":"10.1016\/S1389-9457(08)70011-X","article-title":"Measuring sleep quality","volume":"9","author":"Krystal","year":"2008","journal-title":"Sleep Med."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"S39","DOI":"10.1016\/S1388-2457(00)00400-4","article-title":"Cyclic alternating pattern (CAP) and epilepsy during sleep: How a physiological rhythm modulates a pathological event","volume":"111","author":"Parrino","year":"2000","journal-title":"Clin. Neurophysiol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1088\/0031-9155\/49\/6\/007","article-title":"A novel featureless approach to mass detection in digital mammograms based on support vector machines","volume":"49","author":"Campanini","year":"2004","journal-title":"Phys. Med. Biol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2354","DOI":"10.1109\/JBHI.2018.2886064","article-title":"Automated Sleep Apnea Detection in Raw Respiratory Signals using Long Short-Term Memory Neural Networks","volume":"23","author":"Steenkiste","year":"2018","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Nagi, J., Ducatelle, F., Caro, G., Cire\u015fan, D., Meier, U., Giusti, A., Nagi, F., Schmidhuber, J., and Gambardella, L. (2011, January 16\u201318). Max-pooling convolutional neural networks for vision-based hand gesture recognition. Proceedings of the 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICSIPA.2011.6144164"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1097\/00004691-199603000-00005","article-title":"Polysomnographic analysis of arousal responses in obstructive sleep apnea syndrome by means of the cyclic alternating pattern","volume":"13","author":"Terzano","year":"1996","journal-title":"J. Clin. Neurophysiol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1161\/01.CIR.101.23.e215","article-title":"PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research","volume":"101","author":"Goldberger","year":"2000","journal-title":"Circulation"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Bronzino, J. (2006). The biomedical Engineering Handbook, CRC Press.","DOI":"10.1201\/9781420003857"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1002\/acs.1147","article-title":"Automated sleep\u2013wake staging combining robust feature extraction, artificial neural network classification, and flexible decision rules","volume":"24","author":"Chapotot","year":"2010","journal-title":"Int. J. Adapt. Control Signal Process."},{"key":"ref_39","unstructured":"(1979). Digital Signal Processing Committee of the IEEE\u00ae Acoustics, Speech, and Signal Processing Society. Programs for Digital Signal Processing, IEEE Press."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1093\/sleep\/33.6.793","article-title":"Acute dopamine-agonist treatment in restless legs syndrome: Effects on sleep architecture and NREM sleep instability","volume":"33","author":"Ferri","year":"2010","journal-title":"Sleep"},{"key":"ref_41","unstructured":"Phillips, C., Parr, J., and Riskin, E. (2013). Signals, Systems, and Transforms, Pearson."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1088\/1741-2552\/ab0ab5","article-title":"Deep learning for electroencephalogram (EEG) classification tasks: A review","volume":"16","author":"Craik","year":"2019","journal-title":"J. Neural Eng."},{"key":"ref_44","unstructured":"Bishop, C. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Li, J., Xu, S., and Xu, B. (2016, January 17\u201320). Investigating Gated Recurrent Neural Networks for Acoustic Modeling. Proceedings of the 2016 10th International Symposium on Chinese Spoken Language Processing (ISCSLP), Tianjin, China.","DOI":"10.1109\/ISCSLP.2016.7918370"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Cho, K., Merrienboer, B., Gulcehre, C., Bahdanau, Z., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 26\u201328). Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1179"},{"key":"ref_47","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_48","unstructured":"Klambauer, G., Unterthiner, T., and Mayr, A. (2017, January 4\u20139). Self-Normalizing Neural Networks. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_49","unstructured":"Sackett, D., Haynes, R., Guyatt, G., and Tugwell, P. (1991). Clinical Epidemiology: A Basic Science for Clinical Medicine, Lippincott Williams and Wilkins. [2nd ed.]."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1129","DOI":"10.1016\/S0895-4356(03)00177-X","article-title":"The diagnostic odds ratio: A single indicator of test performance","volume":"56","author":"Glas","year":"2003","journal-title":"J. Clin. Epidemiol."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An introduction to ROC analysis","volume":"27","author":"Fawcett","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"4125","DOI":"10.21037\/jtd.2017.09.14","article-title":"Using the confidence interval confidently","volume":"9","author":"Hazra","year":"2017","journal-title":"J. Thorac. Dis."},{"key":"ref_53","first-page":"34","article-title":"On comparison of feature selection algorithms","volume":"WS-07-05","author":"Refaeilzadeh","year":"2007","journal-title":"AAAI Workshop-Tech. Rep."},{"key":"ref_54","unstructured":"Kaifeng, L., Shunhua, J., and Jian, L. (2017, January 6\u201311). Learning Gradient Descent: Better Generalization and Longer Horizons. Proceedings of the 34 th International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_55","first-page":"2121","article-title":"Adaptive Subgradient Methods for Online Learning and Stochastic Optimization","volume":"12","author":"Duchi","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_56","unstructured":"Kingma, D., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv, Available online: https:\/\/arxiv.org\/abs\/1412.6980."},{"key":"ref_57","unstructured":"Silva, H., Guerreiro, J., Louren\u00e7o, A., Fred, A., and Martins, R. (2014, January 1). BITalino: A Novel Hardware Framework for Physiological Computing. Proceedings of the International Conference on Physiological Computing Systems (PhyCS), Lisbon, Portugal."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1049\/htl.2018.5037","article-title":"Benchmarking of the BITalino Biomedical Toolkit Against an Established Gold Standard","volume":"6","author":"Batista","year":"2019","journal-title":"Healthc. Technol. Lett."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"2233","DOI":"10.1109\/TNSRE.2018.2881361","article-title":"Sleep quality estimation by cardiopulmonary coupling analysis","volume":"26","author":"Mostafa","year":"2018","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_60","unstructured":"IEC (2019). IEC 80601-2-26: Medical electrical equipment, IEC. [1st ed.]."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/12\/1203\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:40:17Z","timestamp":1760190017000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/12\/1203"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,7]]},"references-count":60,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["e21121203"],"URL":"https:\/\/doi.org\/10.3390\/e21121203","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,7]]}}}