{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:05:52Z","timestamp":1760234752182,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2021,6,11]],"date-time":"2021-06-11T00:00:00Z","timestamp":1623369600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Data reusability is an important feature of current research, just in every field of science. Modern research in Affective Computing, often rely on datasets containing experiments-originated data such as biosignals, video clips, or images. Moreover, conducting experiments with a vast number of participants to build datasets for Affective Computing research is time-consuming and expensive. Therefore, it is extremely important to provide solutions allowing one to (re)use data from a variety of sources, which usually demands data integration. This paper presents the Graph Representation Integrating Signals for Emotion Recognition and Analysis (GRISERA) framework, which provides a persistent model for storing integrated signals and methods for its creation. To the best of our knowledge, this is the first approach in Affective Computing field that addresses the problem of integrating data from multiple experiments, storing it in a consistent way, and providing query patterns for data retrieval. The proposed framework is based on the standardized graph model, which is known to be highly suitable for signal processing purposes. The validation proved that data from the well-known AMIGOS dataset can be stored in the GRISERA framework and later retrieved for training deep learning models. Furthermore, the second case study proved that it is possible to integrate signals from multiple sources (AMIGOS, ASCERTAIN, and DEAP) into GRISERA and retrieve them for further statistical analysis.<\/jats:p>","DOI":"10.3390\/s21124035","type":"journal-article","created":{"date-parts":[[2021,6,14]],"date-time":"2021-06-14T22:25:46Z","timestamp":1623709546000},"page":"4035","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Graph Representation Integrating Signals for Emotion Recognition and Analysis"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0544-5573","authenticated-orcid":false,"given":"Teresa","family":"Zawadzka","sequence":"first","affiliation":[{"name":"Faculty of Electronics, Telecommunications and Informatics, Gda\u0144sk University of Technology, 80-233 Gda\u0144sk, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5191-0261","authenticated-orcid":false,"given":"Tomasz","family":"Wierci\u0144ski","sequence":"additional","affiliation":[{"name":"Faculty of Electronics, Telecommunications and Informatics, Gda\u0144sk University of Technology, 80-233 Gda\u0144sk, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3626-6962","authenticated-orcid":false,"given":"Grzegorz","family":"Meller","sequence":"additional","affiliation":[{"name":"Faculty of Electronics, Telecommunications and Informatics, Gda\u0144sk University of Technology, 80-233 Gda\u0144sk, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2387-1234","authenticated-orcid":false,"given":"Mateusz","family":"Rock","sequence":"additional","affiliation":[{"name":"Faculty of Electronics, Telecommunications and Informatics, Gda\u0144sk University of Technology, 80-233 Gda\u0144sk, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6019-1601","authenticated-orcid":false,"given":"Robert","family":"Zwierzycki","sequence":"additional","affiliation":[{"name":"Faculty of Electronics, Telecommunications and Informatics, Gda\u0144sk University of Technology, 80-233 Gda\u0144sk, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1117-903X","authenticated-orcid":false,"given":"Micha\u0142 R.","family":"Wr\u00f3bel","sequence":"additional","affiliation":[{"name":"Faculty of Electronics, Telecommunications and Informatics, Gda\u0144sk University of Technology, 80-233 Gda\u0144sk, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,11]]},"reference":[{"key":"ref_1","unstructured":"Picard, R.W. (2000). Affective Computing, The MIT Press."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.inffus.2017.02.003","article-title":"A review of affective computing: From unimodal analysis to multimodal fusion","volume":"37","author":"Poria","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1109\/MSP.2012.2235192","article-title":"The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains","volume":"30","author":"Shuman","year":"2013","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1109\/MSP.2014.2329213","article-title":"Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure","volume":"31","author":"Sandryhaila","year":"2014","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Thanos, C. (2017). Research Data Reusability: Conceptual Foundations, Barriers and Enabling Technologies. Publications, 5.","DOI":"10.3390\/publications5010002"},{"key":"ref_6","unstructured":"National Research Council (1997). Bits of Power: Issues in Global Access to Scientific Data, National Academies Press."},{"key":"ref_7","unstructured":"National Research Council (2000). A Question of Balance: Private Rights and the Public Interest in Scientific and Technical Databases, National Academies Press."},{"key":"ref_8","unstructured":"Simberloff, D., Barish, B., Droegemeier, K., Etter, D., Fedoroff, N., Ford, K., Lanzerotti, L., Leshner, A., Lubchenco, J., and Rossmann, M. (2005). Long-Lived Digital Data Collections: Enabling Research and Education in the 21st Century, National Academies Press. Technical Report."},{"key":"ref_9","unstructured":"Lim, K.T., Maier, S.D., Ratzesberger, O., and Zdonik, S. (2009, January 13\u201316). Requirements for science data bases and SciDB. Proceedings of the Conference on Innovative Data Systems Research, Asilomar, CA, USA."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/meet.14504901199","article-title":"Identifying content and levels of representation in scientific data","volume":"49","author":"Wickett","year":"2012","journal-title":"Proc. Am. Soc. Inf. Sci. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Pokorny, J. (2016). Conceptual and Database Modelling of Graph Databases, In Proceedings of the 20th International Database Engineering Applications Symposium.","DOI":"10.1145\/2938503.2938547"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Francis, N., Taylor, A., Green, A., Guagliardo, P., Libkin, L., Lindaaker, T., Marsault, V., Plantikow, S., Rydberg, M., and Selmer, P. (2018). Cypher: An Evolving Query Language for Property Graphs, In Proceedings of the 2018 International Conference on Management of Data.","DOI":"10.1145\/3183713.3190657"},{"key":"ref_13","unstructured":"Correa, J.A.M., Abadi, M.K., Sebe, N., and Patras, I. (2018). AMIGOS: A Dataset for Affect, Personality and Mood Research on Individuals and Groups. IEEE Trans. Affect. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1109\/TAFFC.2016.2625250","article-title":"ASCERTAIN: Emotion and Personality Recognition Using Commercial Sensors","volume":"9","author":"Subramanian","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/T-AFFC.2011.15","article-title":"Deap: A database for emotion analysis; using physiological signals","volume":"3","author":"Koelstra","year":"2011","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/T-AFFC.2011.25","article-title":"A multimodal database for affect recognition and implicit tagging","volume":"3","author":"Soleymani","year":"2011","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/JBHI.2017.2688239","article-title":"DREAMER: A database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices","volume":"22","author":"Katsigiannis","year":"2017","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1109\/TAFFC.2017.2768030","article-title":"Emotion recognition based on high-resolution EEG recordings and reconstructed brain sources","volume":"11","author":"Becker","year":"2017","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"12177","DOI":"10.1109\/ACCESS.2019.2891579","article-title":"MPED: A multi-modal physiological emotion database for discrete emotion recognition","volume":"7","author":"Song","year":"2019","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"8303465","DOI":"10.1155\/2020\/8303465","article-title":"An EEG Database and Its Initial Benchmark Emotion Classification Performance","volume":"2020","author":"Seal","year":"2020","journal-title":"Comput. Math. Methods Med."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Shu, L., Xie, J., Yang, M., Li, Z., Li, Z., Liao, D., Xu, X., and Yang, X. (2018). A review of emotion recognition using physiological signals. Sensors, 18.","DOI":"10.3390\/s18072074"},{"key":"ref_22","unstructured":"Siddharth, S., Jung, T.P., and Sejnowski, T.J. (2019). Utilizing deep learning towards multi-modal bio-sensing and vision-based affective computing. IEEE Trans. Affect. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"035008","DOI":"10.1088\/1361-6579\/ab7cb5","article-title":"A practical approach to storage and retrieval of high-frequency physiological signals","volume":"41","author":"Goodwin","year":"2020","journal-title":"Physiol. Meas."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Song, C., Qin, X.H., Zhou, Q., Wang, Z.Y., Liu, W.H., Li, J., Huang, L., Chen, Y., Tang, G., and Zhao, D.J. (2018). PlantES: A plant electrophysiological multi-source data online analysis and sharing platform. Appl. Sci., 8.","DOI":"10.3390\/app8112269"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e1206","DOI":"10.1002\/widm.1206","article-title":"An overview of online based platforms for sharing and analyzing electrophysiology data from big data perspective","volume":"7","author":"Chen","year":"2017","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_26","first-page":"776","article-title":"Management framework for biosignals in biomedical studies: From study design to data statistics","volume":"65","author":"Kampusch","year":"2015","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1016\/j.cmpb.2011.02.008","article-title":"Searching biosignal databases by content and context: Research Oriented Integration System for ECG Signals (ROISES)","volume":"108","author":"Kokkinaki","year":"2012","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_28","unstructured":"Carreiras, C., Silva, H., Louren\u00e7o, A., and Fred, A. (2013, January 7\u20139). Storagebit-a metadata-aware, extensible, semantic and hierarchical database for biosignals. Proceedings of the International Conference on Health Informatics, Vilamoura, Portugal."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"112790","DOI":"10.1016\/j.eswa.2019.07.007","article-title":"Sleep EEG signal analysis based on correlation graph similarity coupled with an ensemble extreme machine learning algorithm","volume":"138","author":"Abdulla","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"868","DOI":"10.1109\/JPROC.2018.2798928","article-title":"A graph signal processing perspective on functional brain imaging","volume":"106","author":"Huang","year":"2018","journal-title":"Proc. IEEE"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1109\/MSP.2012.2233865","article-title":"Machine learning with brain graphs: Predictive modeling approaches for functional imaging in systems neuroscience","volume":"30","author":"Richiardi","year":"2013","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"031005","DOI":"10.1088\/1741-2552\/aab2f2","article-title":"A review of classification algorithms for EEG-based brain\u2013computer interfaces: A 10 year update","volume":"15","author":"Lotte","year":"2018","journal-title":"J. Neural Eng."},{"key":"ref_33","unstructured":"Angles, R., Arenas, M., Barcel\u00f3, P., Hogan, A., Reutter, J.L., and Vrgoc, D. (2016). Foundations of Modern Graph Query Languages. arXiv."},{"key":"ref_34","unstructured":"Angles, R. (2018, January 21\u201325). The Property Graph Database Model. Proceedings of the 12th Alberto Mendelzon International Workshop on Foundations of Data Management, Cali, Colombia."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ramesh, D., Sinha, A., and Singh, S. (,  2016). Data modelling for discrete time series data using Cassandra and MongoDB. Proceedings of the 2016 3rd International Conference on Recent Advances in Information Technology (RAIT), Dhanbad, India.","DOI":"10.1109\/RAIT.2016.7507966"},{"key":"ref_36","unstructured":"Damyanov, D. (2021, May 25). Building a Model for Event Data as a Graph. Available online: https:\/\/snowplowanalytics.com\/blog\/2018\/03\/26\/building-a-model-for-atomic-event-data-as-a-graph\/."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Brodny, G., Kolakowska, A., Landowska, A., Szwoch, M., Szwoch, W., and Wrobel, M.R. (2016, January 6\u20138). Comparison of selected off-the-shelf solutions for emotion recognition based on facial expressions. Proceedings of the 2016 9th IEEE International Conference on Human System Interactions (HSI), Portsmouth, UK.","DOI":"10.1109\/HSI.2016.7529664"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","article-title":"A circumplex model of affect","volume":"39","author":"Russell","year":"1980","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1016\/j.neuroimage.2013.04.087","article-title":"Graph analysis of the human connectome: Promise, progress, and pitfalls","volume":"80","author":"Fornito","year":"2013","journal-title":"Neuroimage"},{"key":"ref_40","unstructured":"Dictionary, M.W. (2021, May 25). Merriam-Webster. Available online: www.merriam-webster.com."},{"key":"ref_41","first-page":"13","article-title":"A brief introduction and review on galvanic skin response","volume":"2","author":"Sharma","year":"2016","journal-title":"Int. J. Med. Res. Prof."},{"key":"ref_42","unstructured":"Gamboa, H. (2008). Multi-Modal Behavioral Biometrics Based on HCI and Electrophysiology. [Ph.D. Thesis, Universidade Teecnica de Lisboa]."},{"key":"ref_43","unstructured":"Louren\u00e7o, A., Silva, H., Leite, P., Louren\u00e7o, R., and Fred, A. (2012, January 1\u20134). Real Time Electrocardiogram Segmentation for Finger based ECG Biometrics. Proceedings of the International Conference on Bio-inspired Systems and Signal Processing\u2014BIOSIGNALS, Vilamoura, Portugal."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1109\/PROC.1982.12433","article-title":"Spectrum estimation and harmonic analysis","volume":"70","author":"Thomson","year":"1982","journal-title":"Proc. IEEE"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1371","DOI":"10.1002\/j.1538-7305.1978.tb02104.x","article-title":"Prolate Spheroidal Wave Functions, Fourier Analysis, and Uncertainty-V: The Discrete Case","volume":"57","author":"Slepian","year":"1978","journal-title":"Bell Syst. Tech. J."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1080\/00401706.1996.10484520","article-title":"Spectral Analysis for Physical Applications: Multitaper and Conventional Univariate Techniques","volume":"38","author":"Cox","year":"1996","journal-title":"Technometrics"},{"key":"ref_47","unstructured":"Webber, J. (2021, May 25). Neo4j for Very Large Scale Systems. Available online: https:\/\/www.youtube.com\/watch?v=BfPDZf2wmqg."},{"key":"ref_48","first-page":"57","article-title":"Using deep convolutional neural network for emotion detection on a physiological signals dataset (AMIGOS)","volume":"7","author":"Abdulhay","year":"2018","journal-title":"IEEE Access"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/12\/4035\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:13:20Z","timestamp":1760163200000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/12\/4035"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,11]]},"references-count":48,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["s21124035"],"URL":"https:\/\/doi.org\/10.3390\/s21124035","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,6,11]]}}}