{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T06:44:55Z","timestamp":1777099495223,"version":"3.51.4"},"reference-count":56,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2019,8,5]],"date-time":"2019-08-05T00:00:00Z","timestamp":1564963200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003176","name":"Ministerio de Educaci\u00f3n, Cultura y Deporte","doi-asserted-by":"publisher","award":["FPU16\/04376"],"award-info":[{"award-number":["FPU16\/04376"]}],"id":[{"id":"10.13039\/501100003176","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The identification of daily life events that trigger significant changes on our affective state has become a fundamental task in emotional research. To achieve it, the affective states must be assessed in real-time, along with situational information that could contextualize the affective data acquired. However, the objective monitoring of the affective states and the context is still in an early stage. Mobile technologies can help to achieve this task providing immediate and objective data of the users\u2019 context and facilitating the assessment of their affective states. Previous works have developed mobile apps for monitoring affective states and context, but they use a fixed methodology which does not allow for making changes based on the progress of the study. This work presents a multimodal platform which leverages the potential of the smartphone sensors and the Experience Sampling Methods (ESM) to provide a continuous monitoring of the affective states and the context in an ubiquitous way. The platform integrates several elements aimed to expedite the real-time management of the ESM questionnaires. In order to show the potential of the platform, and evaluate its usability and its suitability for real-time assessment of affective states, a pilot study has been conducted. The results demonstrate an excellent usability level and a good acceptance from the users and the specialists that conducted the study, and lead to some suggestions for improving the data quality of mobile context-aware ESM-based systems.<\/jats:p>","DOI":"10.3390\/s19153430","type":"journal-article","created":{"date-parts":[[2019,8,5]],"date-time":"2019-08-05T11:17:47Z","timestamp":1565003867000},"page":"3430","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Smartphone-Based Platform for Affect Monitoring through Flexibly Managed Experience Sampling Methods"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5049-334X","authenticated-orcid":false,"given":"Carlos","family":"Bailon","sequence":"first","affiliation":[{"name":"Department of Computer Architecture and Technology, CITIC-UGR Research Center, University of Granada, E18071 Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2599-8076","authenticated-orcid":false,"given":"Miguel","family":"Damas","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture and Technology, CITIC-UGR Research Center, University of Granada, E18071 Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8528-828X","authenticated-orcid":false,"given":"Hector","family":"Pomares","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture and Technology, CITIC-UGR Research Center, University of Granada, E18071 Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4164-7607","authenticated-orcid":false,"given":"Daniel","family":"Sanabria","sequence":"additional","affiliation":[{"name":"Mind, Brain &amp; Behavior Research Center, University of Granada, E18071 Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9130-3247","authenticated-orcid":false,"given":"Pandelis","family":"Perakakis","sequence":"additional","affiliation":[{"name":"Mind, Brain &amp; Behavior Research Center, University of Granada, E18071 Granada, Spain"},{"name":"Department of Psychology, Loyola University Andalusia, E41014 Seville, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carmen","family":"Goicoechea","sequence":"additional","affiliation":[{"name":"Mind, Brain &amp; Behavior Research Center, University of Granada, E18071 Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5434-4253","authenticated-orcid":false,"given":"Oresti","family":"Banos","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture and Technology, CITIC-UGR Research Center, University of Granada, E18071 Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Tenenbaum, G., Eklund, R.C., and Kamata, A. (2012). Affect, Mood, and Emotion. Measurement in Sport and Exercise Psychology, Human Kinetics.","DOI":"10.5040\/9781492596332"},{"key":"ref_2","unstructured":"Ekman, P., and Davidson, R. (1994). On emotion, mood, and related affective construct. The Nature of Emotion: Fundamental Questions, Oxford University Press."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.jad.2018.09.061","article-title":"Affective models of depression and anxiety: Extension to within-person processes in daily life","volume":"243","year":"2019","journal-title":"J. Affect. Disord."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1016\/j.jad.2018.09.034","article-title":"Nonlinear dynamics of mood regulation in unaffected first-degree relatives of bipolar disorder patients","volume":"243","author":"Ortiz","year":"2019","journal-title":"J. Affect. Disord."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1111\/j.2044-8295.1996.tb02615.x","article-title":"Emotions are social","volume":"87","author":"Parkinson","year":"1996","journal-title":"Br. J. Psychol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.psychsport.2018.01.001","article-title":"Emotion profiles and their motivational antecedents among adolescent athletes in intensive training settings","volume":"35","author":"Martinent","year":"2018","journal-title":"Psychol. Sport Exerc."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.procs.2017.06.085","article-title":"Toward a Computational Model of Mood","volume":"110","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"183","DOI":"10.4088\/PCC.v09n0303","article-title":"Dynamic Patterns in Mood Among Newly Diagnosed Patients With Major Depressive Episode or Panic Disorder and Normal Controls","volume":"9","author":"Katerndahl","year":"2007","journal-title":"Primary Care Companion J. Clin. Psychiatry"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1123\/jsep.32.2.253","article-title":"Be Active and Become Happy: An Ecological Momentary Assessment of Physical Activity and Mood","volume":"32","author":"Kanning","year":"2010","journal-title":"J. Sport Exerc. Psychol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2359","DOI":"10.3390\/s100302359","article-title":"Ambient Intelligence Systems for Personalized Sport Training","volume":"10","year":"2010","journal-title":"Sensors"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1007\/s00779-014-0829-5","article-title":"Mobile phones as medical devices in mental disorder treatment: An overview","volume":"19","author":"Gravenhorst","year":"2015","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Csikszentmihalyi, M., and Larson, R. (2014). Validity and Reliability of the Experience-Sampling Method. Flow and the Foundations of Positive Psychology, Springer.","DOI":"10.1007\/978-94-017-9088-8_3"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3123988","article-title":"The Experience Sampling Method on Mobile Devices","volume":"50","author":"Berkel","year":"2018","journal-title":"ACM Comput. Surv."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bailon, C., Damas, M., Pomares, H., Sanabria, D., Perakakis, P., Goicoechea, C., and Banos, O. (2018). Intelligent Monitoring of Affective Factors Underlying Sport Performance by Means of Wearable and Mobile Technology. Proceedings, 2.","DOI":"10.3390\/proceedings2191202"},{"key":"ref_15","unstructured":"Google (2019, May 23). Consumer Barometer Study 2017\u2014The Year of the Mobile Majority. Available online: https:\/\/www.thinkwithgoogle.com\/intl\/en-gb\/advertising-channels\/mobile\/consumer-barometer-study-2017-year-mobile-majority\/."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e11215","DOI":"10.2196\/11215","article-title":"Methodological Strategies for Ecological Momentary Assessment to Evaluate Mood and Stress in Adult Patients Using Mobile Phones: Systematic Review","volume":"7","author":"Yang","year":"2019","journal-title":"JMIR Mhealth Uhealth"},{"key":"ref_17","unstructured":"Google (2019, May 22). Google Trends. Available online: www.google.com\/trends."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1037\/a0017813","article-title":"Psychometric properties of a computerized mobile phone method for assessing mood in daily life","volume":"10","author":"Courvoisier","year":"2010","journal-title":"Emotion"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1146\/annurev.psych.54.101601.145030","article-title":"Diary Methods: Capturing Life as it is Lived","volume":"54","author":"Bolger","year":"2003","journal-title":"Annu. Rev. Psychol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"e49","DOI":"10.2196\/mental.6202","article-title":"Development of a Mobile Phone App to Support Self-Monitoring of Emotional Well-Being: A Mental Health Digital Innovation","volume":"3","author":"Rickard","year":"2016","journal-title":"JMIR Ment. Health"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"LiKamWa, R., Liu, Y., Lane, N.D., and Zhong, L. (2013, January 25\u201328). MoodScope: Building a Mood Sensor from Smartphone Usage Patterns. Proceedings of the 11th Annual International Conference on Mobile Systems, Applications, and Services, Taipei, Taiwan.","DOI":"10.1145\/2462456.2464449"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ma, Y., Xu, B., Bai, Y., Sun, G., and Zhu, R. (2012, January 9\u201312). Daily Mood Assessment Based on Mobile Phone Sensing. Proceedings of the 2012 Ninth International Conference on Wearable and Implantable Body Sensor Networks, London, UK.","DOI":"10.1109\/BSN.2012.3"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"e72","DOI":"10.2196\/jmir.5505","article-title":"Mobile Phone-Based Unobtrusive Ecological Momentary Assessment of Day-to-Day Mood: An Explorative Study","volume":"18","author":"Asselbergs","year":"2016","journal-title":"J. Med. Internet Res."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e55","DOI":"10.2196\/jmir.1838","article-title":"Harnessing Context Sensing to Develop a Mobile Intervention for Depression","volume":"13","author":"Burns","year":"2011","journal-title":"J. Med. Internet Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"187","DOI":"10.3389\/fpsyg.2013.00187","article-title":"How to investigate within-subject associations between physical activity and momentary affective states in everyday life: A position statement based on a literature overview","volume":"4","author":"Kanning","year":"2013","journal-title":"Front. Psychol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"6","DOI":"10.3389\/fict.2015.00006","article-title":"AWARE: Mobile context instrumentation framework","volume":"2","author":"Ferreira","year":"2015","journal-title":"Front. ICT"},{"key":"ref_27","unstructured":"AWARE (2019, May 25). Open-Source Context-Instrumentation Framework for Everyone. Available online: https:\/\/awareframework.com\/."},{"key":"ref_28","unstructured":"SQLite (2019, May 25). SQLite Engine. Available online: http:\/\/www.sqlite.org\/."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1037\/0033-2909.98.2.219","article-title":"Toward a consensual structure of mood","volume":"98","author":"Watson","year":"1985","journal-title":"Psychol. Bull."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1037\/0022-3514.54.6.1063","article-title":"Development and validation of brief measures of positive and negative affect: The PANAS scales","volume":"54","author":"Watson","year":"1988","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_31","unstructured":"Ekman, P. (2003). Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life, Times Books\/Henry Holt."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","article-title":"A circumplex model of affect","volume":"39","author":"Russell","year":"1980","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wohlfahrt-Laymann, J., Hermens, H., Villalonga, C., Vollenbroek-Hutten, M., and Banos, O. (2018). MobileCogniTracker\u2014A mobile experience sampling tool for tracking cognitive behaviour. J. Ambient. Intell. Humaniz. Comput., 1\u201318.","DOI":"10.1007\/s12652-018-0827-y"},{"key":"ref_34","unstructured":"Meschtscherjakov, A., Weiss, A., and Scherndl, T. (2009, January 15\u201318). Utilizing Emoticons on Mobile Devices within ESM studies to Measure Emotions in the Field. Proceedings of the International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI\u201909), Bonn, Germany."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1023\/A:1023661322862","article-title":"Affect Measurement in Experience Sampling Research","volume":"4","author":"Schimmack","year":"2003","journal-title":"J. Happiness Stud."},{"key":"ref_36","unstructured":"Attfield, S., Kazai, G., Lalmas, M., and Piwowarski, B. (2011, January 9\u201312). Towards a science of user engagement. Proceedings of the Workshop on User Modelling for Web Applications, Hong Kong, China."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/S0747-5632(02)00080-8","article-title":"Designing website attributes to induce experiential encounters","volume":"19","author":"Huang","year":"2003","journal-title":"Comput. Hum. Behav."},{"key":"ref_38","first-page":"393","article-title":"Applying Motivation Theory to Achieve Increased Response Rates, Respondent Satisfaction and Data Quality","volume":"27","author":"Wenemark","year":"2011","journal-title":"J. Off. Stat."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1080\/01973533.2012.711691","article-title":"Anchoring and Adjusting in Questionnaire Responses","volume":"34","author":"Gehlbach","year":"2012","journal-title":"Basic Appl. Soc. Psychol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1348\/135910709X466063","article-title":"Ecological Momentary Interventions: Incorporating Mobile Technology Into Psychosocial and Health Behavior Treatments","volume":"15","author":"Heron","year":"2010","journal-title":"Br. J. Health Psychol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1210","DOI":"10.1093\/ntr\/ntv266","article-title":"Response Parameters for SMS Text Message Assessments Among Pregnant and General Smokers Participating in SMS Cessation Trials","volume":"18","author":"Naughton","year":"2016","journal-title":"Nicotine Tob. Res."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1111\/rssa.12024","article-title":"Re-engaging with survey non-respondents: Evidence from three household panels","volume":"177","author":"Watson","year":"2014","journal-title":"J. R. Stat. Soc. Ser. A (Stat. Soc.)"},{"key":"ref_43","unstructured":"Ronacher, A. (2019, July 02). Serialization Framework for Java. Available online: http:\/\/flask.pocoo.org\/."},{"key":"ref_44","unstructured":"Bailon, C. (2019, July 08). AWARE Plugin: Flexible ESM. Available online: https:\/\/github.com\/carlos-bailon\/com.aware.plugin.esm.flexible."},{"key":"ref_45","unstructured":"Simple-XML (2019, May 25). Serialization Framework for Java. Available online: http:\/\/simple.sourceforge.net\/."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1007\/s007790170019","article-title":"Understanding and Using Context","volume":"5","author":"Dey","year":"2001","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1146\/annurev-clinpsy-032816-044949","article-title":"Personal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning","volume":"13","author":"Mohr","year":"2017","journal-title":"Annu. Rev. Clin. Psychol."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Banos, O., Villalonga, C., Bang, J.H., Hur, T.H., Kang, D., Park, S.B., Hyunh-The, T., Vui, L.B., Amin, M.B., and Razzaq, M.A. (2016). Human Behavior Analysis by means of Multimodal Context Mining. Sensors, 16.","DOI":"10.3390\/s16081264"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Van Berkel, N., Goncalves, J., Koval, P., Hosio, S., Dingler, T., Ferreira, D., and Kostakos, V. (2019, January 4\u20139). Context-Informed Scheduling and Analysis: Improving Accuracy of Mobile Self-Reports. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK.","DOI":"10.1145\/3290605.3300281"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1111\/j.1467-6494.1991.tb00260.x","article-title":"Measuring Daily Events and Experiences: Decisions for the Researcher","volume":"59","author":"Stone","year":"1991","journal-title":"J. Personal."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1136\/ebmental-2016-102418","article-title":"Use of the experience sampling method in the context of clinical trials: Table 1","volume":"19","author":"Verhagen","year":"2016","journal-title":"Evid. Based Ment. Health"},{"key":"ref_52","unstructured":"Mcabe, K.O., Mack, L., and Fleeson, W. (2012). A Guide for Data Cleaning in Experience Sampling Studies, Guilford Press."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Jordan, P.W., Thomas, B., Weerdmeester, B.A., and McClelland, A.L. (1996). SUS-A quick and dirty usability scale. Usability Evaluation in Industry, Taylor&Francis.","DOI":"10.1201\/9781498710411"},{"key":"ref_54","unstructured":"Sauro, J. (2011). A Practical Guide to the System Usability Scale, Createspace Independent Publishing Platform."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1080\/10447310802205776","article-title":"An empirical evaluation of the system usability scale","volume":"24","author":"Bangor","year":"2008","journal-title":"Hum. Comput. Interact."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.ijhcs.2018.12.002","article-title":"Effect of experience sampling schedules on response rate and recall accuracy of objective self-reports","volume":"125","author":"Goncalves","year":"2019","journal-title":"Int. J. Hum.-Comp. Stud."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/15\/3430\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:08:47Z","timestamp":1760188127000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/15\/3430"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,5]]},"references-count":56,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["s19153430"],"URL":"https:\/\/doi.org\/10.3390\/s19153430","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,8,5]]}}}