{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T22:10:32Z","timestamp":1780611032617,"version":"3.54.1"},"reference-count":30,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2015,4,8]],"date-time":"2015-04-08T00:00:00Z","timestamp":1428451200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Spanish Government","award":["TIN2013-47152-C3-3-R"],"award-info":[{"award-number":["TIN2013-47152-C3-3-R"]}]},{"DOI":"10.13039\/501100000780","name":"European Union","doi-asserted-by":"publisher","award":["AAL-2012-5-187"],"award-info":[{"award-number":["AAL-2012-5-187"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Evaluating human activity recognition systems usually implies following expensive and time-consuming methodologies, where experiments with humans are run with the consequent ethical and legal issues. We propose a novel evaluation methodology to overcome the enumerated problems, which is based on surveys for users and a synthetic dataset generator tool. Surveys allow capturing how different users perform activities of daily living, while the synthetic dataset generator is used to create properly labelled activity datasets modelled with the information extracted from surveys. Important aspects, such as sensor noise, varying time lapses and user erratic behaviour, can also be simulated using the tool. The proposed methodology is shown to have very important advantages that allow researchers to carry out their work more efficiently. To evaluate the approach, a synthetic dataset generated following the proposed methodology is compared to a real dataset computing the similarity between sensor occurrence frequencies. It is concluded that the similarity between both datasets is more than significant.<\/jats:p>","DOI":"10.3390\/s150408192","type":"journal-article","created":{"date-parts":[[2015,4,8]],"date-time":"2015-04-08T11:23:46Z","timestamp":1428492226000},"page":"8192-8213","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Combining Users\u2019 Activity Survey and Simulators to Evaluate Human Activity Recognition Systems"],"prefix":"10.3390","volume":"15","author":[{"given":"Gorka","family":"Azkune","sequence":"first","affiliation":[{"name":"DeustoTech\u2014Deusto Institute of Technology, University of Deusto, Avda Universidades 24, Bilbao 48007, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1585-4717","authenticated-orcid":false,"given":"Aitor","family":"Almeida","sequence":"additional","affiliation":[{"name":"DeustoTech\u2014Deusto Institute of Technology, University of Deusto, Avda Universidades 24, Bilbao 48007, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8055-6823","authenticated-orcid":false,"given":"Diego","family":"L\u00f3pez-de-Ipi\u00f1a","sequence":"additional","affiliation":[{"name":"DeustoTech\u2014Deusto Institute of Technology, University of Deusto, Avda Universidades 24, Bilbao 48007, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liming","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Computer Science and Informatics, De Montfort University, Leicester, LE19BH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2015,4,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1007\/978-3-540-70540-6_3","article-title":"An investigation on acceptance of ubiquitous devices for the elderly in an geriatric hospital environment: Using the example of person tracking","volume":"5105","author":"Miesenberger","year":"2008","journal-title":"Computers Helping People with Special Needs, Lecture Notes in Computer Science, LNCS"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"6982","DOI":"10.1016\/j.eswa.2012.01.050","article-title":"Human activity monitoring by local and global finite state machines","volume":"39","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1635","DOI":"10.3390\/s130201635","article-title":"Exploring techniques for vision based human activity recognition: Methods, systems, and evaluation","volume":"13","author":"Xu","year":"2013","journal-title":"Sensors"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ziefle, M., Rocker, C., and Holzinger, A. (2011, January 23\u201326). Perceived Usefulness of Assistive Technologies and Electronic Services for Ambient Assisted Living. Dublin, Ireland.","DOI":"10.4108\/icst.pervasivehealth.2011.246044"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/MPRV.2004.7","article-title":"Inferring activities from interactions with objects","volume":"3","author":"Philipose","year":"2004","journal-title":"IEEE Pervas. Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"17313","DOI":"10.3390\/s140917313","article-title":"Integration of Multisensor Hybrid Reasoners to Support Personal Autonomy in the Smart Home","volume":"14","author":"Valero","year":"2014","journal-title":"Sensors"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/S0921-8890(02)00372-X","article-title":"A survey of socially interactive robots","volume":"42","author":"Fong","year":"2003","journal-title":"Robot. Auton. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/MPRV.2008.39","article-title":"The mobile sensing platform: An embedded activity recognition system","volume":"7","author":"Choudhury","year":"2008","journal-title":"IEEE Pervas. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1007\/s00779-010-0363-z","article-title":"Awareness marks: Adaptive services through user interactions with augmented objects","volume":"15","author":"Bravo","year":"2011","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1109\/TKDE.2010.148","article-title":"Discovering activities to recognize and track in a smart environment","volume":"23","author":"Rashidi","year":"2011","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_11","unstructured":"Kasteren, T.V., and Noulas, A. (2008, January 21\u201324). Accurate Activity Recognition in a Home Setting. Seoul, Korea."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1007\/978-3-540-24646-6_10","article-title":"Activity Recognition in the Home Using Simple and Ubiquitous Sensors","volume":"3001","author":"Tapia","year":"2004","journal-title":"Pervasive Comput."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Helaoui, R. (2011, January 21\u201325). Recognizing Interleaved and Concurrent Activities: A Statistical-Relational Approach. Seattle, WA, USA.","DOI":"10.1109\/PERCOM.2011.5767586"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Aztiria, A., and Augusto, J. (2010, January 6\u20138). Accurate Temporal Relationships in Sequences of User Behaviours in Intelligent Environments. Salamanca, Spain.","DOI":"10.1007\/978-3-642-13268-1_3"},{"key":"ref_15","first-page":"787","article-title":"Location-based activity recognition","volume":"18","author":"Liao","year":"2006","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wren, C., and Tapia, E. (2006, January 10\u201311). Toward scalable activity recognition for sensor networks. Dublin, Ireland.","DOI":"10.1007\/11752967_12"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Huynh, T., Fritz, M., and Schiele, B. (2008, January 21\u201324). Discovery of Activity Patterns Using Topic Models. Seoul, Korea.","DOI":"10.1145\/1409635.1409638"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Helal, S., Lee, J., and Hossain, S. (2011, January 25\u201328). Persim-Simulator for Human Activities in Pervasive Spaces. Nottingham, UK.","DOI":"10.1109\/IE.2011.34"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Helal, A., Cho, K., and Lee, W. (2012, January 4\u20137). 3D Modeling and Simulation of Human Activities in Smart Spaces. Fukuoka, Japan.","DOI":"10.1109\/UIC-ATC.2012.35"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.pmcj.2012.11.004","article-title":"Dynamic sensor data segmentation for real-time knowledge-driven activity recognition","volume":"10","author":"Okeyo","year":"2012","journal-title":"Pervasive Mob. Comput."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bruneau, J., Jouve, W., and Consel, C. (2009, January 13\u201316). DiaSim: A Parameterized Simulator for Pervasive Computing Applications. Toronto, Canada.","DOI":"10.4108\/ICST.MOBIQUITOUS2009.6851"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"790","DOI":"10.1109\/TSMCC.2012.2198883","article-title":"Sensor-based activity recognition","volume":"42","author":"Chen","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern.-Part C"},{"key":"ref_23","unstructured":"ADL Survey. Available online: http:\/\/goo.gl\/etCNyi."},{"key":"ref_24","unstructured":"Google Form. Available online: http:\/\/www.google.com\/google-d-s\/createforms.html."},{"key":"ref_25","unstructured":"Python. Available online: https:\/\/www.python.org\/."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1109\/TKDE.2011.51","article-title":"A knowledge-driven approach to activity recognition in smart homes","volume":"24","author":"Chen","year":"2012","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_27","unstructured":"JavaScript Object Notation. Available online: http:\/\/json.org\/."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"87","DOI":"10.2307\/2340521","article-title":"On the interpretation of \u03c7 2 from contingency tables, and the calculation of P","volume":"85","author":"Fisher","year":"1922","journal-title":"J. R. Stat. Soc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3115","DOI":"10.1016\/j.eswa.2014.11.063","article-title":"Extending knowledge-driven activity models through data-driven learning techniques","volume":"42","author":"Azkune","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s10209-010-0212-x","article-title":"The effect of previous exposure to technology on acceptance and its importance in usability and accessibility engineering","volume":"10","author":"Holzinger","year":"2010","journal-title":"Univ. Access Inf. Soc."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/4\/8192\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:44:27Z","timestamp":1760215467000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/4\/8192"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,4,8]]},"references-count":30,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2015,4]]}},"alternative-id":["s150408192"],"URL":"https:\/\/doi.org\/10.3390\/s150408192","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,4,8]]}}}