{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T22:30:44Z","timestamp":1764714644472,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2014,8,27]],"date-time":"2014-08-27T00:00:00Z","timestamp":1409097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"publisher","award":["EP\/F063822\/1","EP\/G012393\/1"],"award-info":[{"award-number":["EP\/F063822\/1","EP\/G012393\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper we discuss the design and evaluation of a mobile based tool to collect activity data on a large scale. The current approach, based on an existing activity recognition module, recognizes class transitions from a set of specific activities (for example walking and running) to the standing still activity. Once this transition is detected the system prompts the user to provide a label for their previous activity. This label, along with the raw sensor data, is then stored locally prior to being uploaded to cloud storage.  The system was evaluated by ten users. Three evaluation protocols were used, including a structured, semi-structured and free living protocol. Results indicate that the mobile application could be used to allow the user to provide accurate ground truth labels for  their activity data. Similarities of up to 100% where observed when comparing the user prompted labels and those from an observer during structured lab based experiments. Further work will examine data segmentation and personalization issues in order to refine the system.<\/jats:p>","DOI":"10.3390\/s140915861","type":"journal-article","created":{"date-parts":[[2014,8,27]],"date-time":"2014-08-27T09:52:39Z","timestamp":1409133159000},"page":"15861-15879","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":47,"title":["Evaluation of Prompted Annotation of Activity Data Recorded from a Smart Phone"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2368-7354","authenticated-orcid":false,"given":"Ian","family":"Cleland","sequence":"first","affiliation":[{"name":"School of Computing and Mathematics, Computer Science Research Institute, University of Ulster, Newtownabbey, Co. Antrim, BT37 0QB, Northern Ireland, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manhyung","family":"Han","sequence":"additional","affiliation":[{"name":"Ubiquitous Computing Laboratory, Kyung Hee University, 1 Seocheon-dong, Giheung-gu,  Yongin-si, Gyeonggi-do 446-701, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0882-7902","authenticated-orcid":false,"given":"Chris","family":"Nugent","sequence":"additional","affiliation":[{"name":"School of Computing and Mathematics, Computer Science Research Institute, University of Ulster, Newtownabbey, Co. Antrim, BT37 0QB, Northern Ireland, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hosung","family":"Lee","sequence":"additional","affiliation":[{"name":"Ubiquitous Computing Laboratory, Kyung Hee University, 1 Seocheon-dong, Giheung-gu,  Yongin-si, Gyeonggi-do 446-701, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sally","family":"McClean","sequence":"additional","affiliation":[{"name":"School of Computing and Information Engineering, University of Ulster, Coleraine,  Co. Londonderry, BT52 1SA, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuai","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computing and Mathematics, Computer Science Research Institute, University of Ulster, Newtownabbey, Co. Antrim, BT37 0QB, Northern Ireland, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sungyoung","family":"Lee","sequence":"additional","affiliation":[{"name":"Ubiquitous Computing Laboratory, Kyung Hee University, 1 Seocheon-dong, Giheung-gu,  Yongin-si, Gyeonggi-do 446-701, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2014,8,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lane, N.D., Eisenman, S.B., Musolesi, M., Miluzzo, E., and Campbell, A.T. (2008, January 25\u201326). Urban Sensing Systems: Opportunistic or Participatory?. Napa Valley, CA, USA.","DOI":"10.1145\/1411759.1411763"},{"key":"ref_2","unstructured":"Kanhere, S.S. (2013). Distributed Computing and Internet Technology, Springer."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"R1","DOI":"10.1088\/0967-3334\/30\/4\/R01","article-title":"Activity Identification using Body-Mounted Sensors\u2014A Review of Classification Techniques","volume":"30","author":"Preece","year":"2009","journal-title":"Physiol. Meas."},{"key":"ref_4","unstructured":"Avci, A., Bosch, S., Marin-Perianu, M., Marin-Perianu, R., and Havinga, P. (2010, January 22\u201323). Activity Recognition Using Inertial Sensing for Healthcare, Wellbeing and Sports Applications: A Survey. Hannover, Germany."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1109\/MPRV.2013.28","article-title":"Closing the Evaluation Gap in UbiHealth Research","volume":"12","author":"Intille","year":"2013","journal-title":"IEEE Pervasive Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"S24","DOI":"10.1249\/MSS.0b013e3182399c7d","article-title":"New Horizons in Sensor Development","volume":"44","author":"Intille","year":"2012","journal-title":"Med. Sci. Sports Exerc."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1109\/MCOM.2010.5560598","article-title":"A Survey of Mobile Phone Sensing","volume":"48","author":"Lane","year":"2010","journal-title":"IEEE Commun. Mag."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hossmann, T., Efstratiou, C., and Mascolo, C. (2012, January 25\u201329). Collecting Big Datasets of Human Activity One Check in at a Time. Ambleside, UK.","DOI":"10.1145\/2307836.2307842"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"7772","DOI":"10.3390\/s100807772","article-title":"A Review of Accelerometry-Based Wearable Motion Detectors for Physical Activity Monitoring","volume":"10","author":"Yang","year":"2010","journal-title":"Sensors"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1192","DOI":"10.1109\/SURV.2012.110112.00192","article-title":"A survey on human activity recognition using wearable sensors","volume":"15","author":"Lara","year":"2013","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1145\/1964897.1964918","article-title":"Activity Recognition Using Cell Phone Accelerometers","volume":"12","author":"Kwapisz","year":"2011","journal-title":"ACM SIGKDD Explor. Newslett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1007\/s12668-013-0088-3","article-title":"A review and taxonomy of activity recognition on mobile phones","volume":"3","author":"Incel","year":"2013","journal-title":"BioNanoScience"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2521","DOI":"10.1109\/TPAMI.2011.36","article-title":"Weakly Supervised Recognition of Daily Life Activities with Wearable Sensors","volume":"33","author":"Stikic","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1109\/TITB.2005.856863","article-title":"Activity Classification Using Realistic Data from Wearable Sensors","volume":"10","author":"Parkka","year":"2006","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2193","DOI":"10.1249\/MSS.0b013e31829736d6","article-title":"Activity Recognition Using a Single Accelerometer Placed at the Wrist or Ankle","volume":"45","author":"Mannini","year":"2013","journal-title":"Med. Sci. Sports Exerc."},{"key":"ref_16","unstructured":"Krishnan, N.C., Colbry, D., Juillard, C., and Panchanathan, S. (2008, January 11\u201314). Real Time Human Activity Recognition Using Tri-Axial Accelerometers. Sedona, AZ, USA."},{"key":"ref_17","unstructured":"Bao, L., and Intille, S.S. (2004). Pervasive Computing, Springer: Berlin\/Heidelberg, Germany."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Plotz, T., Chen, C., Hammerla, N.Y., and Abowd, G.D. (2012, January 18\u201322). Automatic Synchronization of Wearable Sensors and Video-Cameras for Ground Truth Annotation\u2014A Practical Approach. Newcastle, UK.","DOI":"10.1109\/ISWC.2012.15"},{"key":"ref_19","unstructured":"Cruciani, F., Donnelly, M.P., Nugent, C.D., Parente, G., Paggetti, C., and Burns, W. (2011). Sensor Systems and Software, Springer."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lasecki, W.S., Song, Y.C., Kautz, H., and Bigham, J.P. (2013, January 23\u201327). Real-Time Crowd Labeling for Deployable Activity Recognition. San Antonio, TX, USA.","DOI":"10.1145\/2441776.2441912"},{"key":"ref_21","unstructured":"Kawaguchi, N., Watanabe, H., Yang, T., Ogawa, N., Iwasaki, Y., Kaji, K., Terada, T., Murao, K., Hada, H., and Inoue, S. (2012, January 16\u201320). HASC2012corpus: Large Scale Human Activity Corpus and its Application. Beijing, China."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Tapia, E.M., Intille, S.S., and Larson, K. (2004). Activity Recognition in the Home Using Simple and Ubiquitous Sensors, Springer.","DOI":"10.1007\/978-3-540-24646-6_10"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Harada, S., Lester, J., Patel, K., Saponas, T.S., Fogarty, J., Landay, J.A., and Wobbrock, J.O. (2008, January 20\u201322). VoiceLabel: Using Speech to Label Mobile Sensor Data. Crete, Greece.","DOI":"10.1145\/1452392.1452407"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1109\/TBME.2012.2208111","article-title":"Enabling Large-Scale Ground-Truth Acquisition and System Evaluation in Wireless Health","volume":"60","author":"Xu","year":"2013","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"12588","DOI":"10.3390\/s120912588","article-title":"Comprehensive Context Recognizer Based on Multimodal Sensors in a Smartphone","volume":"12","author":"Han","year":"2012","journal-title":"Sensors"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1077","DOI":"10.1682\/JRRD.2007.11.0197","article-title":"How humans walk: Bout duration, steps per bout, and rest duration","volume":"45","author":"Orendurff","year":"2008","journal-title":"J. Rehabil. Res. Dev."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1080\/10630732.2014.888216","article-title":"Managed Participatory Sensing with YouSense","volume":"21","author":"Linnap","year":"2014","journal-title":"J. Urban Technol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ferreira, D., Gon\u00e7alves, J., Kostakos, V., Barkhuus, L., and Dey, A.K. (2014, January 23\u201326). Contextual Experience Sampling of Mobile Application Micro-Usage. Toronto, ON, Canada.","DOI":"10.1145\/2628363.2628367"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1080\/10447319509526110","article-title":"IBM Compute UsabilitySatisfaction Questionnaires: Psychometric Evaluation and Instructions for Use","volume":"7","author":"Lewis","year":"1995","journal-title":"Int. J. Human Comput. Interac."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1007\/s10115-012-0507-8","article-title":"A survey on instance selection for active learning","volume":"35","author":"Fu","year":"2013","journal-title":"Knowl. Inf. Syst."},{"key":"ref_31","unstructured":"Patterson, P., McClean, S., Nugent, C., Zhang, S., Galway, L., and Cleland, I. Online Change Detection for Timely Solicitation of User Interaction. Accepted."},{"key":"ref_32","unstructured":"Jain, A., and Wang, Y. A New Framework for On-Line Change Detection. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/summary?doi=10.1.1.62.5929."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1093\/biomet\/41.1-2.100","article-title":"Continuous Inspection Schemes","volume":"41","author":"Page","year":"1954","journal-title":"Biometrika"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"237","DOI":"10.5626\/JCSE.2011.5.3.237","article-title":"Managing Sensor Data in Ambient Assisted Living","volume":"5","author":"Nugent","year":"2011","journal-title":"JCSE"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5791","DOI":"10.3390\/s120505791","article-title":"Detection of (in) Activity Periods in Human Body Motion using Inertial Sensors: A Comparative Study","volume":"12","author":"Olivares","year":"2012","journal-title":"Sensors"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hoseini-Tabatabaei, S.A., Gluhak, A., and Tafazolli, R. (2013). A survey on smartphone-based systems for opportunistic user context recognition. ACM Comput. Surv.","DOI":"10.1145\/2480741.2480744"},{"key":"ref_37","unstructured":"Liang, Y., Zhou, X., Yu, Z., Guo, B., and Yang, Y. (2012). Advances in Grid and Pervasive Computing, Springer."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/9\/15861\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:15:18Z","timestamp":1760217318000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/9\/15861"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,8,27]]},"references-count":37,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2014,9]]}},"alternative-id":["s140915861"],"URL":"https:\/\/doi.org\/10.3390\/s140915861","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2014,8,27]]}}}