{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T09:27:46Z","timestamp":1762507666364,"version":"build-2065373602"},"reference-count":52,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,1,22]],"date-time":"2019-01-22T00:00:00Z","timestamp":1548115200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Mobile and wearable devices are capable of quantifying user behaviors based on their contextual sensor data. However, few indexing and annotation mechanisms are available, due to difficulties inherent in raw multivariate data types and the relative sparsity of sensor data. These issues have slowed the development of higher level human-centric searching and querying mechanisms. Here, we propose a pipeline of three algorithms. First, we introduce a spatio-temporal event detection algorithm. Then, we introduce a clustering algorithm based on mobile contextual data. Our spatio-temporal clustering approach can be used as an annotation on raw sensor data. It improves information retrieval by reducing the search space and is based on searching only the related clusters. To further improve behavior quantification, the third algorithm identifies contrasting events within a cluster content. Two large real-world smartphone datasets have been used to evaluate our algorithms and demonstrate the utility and resource efficiency of our approach to search.<\/jats:p>","DOI":"10.3390\/s19030448","type":"journal-article","created":{"date-parts":[[2019,1,24]],"date-time":"2019-01-24T03:52:32Z","timestamp":1548301952000},"page":"448","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Indexing Multivariate Mobile Data through Spatio-Temporal Event Detection and Clustering"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2607-1777","authenticated-orcid":false,"given":"Reza","family":"Rawassizadeh","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Rochester, Rochester, NY 14620, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9420-2452","authenticated-orcid":false,"given":"Chelsea","family":"Dobbins","sequence":"additional","affiliation":[{"name":"School of Information Technology and Electrical Engineering, University of Queensland, Brisbane 4067, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3321-5775","authenticated-orcid":false,"given":"Mohammad","family":"Akbari","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University College London, London WC1E 6BT, UK"}]},{"given":"Michael","family":"Pazzani","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of California, Riverside, CA 92507, USA"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3098","DOI":"10.1109\/TKDE.2016.2592527","article-title":"Scalable Daily Human Behavioral Pattern Mining from Multivariate Temporal Data","volume":"28","author":"Rawassizadeh","year":"2016","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Jararweh, Y., Tawalbeh, L., Ababneh, F., and Dosari, F. (2013, January 11\u201313). Resource Efficient Mobile Computing Using Cloudlet Infrastructure. Proceedings of the IEEE Ninth International Conference on Mobile Ad-hoc and Sensor Networks (MSN \u201913), Dalian, China.","DOI":"10.1109\/MSN.2013.75"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1109\/MPRV.2018.011591063","article-title":"NoCloud: Experimenting with Network Disconnection by Design","volume":"17","author":"Rawassizadeh","year":"2018","journal-title":"IEEE Pervas. Comput."},{"key":"ref_4","unstructured":"(2019, January 18). Google Fit: Health and Activity Tracking. Available online: https:\/\/play.google.com\/store\/apps\/details?id=com.google.android.apps.fitness."},{"key":"ref_5","unstructured":"(2019, January 18). Samsung Health. Available online: https:\/\/play.google.com\/store\/apps\/details?id=com.sec.android.app.shealth."},{"key":"ref_6","unstructured":"(2019, January 18). Fitbit. Available online: https:\/\/itunes.apple.com\/us\/app\/fitbit\/id462638897?mt=8."},{"key":"ref_7","unstructured":"(2019, January 18). SiRi. Available online: https:\/\/www.apple.com\/ios\/siri."},{"key":"ref_8","unstructured":"(2019, January 18). Cortona. Available online: https:\/\/www.microsoft.com\/en-us\/mobile\/experiences\/cortana."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1177\/0272989X10373805","article-title":"Graph Literacy: A Cross-Cultural Comparison","volume":"31","author":"Galesic","year":"2011","journal-title":"Med. Decis. Mak."},{"key":"ref_10","first-page":"173","article-title":"The Roles of Health Literacy, Numeracy, and Graph Literacy on the Usability of the VA\u2019s Personal Health Record by Veterans","volume":"9","author":"Sharit","year":"2014","journal-title":"J. Usability Stud."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"315","DOI":"10.3390\/jsan4040315","article-title":"Lesson Learned from Collecting Quantified Self Information via Mobile and Wearable Devices","volume":"4","author":"Rawassizadeh","year":"2015","journal-title":"J. Sens. Actuator Netw."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1007\/s00778-011-0244-8","article-title":"Unveiling the Complexity of Human Mobility by Querying and Mining Massive Trajectory Data","volume":"20","author":"Giannotti","year":"2011","journal-title":"VLDB J."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bay, S., and Pazzani, M. (1999, January 15\u201318). Detecting Change in Categorical Data: Mining Contrast Sets. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD \u201999), San Diego, CA, USA.","DOI":"10.1145\/312129.312263"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/s00779-013-0640-8","article-title":"A Probabilistic Approach to Mining Mobile Phone Data Sequences","volume":"18","author":"Farrahi","year":"2014","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zheng, J., and Ni, L. (2012, January 5\u20138). An Unsupervised Framework for Sensing Individual and Cluster Behavior Patterns from Human Mobile Data. Proceedings of the 2012 ACM Conference on Ubiquitous Computing, Pittsburgh, PA, USA.","DOI":"10.1145\/2370216.2370241"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1007\/s00779-005-0046-3","article-title":"Reality Mining: Sensing Complex Social Systems","volume":"10","author":"Eagle","year":"2006","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1007\/s00779-012-0511-8","article-title":"UbiqLog: A generic mobile phone-based life-log framework","volume":"17","author":"Rawassizadeh","year":"2013","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1145\/2627534.2627553","article-title":"Device analyzer: Large Scale Mobile Data Collection","volume":"41","author":"Wagner","year":"2014","journal-title":"ACM Sigmetr. Perform. Eval. Rev."},{"key":"ref_19","unstructured":"(2019, January 18). Ubiqlog. Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets\/UbiqLog+(smartphone+\\lifelogging)."},{"key":"ref_20","unstructured":"(2019, January 18). Ubiqlog Tool. Available online: https:\/\/github.com\/rezar\/ubiqlog."},{"key":"ref_21","unstructured":"(2019, January 18). Device Analyzer. Available online: https:\/\/deviceanalyzer.cl.cam.ac.uk\/."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Rawassizadeh, R., and Tjoa, A. (2010, January 20\u201322). Securing Shareable Life-Log. Proceedings of the IEEE Second International Conference on Social Computing (SocialCom\u201910), Minneapolis, MN, USA.","DOI":"10.1109\/SocialCom.2010.164"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1080\/0144929X.2010.510208","article-title":"Towards Sharing Life-log Information with Society","volume":"31","author":"Rawassizadeh","year":"2012","journal-title":"Behav. Inf. Technol."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Deblauwe, N., and Ruppel, P. (2007, January 6\u201310). Combining GPS and GSM Cell-ID Positioning for Proactive Location-based Services. Proceedings of the Fourth Annual International Conference on Mobile and Ubiquitous Systems: Networking & Services (MobiQuitous \u201907), Philadelphia, PA, USA.","DOI":"10.1109\/MOBIQ.2007.4450985"},{"key":"ref_25","unstructured":"Paek, J., Kim, K., Singh, J., and Govindan, R. (July, January 28). Energy-efficient Positioning for Smartphones Using Cell-ID Sequence Matching. Proceedings of the 9th International Conference on Mobile Systems, Applications, and Services (MobiSys \u201911), Bethesda, MD, USA."},{"key":"ref_26","unstructured":"Zhou, C., Shekhar, S., and Terveen, L. Discovering Personal Paths from Sparse GPS Traces. Proceedings of the 1st International Workshop on Data Mining in Conjunction with 8th Joint Conference on Information Sciences (JCIS \u201905), Available online: https:\/\/pdfs.semanticscholar.org\/1bb9\/21aded7824aee6e55003454eb4200aa86ed9.pdf."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Noulas, A., Scellato, S., Lathia, N., and Mascolo, C. (2012, January 10). Mining User Mobility Features for Next Place Prediction in Location-Based Services. Proceedings of the IEEE 12th International Conference on Data Mining (ICDM \u201912), Brussels, Belgium.","DOI":"10.1109\/ICDM.2012.113"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, D., Pedreschi, D., Song, C., Giannotti, F., and Barabasi, A. (2011, January 21\u201324). Human Mobility, Social Ties, and Link Prediction. Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD \u201911), San Diego, CA, USA.","DOI":"10.1145\/2020408.2020581"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Webb, G., Butler, S., and Newlands, D. (2003, January 24\u201327). On detecting differences between groups. Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD \u201903), Washington, DC, USA.","DOI":"10.1145\/956755.956781"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1109\/MPRV.2011.13","article-title":"LifeMap: A Smartphone-Based Context Provider for Location-Based Services","volume":"10","author":"Chon","year":"2011","journal-title":"IEEE Pervas. Comput."},{"key":"ref_31","first-page":"3389","article-title":"SPMF: A Java Open-source Pattern Mining Library","volume":"15","author":"Gomariz","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1080\/01969727308546046","article-title":"A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters","volume":"3","author":"Dunn","year":"1973","journal-title":"J. Cybern."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1016\/j.jmva.2006.11.013","article-title":"Comparing Clusterings? An Information based Distance","volume":"98","year":"2007","journal-title":"J. Multivar. Anal."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Rawassizadeh, R., Dobbins, C., Nourizadeh, M., Ghamchili, Z., and Pazzani, M. (2017, January 13\u201317). A Natural Language Query Interface for Searching Personal Information on Smartwatches. Proceedings of the IEEE International Conference on Pervasive Computing and Communications, WristSence Workshop, Kona, HI, USA.","DOI":"10.1109\/PERCOMW.2017.7917645"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ferreira, D., Dey, A., and Kostakos, V. (2011, January 12\u201315). Understanding Human-Smartphone Concerns: A Study of Battery Life. Proceedings of the International Conference on Pervasive Computing, San Francisco, CA, USA.","DOI":"10.1007\/978-3-642-21726-5_2"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Ma, H., Cao, H., Yang, Q., Chen, E., and Tian, J. (2012, January 16\u201320). A Habit Mining Approach for Discovering Similar Mobile Users. Proceedings of the 21st International Conference on World Wide Web (WWW \u201912), Lyon, France.","DOI":"10.1145\/2187836.2187868"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ghahramani, M., Zhou, M., and Hon, C.T. (2018). Mobile Phone Data Analysis: A Spatial Exploration Toward Hotspot Detection. IEEE Trans. Autom. Sci. Eng.","DOI":"10.1109\/TASE.2018.2795241"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1109\/JAS.2017.7510316","article-title":"Social Media based Transportation Research: The State of The Work and The Networking","volume":"4","author":"Lv","year":"2017","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mokbel, M., Xiong, X., and Aref, W. (2004, January 13\u201318). Sina: Scalable Incremental Processing of Continuous Queries in Spatio-temporal Databases. Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data (SIGMOD \u201904), Paris, France.","DOI":"10.1145\/1007568.1007638"},{"key":"ref_40","unstructured":"Zhang, C., Zhang, Y., Zhang, W., and Lin, X. (2013, January 8\u201312). Inverted Linear Quadtree: Efficient Top k Spatial Keyword Search. Proceedings of the IEEE 29th International Conference on Data Engineering (ICDE \u201913), Washington, DC, USA."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Christensen, R., Wang, L., Li, F., Yi, K., Tang, J., and Villa, N. (June, January 31). STORM: Spatio-Temporal Online Reasoning and Management of Large Spatio-Temporal Data. Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (SIGMOD \u201915), Melbourne, VIC, Australia.","DOI":"10.1145\/2723372.2735373"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Franzke, M., Emrich, T., Z\u1ef3fle, A., and Renz, M. (2016, January 16\u201320). Indexing Multi-Metric Data. Proceedings of the IEEE 32th International Conference on Data Engineering (ICDE \u201916), Helsinki, Finland.","DOI":"10.1109\/ICDE.2016.7498318"},{"key":"ref_43","unstructured":"Bhattacharya, T., Kulik, L., and Bailey, J. (2019, January 18). Automatically Recognizing Places of Interest from Unreliable GPS Data Using Spatio-temporal Density Estimation and Line Intersections. Available online: https:\/\/www.sciencedirect.com\/science\/article\/pii\/S1574119214001357."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Krumm, J., and Rouhana, D. (2013, January 8\u201312). Placer: Semantic Place Labels from Diary Data. Proceedings of the 2013 ACM International Joint Conference On Pervasive and Ubiquitous Computing, Zurich, Switzerland.","DOI":"10.1145\/2493432.2493504"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1219","DOI":"10.1109\/TKDE.2014.2365801","article-title":"ePeriodicity: Mining Event Periodicity from Incomplete Observations","volume":"27","author":"Li","year":"2015","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Doherty, A., and Smeaton, A. (2008, January 7\u20139). Automatically Segmenting Lifelog Data into Events. Proceedings of the Ninth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS \u201908), Washington, DC, USA.","DOI":"10.1109\/WIAMIS.2008.32"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Gomi, A., and Itoh, T. (2011, January 21\u201324). A Personal Photograph Browser for Life Log Analysis Based on Location, Time, and Person. Proceedings of the 2011 ACM Symposium on Applied Computing (PSAC \u201911), TaiChung, Taiwan.","DOI":"10.1145\/1982185.1982458"},{"key":"ref_48","unstructured":"Kelly, L., and Jones, G. (2010, January 2\u20133). An Exploration of the Utility of GSR in Locating Events from Personal Lifelogs for Reflection. Proceedings of the 4th Irish Human Computer Interaction Conference (iHCI \u201910), Dubin, Ireland."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Lu, H., Yang, J., Liu, Z., Lane, N., Choudhury, T., and Campbell, A. (2010, January 3\u20135). The Jigsaw Continuous Sensing Engine for Mobile Phone Applications. Proceedings of the 8th ACM Conference on Embedded Networked Sensor Systems (SenSys \u201910), Zurich, Switzerland.","DOI":"10.1145\/1869983.1869992"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Liu, C., Zhang, L., Liu, Z., Liu, K., Li, X., and Liu, Y. (2016, January 3\u20137). Lasagna: Towards Deep Hierarchical Understanding and Searching over Mobile Sensing Data. Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking (MobiCom \u201916), New York, NY, USA.","DOI":"10.1145\/2973750.2973752"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Nath, S. (2012, January 25\u201329). ACE: Exploiting Correlation for Energy-Efficient and Continuous Context Sensing. Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services (MobiSys \u201912), Low Wood Bay, UK.","DOI":"10.1145\/2307636.2307640"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Hsieh, C., Tangmunarunkit, H., Alquaddoomi, F., Jenkins, J., Kang, J., Ketcham, C., Longstaff, B., Selsky, J., Dawson, B., Swendeman, D., Estrin, D., and Ramanathan, N. (2013, January 11\u201315). Lifestreams: A modular sense-making toolset for identifying important patterns from everyday life. Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems (Sensys \u201913), Roma, Italy.","DOI":"10.1145\/2517351.2517368"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/448\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:28:00Z","timestamp":1760185680000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/448"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,22]]},"references-count":52,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["s19030448"],"URL":"https:\/\/doi.org\/10.3390\/s19030448","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,1,22]]}}}