{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:19:22Z","timestamp":1760242762839,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2016,5,23]],"date-time":"2016-05-23T00:00:00Z","timestamp":1463961600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CCF 1048298"],"award-info":[{"award-number":["CCF 1048298"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>We demonstrate the feasibility of constructing a novel and practical real-world mobile cloud system, called myBlackBox, that efficiently fuses multimodal smartphone sensor data to identify and log unusual personal events in mobile users\u2019 daily lives. The system incorporates a hybrid architectural design that combines unsupervised classification of audio, accelerometer and location data with supervised joint fusion classification to achieve high accuracy, customization, convenience and scalability. We show the feasibility of myBlackBox by implementing and evaluating this end-to-end system that combines Android smartphones with cloud servers, deployed for 15 users over a one-month period.<\/jats:p>","DOI":"10.3390\/s16050753","type":"journal-article","created":{"date-parts":[[2016,5,24]],"date-time":"2016-05-24T09:05:05Z","timestamp":1464080705000},"page":"753","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["myBlackBox: Blackbox Mobile Cloud Systems for Personalized Unusual Event Detection"],"prefix":"10.3390","volume":"16","author":[{"given":"Junho","family":"Ahn","sequence":"first","affiliation":[{"name":"National Security Research Institute, Yuseong, Daejeon 305-600, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Colorado, Boulder, CO 80309, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,5,23]]},"reference":[{"key":"ref_1","unstructured":"Car BlackBox. Available online: https:\/\/dashcamtalk.com\/."},{"key":"ref_2","unstructured":"Falcon Zero. Available online: http:\/\/falconzero.com\/."},{"key":"ref_3","unstructured":"Beauvais, S.B., Rialle, V., and Sablier, J. (2012, January 23\u201328). Myvigi: An Android Application to Detect Fall and Wandering. Proceedings of the sixth International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies, UBICOMM 2012, Barcelona, Spain."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Doukas, C., Maglogiannis, I., Rouskas, A., and Pneumatikakis, A. (2009, January 9\u201313). Emergency incidents detection in assisted living environments utilizing sound and visual perceptual components. Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments (PETRA \u201909), Corfu, Greece.","DOI":"10.1145\/1579114.1579128"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ito, A., Aiba, A., Ito, M., and Makino, S. (2009, January 18\u201320). Detection of abnormal sound using multi-stage gmm for surveillance microphone. Proceedings of the 2009 Fifth International Conference on Information Assurance and Security (IAS \u201909), Xi\u2019an, China.","DOI":"10.1109\/IAS.2009.160"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ntalampiras, S., Potamitis, I., and Fakotakis, N. (2009, January 19\u201324). On acoustic surveillance of hazardous situations. Proceedings of the ICASSP 2009, Taipei, Taiwan.","DOI":"10.1109\/ICASSP.2009.4959546"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1109\/TMM.2011.2122247","article-title":"Probabilistic novelty detection for acoustic surveillance under real-world conditions","volume":"13","author":"Ntalampiras","year":"2011","journal-title":"IEEE Trans. Multimedia"},{"key":"ref_8","first-page":"277","article-title":"Fall detection by embedding an accelerometer in cellphone and using KFD algorithm","volume":"6","author":"Zhang","year":"2006","journal-title":"Int. J. Comput. Sci. Netw. Secur."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1155\/2013\/360243","article-title":"Personalized behavior pattern recognition and unusual event detection for mobile users","volume":"9","author":"Ahn","year":"2013","journal-title":"Mobile Inf. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2808207","article-title":"Supporting Healthy Grocery Shopping via Mobile Augmented Reality","volume":"12","author":"Ahn","year":"2015","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"ref_11","unstructured":"Miluzzo, E., Lane, N., Eisenman, S., and Campbell, A. (2007, January 21\u201323). Cenceme\u2014Injecting sensing presence into social networking applications. Proceedings of the 2nd European conference on Smart sensing and context (EuroSSC \u201907), Lisbon, Portugal."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Miluzzo, E., Lane, N., Fodor, K., Peterson, R., Lu, H., Musolesi, M., Eisenman, S., Zheng, X., and Campbell, A. (2008, January 4\u20137). Sensing meets mobile social networks: The design, implementation and evaluation of the cenceme application. Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems, SenSys \u201908, Raleigh, NC, USA.","DOI":"10.1145\/1460412.1460445"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1109\/TPAMI.2007.70825","article-title":"Robust real-time unusual event detection using multiple fixed-location monitors","volume":"30","author":"Adam","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","unstructured":"Shimizu, K., Kawamura, K., and Yamamoto, K. (2000, January 23\u201328). Location system for dementia wandering. Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA."},{"key":"ref_15","unstructured":"Sposaro, F., Danielson, J., and Tyson, G. (September, January 31). Iwander: An android application for dementia patients. Proceedings of the 32nd Annual International Conference of the IEEE EMBS, Buenos Aires, Argentina."},{"key":"ref_16","unstructured":"Family Locator\u2014GPS Tracker. Available online: https:\/\/play.google.com\/store\/apps\/details?id=com.sygic.familywhere.android."},{"key":"ref_17","unstructured":"Family Locator\u2014Kids Tracker. Available online: https:\/\/play.google.com\/store\/apps\/details?id=com.zoemob.gpstracking."},{"key":"ref_18","unstructured":"Logan, B. (2000, January 23\u201325). Mel Frequency Cepstral Coefficients for Music Modeling. Proceedings of the International Symposium on Music Information Retrieval, Plymouth, MA, USA."},{"key":"ref_19","unstructured":"Permuter, H., Francos, J., and Jermyn, I.H. (2003, January 6\u201310). Gaussian mixture models of texture and colour for image database retrieval. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP \u201903), Hong Kong, China."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Tian, L., Rafiq, R., Li, S., Chu, D., Han, R., Lv, Q., and Mishra, S. (2014, January 2\u20135). Multi-modal fusion for flasher detection in a mobile video chat application. Proceedings of the 11th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (Mobiquitous), London, UK.","DOI":"10.4108\/icst.mobiquitous.2014.257973"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhou, D., Luo, J., Silenzio, V., Zhou, Y., Hu, J., Glenn, C., and Henry, K. (2015, January 25\u201330). Tackling mental health by integrating unobtrusive multimodal sensing. Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI\u201915), Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9381"},{"key":"ref_22","unstructured":"Marina, V.S., Antonio, F., Mar\u00eda, T.L., Arturo, M., Roberto, Z., and Jos\u00e9, M.P. (2015). Trends in Practical Applications of Agents, Multi-Agent Systems and Sustainability, Springer."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.cviu.2015.06.009","article-title":"Multi-modal human aggression detection","volume":"144","author":"Kooij","year":"2016","journal-title":"Proc. Comput. Vis. Image Underst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF00058655","article-title":"Bagging predictors","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/jcss.1997.1504","article-title":"A decision-theoretic generalization of on-line learning and an application to boosting","volume":"55","author":"Freund","year":"1997","journal-title":"J. Comput. Syst. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1023\/A:1009715923555","article-title":"A tutorial on support vector machines for pattern recognition","volume":"2","author":"Burges","year":"1998","journal-title":"Knowl. Discov. Data Min."},{"key":"ref_27","unstructured":"Banerjee, N., Rahmati, A., Corner, M., Rollins, S., and Zhong, L. (2007, January 16\u201319). Users and batteries: Interactions and adaptive energy management in mobile systems. Proceedings of the 9th International Conference on Ubiquitous Computing (UbiComp \u201907), Innsbruck, Austria."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Tucker, A.B. (2004). Computer Science Handbook, CRC Press.","DOI":"10.1201\/9780203494455"},{"key":"ref_29","unstructured":"Mohri, M., Rostamizadeh, A., and Talwalkar, A. (2012). Foundations of Machine Learning, The MIT Press."},{"key":"ref_30","unstructured":"Ahn, J., and Han, R. (2012). Detecting Human Behavior and Feelings to Determine Safety Level Status Using the Mobile Phone in a User\u2019s Daily Life, IRB. Protocol:12-0260."},{"key":"ref_31","unstructured":"Mobile BlackBox (myBlackBox). Available online: http:\/\/android.aapk1.com\/screenshots\/mobile-blackbox-161-6809.html."},{"key":"ref_32","unstructured":"Spring Roo. Available online: http:\/\/www.springsource.org\/spring-roo."},{"key":"ref_33","unstructured":"MongoDB. Available online: http:\/\/www.mongodb.org."},{"key":"ref_34","unstructured":"myBlackBox Web-Server. Available online: http:\/\/www.mblackbox.com."},{"key":"ref_35","unstructured":"Skyhook. Available online: http:\/\/www.skyhookwireless.com."},{"key":"ref_36","unstructured":"System Monitor. Available online: https:\/\/play.google.com\/store\/apps\/details?id=com.cgollner.systemmonitor."},{"key":"ref_37","unstructured":"Power Tutor. Available online: http:\/\/ziyang.eecs.umich.edu\/projects\/powertutor."},{"key":"ref_38","unstructured":"Power Profiles for Android. Available online: https:\/\/source.android.com\/devices\/tech\/power.html."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/5\/753\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:24:21Z","timestamp":1760210661000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/5\/753"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,5,23]]},"references-count":38,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2016,5]]}},"alternative-id":["s16050753"],"URL":"https:\/\/doi.org\/10.3390\/s16050753","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2016,5,23]]}}}