{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:19:17Z","timestamp":1760242757773,"version":"build-2065373602"},"reference-count":30,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2016,6,2]],"date-time":"2016-06-02T00:00:00Z","timestamp":1464825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Samsung Electronics Co. Ltd"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>For the past few decades, action recognition has been attracting many researchers due to its wide use in a variety of applications. Especially with the increasing number of smartphone users, many studies have been conducted using sensors within a smartphone. However, a lot of these studies assume that the users carry the device in specific ways such as by hand, in a pocket, in a bag, etc. This paper investigates the impact of providing an action recognition system with the information of the possession-way of a smartphone, and vice versa. The experimental dataset consists of five possession-ways (hand, backpack, upper-pocket, lower-pocket, and shoulder-bag) and two actions (walking and running) gathered by seven users separately. Various machine learning models including recurrent neural network architectures are employed to explore the relationship between the action recognition and the possession-way recognition. The experimental results show that the assumption of possession-ways of smartphones do affect the performance of action recognition, and vice versa. The results also reveal that a good performance is achieved when both actions and possession-ways are recognized simultaneously.<\/jats:p>","DOI":"10.3390\/s16060812","type":"journal-article","created":{"date-parts":[[2016,6,2]],"date-time":"2016-06-02T10:19:08Z","timestamp":1464862748000},"page":"812","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Investigating the Impact of Possession-Way of a Smartphone on Action Recognition"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2572-6348","authenticated-orcid":false,"given":"Zae","family":"Kim","sequence":"first","affiliation":[{"name":"School of Computing, KAIST, Daejeon 34141, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Young-Seob","family":"Jeong","sequence":"additional","affiliation":[{"name":"Naver Labs, Seongnam 13561, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hyung","family":"Oh","sequence":"additional","affiliation":[{"name":"Samsung Electronics, Seoul 06765, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kyo-Joong","family":"Oh","sequence":"additional","affiliation":[{"name":"School of Computing, KAIST, Daejeon 34141, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chae-Gyun","family":"Lim","sequence":"additional","affiliation":[{"name":"School of Computing, KAIST, Daejeon 34141, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0112-2600","authenticated-orcid":false,"given":"Youssef","family":"Iraqi","sequence":"additional","affiliation":[{"name":"Electrical and Computer Engineering Department, Khalifa University, Abu Dhabi 127788, UAE"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ho-Jin","family":"Choi","sequence":"additional","affiliation":[{"name":"School of Computing, KAIST, Daejeon 34141, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,6,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"126","DOI":"10.5391\/IJFIS.2015.15.2.126","article-title":"Design of Fuzzy Logic Control System for Segway Type Mobile Robots","volume":"15","author":"Kwak","year":"2015","journal-title":"Int. J. Fuzzy Logic Intell. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"27","DOI":"10.5391\/IJFIS.2015.15.1.27","article-title":"Unusual Motion Detection for Vision-Based Driver Assistance","volume":"15","author":"Fu","year":"2015","journal-title":"Int. J. Fuzzy Logic Intell. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5391\/IJFIS.2015.15.1.1","article-title":"Deep Level Situation Understanding for Casual Communication in Humans-Robots Interaction","volume":"15","author":"Tang","year":"2015","journal-title":"Int. J. Fuzzy Logic Intell. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1109\/TITB.2009.2036722","article-title":"Structural Action Recognition in Body Sensor Networks: Distributed Classification Based on String Matching","volume":"14","author":"Ghasemzadeh","year":"2010","journal-title":"Inf. Technol. Biomed."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1007\/978-3-642-21219-2_58","article-title":"Activity Recognition Using Hierarchical Hidden Markov Models on a Smartphone with 3D Accelerometer","volume":"6678","author":"Lee","year":"2011","journal-title":"Hybrid Artif. Intell. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Oh, S., Hoogs, A., Perera, A., Cuntoor, N., Chen, C.C., Lee, J.T., and Mukherjee, S. (2011, January 20\u201325). A Large-scale Benchmark Dataset for Event Recognition in Surveillance Video. Proceedings of the 24th IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2011.5995586"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"983","DOI":"10.1007\/s00371-012-0752-6","article-title":"A Survey on Activity Recognition and Behavior Understanding in Video Surveillance","volume":"29","author":"Vishwakarma","year":"2013","journal-title":"Visual Comput."},{"key":"ref_8","unstructured":"Jeong, Y.S., Oh, K.J., Kim, Z.M., Choi, H.J., and Iraqi, Y. (2015, January 4\u20137). Does Smartphone Possession-Way Prediction Help Action Recognition?. Proceedings of the 16th International Symposium on Advanced Intelligent Systems, Mokpo, Korea."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3343","DOI":"10.1016\/j.patcog.2014.04.018","article-title":"A survey on still image based human action recognition","volume":"47","author":"Gui","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Vu, T.H., Olsson, C., Laptev, I., Oliva, A., and Sivic, J. (2014, January 6\u201312). Predicting Actions from Static Scenes. Proceedings of the 13th European Conference of Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_28"},{"key":"ref_11","unstructured":"Zheng, Y., Zhang, Y.J., Li, X., and Liu, B.D. (October, January 30). Action recognition in still images using a combination of human pose and context information. Proceedings of the 19th IEEE Iternational Conference on Image Processing, Orlando, FL, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1016\/j.cviu.2013.01.013","article-title":"A survey of video datasets for human action and activity recognition","volume":"117","author":"Chaquet","year":"2013","journal-title":"Comput. Vision Image Understanding"},{"key":"ref_13","unstructured":"Simonyan, K., and Zisserman, A. (2014, January 8\u201313). Two-Stream Convolutional Networks for Action Recognition in Videos. Proceedings of the Annual Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1007\/s00138-012-0450-4","article-title":"Recognizing 50 human action categories of web videos","volume":"24","author":"Reddy","year":"2013","journal-title":"Mach. Vision Appl."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Xia, L., Chen, C.C., and Aggarwal, J.K. (2012, January 16\u201321). View Invariant Human Action Recognition Using Histograms of 3D Joints. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6239233"},{"key":"ref_16","unstructured":"Gao, L., Bourke, A.K., and Nelson, J. (September, January 30). A System for Activity Recognition Using Multi-Sensor Fusion. Proceedings of the 33rd Annual International Conference of the IEEE EMBS, Boston, MA, USA."},{"key":"ref_17","first-page":"1751","article-title":"A Wrist-Type Fall Detector with Statistical Classifier for the Elderly Care","volume":"5","author":"Park","year":"2011","journal-title":"KSII Trans. Internet Inf. Syst."},{"key":"ref_18","unstructured":"Lustrek, M., Gjoreski, H., Kozina, S., Cvetkovic, B., Mirchevska, V., and Gams, M. (2011, January 9\u201311). Detecting Falls with Location Sensors and Accelerometers. Proceedings of the 23rd Innovative Applications of Artificial Intelligence Conference, San Francisco, CA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1192","DOI":"10.1109\/SURV.2012.110112.00192","article-title":"A Survey on Human Activity Recognition using Wearable Sensors","volume":"15","author":"Lara","year":"2013","journal-title":"IEEE Commun. Surv. Tutorials"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kangas, M., Konttila, A., Winblad, I., and Jamsa, T. (2007, January 22\u201326). Determintation of Simple Thresholds for Accelerometry-based Parameters for Fall Detection. Proceedings of the 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Lyon, France.","DOI":"10.1109\/IEMBS.2007.4352552"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"17235","DOI":"10.3390\/s140917235","article-title":"Wearability Assessment of a Wearable System for Parkinson\u2019s Disease Remote Monitoring Based on a Body Area Network of Sensors","volume":"14","author":"Cancela","year":"2014","journal-title":"Sensors"},{"key":"ref_22","unstructured":"Digieco Mobile Trends for the First Half Year 2015. Available online: http:\/\/www.digieco.co.kr\/KTFront\/report\/report_issue_trend_view.action?board_id=issue_trend&board_seq=10349."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1007\/s00779-010-0292-x","article-title":"Mobile Phone-based Pervasive Fall Detection","volume":"14","author":"Dai","year":"2010","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4236\/etsn.2012.11001","article-title":"Falling-Incident Detection and Alarm by Smartphone with Multimedia Messaging Service (MMS)","volume":"1","author":"He","year":"2012","journal-title":"E Health Telecommun. Syst. Netw."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/978-3-642-15672-4_16","article-title":"User Behavior Pattern Analysis and Prediction Based on Mobile Phone Sensors","volume":"6289","author":"Song","year":"2010","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_26","unstructured":"Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. Learning Phrase Representations Using RNN Encoder-Decoder for Statistical Machine Translation. Available online: http:\/\/arxiv.org\/abs\/1406.1078."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer. [2nd ed.].","DOI":"10.1007\/978-0-387-84858-7"},{"key":"ref_29","unstructured":"Abu-Mostafa, Y., Magdon-Ismail, M., and Lin, H.T. (2012). Learning From Data, AMLBook."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kobayashi, T., Hasida, K., and Otsu, N. (2011, January 22\u201327). Rotation invariant feature extraction from 3-D acceleration signals. Proceedings of the 2011 IEEE International Conference on Acoustics, Speech and Signal Processing, Prague, Czech Republic.","DOI":"10.1109\/ICASSP.2011.5947150"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/6\/812\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:24:54Z","timestamp":1760210694000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/6\/812"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,6,2]]},"references-count":30,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2016,6]]}},"alternative-id":["s16060812"],"URL":"https:\/\/doi.org\/10.3390\/s16060812","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2016,6,2]]}}}