{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T17:53:23Z","timestamp":1775757203628,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2021,10,10]],"date-time":"2021-10-10T00:00:00Z","timestamp":1633824000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>To capture scientific evidence in elderly care, a user-defined facial expression sensing service was proposed in our previous study. Since the time-series data of feature values have been growing at a high rate as the measurement time increases, it may be difficult to find points of interest, especially for detecting changes from the elderly facial expression, such as many elderly people can only be shown in a micro facial expression due to facial wrinkles and aging. The purpose of this paper is to implement a method to efficiently find points of interest (PoI) from the facial feature time-series data of the elderly. In the proposed method, the concept of changing point detection into the analysis of feature values is incorporated by us, to automatically detect big fluctuations or changes in the trend in feature values and detect the moment when the subject\u2019s facial expression changed significantly. Our key idea is to introduce the novel concept of composite feature value to achieve higher accuracy and apply change-point detection to it as well as to single feature values. Furthermore, the PoI finding results from the facial feature time-series data of young volunteers and the elderly are analyzed and evaluated. By the experiments, it is found that the proposed method is able to capture the moment of large facial movements even for people with micro facial expressions and obtain information that can be used as a clue to investigate their response to care.<\/jats:p>","DOI":"10.3390\/s21206726","type":"journal-article","created":{"date-parts":[[2021,10,10]],"date-time":"2021-10-10T21:37:49Z","timestamp":1633901869000},"page":"6726","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Toward Capturing Scientific Evidence in Elderly Care: Efficient Extraction of Changing Facial Feature Points"],"prefix":"10.3390","volume":"21","author":[{"given":"Kosuke","family":"Hirayama","sequence":"first","affiliation":[{"name":"Graduate School of System Informatics, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9898-7370","authenticated-orcid":false,"given":"Sinan","family":"Chen","sequence":"additional","affiliation":[{"name":"Graduate School of System Informatics, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sachio","family":"Saiki","sequence":"additional","affiliation":[{"name":"Department of Data & Innovation, Kochi University of Technology, 185 Miyanigutu, Tosayamada-cho, Kami-shi 782-8502, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Masahide","family":"Nakamura","sequence":"additional","affiliation":[{"name":"Graduate School of System Informatics, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan"},{"name":"RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo 103-0027, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,10]]},"reference":[{"key":"ref_1","unstructured":"Okamura, H. (2016). Mainstreaming Gender and Aging in the SDGs, Ambassador and Deputy Representative of Japan to the United Nations. At a Side Event to the High Level Political Forum."},{"key":"ref_2","unstructured":"(2021, September 15). For Japan\u2019s Economic Revitalization (No.26), H. Future Investment Strategy (2017). Available online: http:\/\/www.kantei.go.jp\/jp\/singi\/keizaisaisei\/dai26\/siryou.pdf."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1111\/j.1532-5415.2005.53175.x","article-title":"Care-needs certification in the long-term care insurance system of Japan","volume":"53","author":"Tsutsui","year":"2005","journal-title":"J. Am. Geriatr. Soc."},{"key":"ref_4","first-page":"e320","article-title":"Facial expressions","volume":"16","author":"Ekman","year":"1999","journal-title":"Handb. Cogn. Emot."},{"key":"ref_5","first-page":"46","article-title":"Universal facial expressions of emotion","volume":"Volume 27","author":"Segerstrale","year":"1997","journal-title":"Nonverbal Communication: Where Nature Meets Culture"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1111\/1467-9280.00221","article-title":"Unconscious facial reactions to emotional facial expressions","volume":"11","author":"Dimberg","year":"2000","journal-title":"Psychol. Sci."},{"key":"ref_7","unstructured":"Ekman, P., and Friesen, W.V. (1975). Unmasking the Face, Spectrum-Prentice Hall."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1007\/s11277-020-07224-2","article-title":"Real Time Automatic Attendance System for Face Recognition Using Face API and OpenCV","volume":"113","author":"Khan","year":"2020","journal-title":"Wirel. Pers. Commun."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kim, H., Kim, T., and Kim, P. (2018, January 11\u201313). Interest Recommendation System Based on Dwell Time Calculation Utilizing Azure Face API. Proceedings of the 2018 International Conference on Computer, Information and Telecommunication Systems (CITS), Colmar, France.","DOI":"10.1109\/CITS.2018.8440148"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.comppsych.2013.10.002","article-title":"Expressed emotion in anorexia nervosa: What is inside the \u201cblack box\u201d?","volume":"55","author":"Duclos","year":"2014","journal-title":"Compr. Psychiatry"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Liu, B., Fu, Y., Yao, Z., and Xiong, H. (2013, January 11\u201314). Learning geographical preferences for point-of-interest recommendation. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, IL, USA.","DOI":"10.1145\/2487575.2487673"},{"key":"ref_12","unstructured":"Yuan, Q., Cong, G., Ma, Z., Sun, A., and Thalmann, N.M. (August, January 28). Time-aware point-of-interest recommendation. Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, Dublin, Ireland."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Gao, H., Tang, J., Hu, X., and Liu, H. (2015, January 25\u201330). Content-aware point of interest recommendation on location-based social networks. Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9462"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Hirayama, K., Saiki, S., Nakamura, M., and Yasuda, K. (2020, January 23\u201327). Capturing User-defined Facial Features for Scientific Evidence of Elderly Care. Proceedings of the 2020 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), Austin, TX, USA.","DOI":"10.1109\/PerComWorkshops48775.2020.9156106"},{"key":"ref_15","unstructured":"Lee, B., Erdenee, E., Jin, S., Nam, M.Y., Jung, Y.G., and Rhee, P.K. Multi-class multi-object tracking using changing point detection. Proceedings of the European Conference on Computer Vision."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Miranda, V., and Zhao, L. (2019). Topological Data Analysis for Time Series Changing Point Detection. Proceedings of the International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, Springer.","DOI":"10.1007\/978-3-030-32591-6_21"},{"key":"ref_17","first-page":"895","article-title":"A Survey on Anomaly Detection for Discovering Emerging Topics","volume":"3","author":"Saranya","year":"2014","journal-title":"Int. J. Comput. Sci. Mob. Comput. (IJCSMC)"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1080\/00207549308956807","article-title":"Composite feature and variational design concepts in a feature-based design system","volume":"31","author":"Li","year":"1993","journal-title":"Int. J. Prod. Res."},{"key":"ref_19","first-page":"163","article-title":"Development of an objective evaluation method for the nursing-care education based on facial expression analysis","volume":"1","author":"Sato","year":"2010","journal-title":"Med. Health Sci. Res. Bull. Tsukuba Int. Univ."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Moniz, A., Gordon, M., Bergum, I., Chang, M., and Grant, G. (2021). Introducing Cognitive Services. Beginning Azure Cognitive Services, Springer.","DOI":"10.1007\/978-1-4842-7176-6"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kasaei, S., Sock, J., Lopes, L.S., Tom\u00e9, A.M., and Kim, T.K. (2018, January 2\u20137). Perceiving, learning, and recognizing 3d objects: An approach to cognitive service robots. Proceedings of the AAAI Conference on Artificial Intelligence, Hilton, New Orleans Riverside, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11319"},{"key":"ref_22","unstructured":"Mertes, C., Yang, J., Hammerschmidt, J., and Hermann, T. (2016). Challenges for Smart Environments in Bathroom Contexts-Video and Sound Example, Bielefeld University."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"e4275","DOI":"10.1002\/cpe.4275","article-title":"Linguistic techniques for cryptographic data sharing algorithms","volume":"30","author":"Ogiela","year":"2018","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"19774","DOI":"10.1109\/ACCESS.2018.2791469","article-title":"Cognitive computing: Architecture, technologies and intelligent applications","volume":"6","author":"Chen","year":"2018","journal-title":"IEEE Access"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Chen, S., Saiki, S., and Nakamura, M. (2019, January 8\u201311). Proposal of home context recognition method using feature values of cognitive API. Proceedings of the 2019 20th IEEE\/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel\/Distributed Computing (SNPD), Toyama, Japan.","DOI":"10.1109\/SNPD.2019.8935793"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"16","DOI":"10.2991\/ijndc.k.191118.001","article-title":"Toward Affordable and Practical Home Context Recognition: Framework and Implementation with Image-based Cognitive API","volume":"8","author":"Chen","year":"2019","journal-title":"Int. J. Netw. Distrib. Comput."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chen, S., Saiki, S., and Nakamura, M. (2020). Integrating Multiple Models Using Image-as-Documents Approach for Recognizing Fine-Grained Home Contexts. Sensors, 20.","DOI":"10.3390\/s20030666"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Chen, S., Saiki, S., and Nakamura, M. (2020). Toward flexible and efficient home context sensing: Capability evaluation and verification of image-based cognitive APIs. Sensors, 20.","DOI":"10.3390\/s20051442"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Sako, A., Saiki, S., Nakamura, M., and Yasuda, K. (2018, January 15\u201320). Developing Face Emotion Tracker for Quantitative Evaluation of Care Effects. Proceedings of the Digital Human Modeling 2018 (DHM 2018), Held as Part of HCI International 2018, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-319-91397-1_41"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"30","DOI":"10.4018\/IJSI.2017010103","article-title":"VirtualCareGiver: Personalized Smart Elderly Care","volume":"5","author":"Tokunaga","year":"2016","journal-title":"Int. J. Softw. Innov. (IJSI)"},{"key":"ref_31","unstructured":"Azure, M. (2021, August 30). Face API-Facial Recognition Software | Microsoft Azure. Available online: https:\/\/azure.microsoft.com\/en-us\/services\/cognitive-services\/face\/."},{"key":"ref_32","unstructured":"Asgarian, A., Zhao, S., Ashraf, A.B., Browne, M.E., Prkachin, K.M., Mihailidis, A., Hadjistavropoulos, T., and Taati, B. (2019, January 15). Limitations and Biases in Facial Landmark Detection D an Empirical Study on Older Adults with Dementia. Proceedings of the CVPR Workshops, Long Beach, CA, USA."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2019\/4172569","article-title":"Effects of mnemonic strategy training on brain activity and cognitive functioning of left-hemisphere ischemic stroke patients","volume":"2019","author":"Batista","year":"2019","journal-title":"Neural Plast."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Bandini, A., Green, J.R., Taati, B., Orlandi, S., Zinman, L., and Yunusova, Y. (2018, January 15\u201319). Automatic detection of amyotrophic lateral sclerosis (ALS) from video-based analysis of facial movements: Speech and non-speech tasks. Proceedings of the 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00031"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.jneumeth.2017.02.006","article-title":"Analysis of facial expressions in parkinson\u2019s disease through video-based automatic methods","volume":"281","author":"Bandini","year":"2017","journal-title":"J. Neurosci. Methods"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Guralnik, V., and Srivastava, J. (1999, January 15\u201318). Event detection from time series data. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, CA, USA.","DOI":"10.1145\/312129.312190"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Yamanishi, K., and Takeuchi, J. (2002, January 23\u201326). A Unifying Framework for Detecting Outliers and Change Points from Non-Stationary Time Series Data. Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Edmonton, AB, Canada.","DOI":"10.1145\/775047.775148"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Yamanishi, K., and Takeuchi, J. (2001, January 26\u201329). Discovering Outlier Filtering Rules from Unlabeled Data: Combining a Supervised Learner with an Unsupervised Learner. Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/502512.502570"},{"key":"ref_39","unstructured":"Yamanishi, K. (2009). Anomaly Detection with Data Mining, Kyoritsu Shuppan Co., Ltd."},{"key":"ref_40","first-page":"20","article-title":"Facial expression analysis: Comparison with results of Paul Ekman","volume":"3","author":"Ohta","year":"2005","journal-title":"J. Nurs. Shiga Univ. Med Sci."},{"key":"ref_41","unstructured":"(2021, September 15). GitHub-Shunsukeaihara\/Changefinder. Available online: https:\/\/github.com\/shunsukeaihara\/changefinder."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/20\/6726\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:11:21Z","timestamp":1760166681000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/20\/6726"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,10]]},"references-count":41,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["s21206726"],"URL":"https:\/\/doi.org\/10.3390\/s21206726","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,10]]}}}