{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T11:42:28Z","timestamp":1781610148825,"version":"3.54.5"},"reference-count":52,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2020,3,6]],"date-time":"2020-03-06T00:00:00Z","timestamp":1583452800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Cognitive Application Program Interface (API) is an API of emerging artificial intelligence (AI)-based cloud services, which extracts various contextual information from non-numerical multimedia data including image and audio. Our interest is to apply image-based cognitive APIs to implement flexible and efficient context sensing services in a smart home. In the existing approach with machine learning by us, with the complexity of recognition object and the number of the defined contexts increases by users, it still requires directly manually labeling a moderate scale of data for training and continually try to calling multiple cognitive APIs for feature extraction. In this paper, we propose a novel method that uses a small scale of labeled data to evaluate the capability of cognitive APIs in advance, before training features of the APIs with machine learning, for the flexible and efficient home context sensing. In the proposed method, we exploit document similarity measures and the concepts (i.e., internal cohesion and external isolation) integrate into clustering results, to see how the capability of different cognitive APIs for recognizing each context. By selecting the cognitive APIs that relatively adapt to the defined contexts and data based on the evaluation results, we have achieved the flexible integration and efficient process of cognitive APIs for home context sensing.<\/jats:p>","DOI":"10.3390\/s20051442","type":"journal-article","created":{"date-parts":[[2020,3,6]],"date-time":"2020-03-06T09:26:41Z","timestamp":1583486801000},"page":"1442","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Toward Flexible and Efficient Home Context Sensing: Capability Evaluation and Verification of Image-Based Cognitive APIs"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9898-7370","authenticated-orcid":false,"given":"Sinan","family":"Chen","sequence":"first","affiliation":[{"name":"Graduate School of System Informatics, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sachio","family":"Saiki","sequence":"additional","affiliation":[{"name":"Graduate School of System Informatics, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Masahide","family":"Nakamura","sequence":"additional","affiliation":[{"name":"Graduate School of System Informatics, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan"},{"name":"RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo 103-0027, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,6]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"A Monitoring Support System for Elderly Person Living Alone through Activity Sensing in Living Space and Its Evaluation","volume":"2014","author":"Mai","year":"2014","journal-title":"IPSJ SIG Notes"},{"key":"ref_2","first-page":"7","article-title":"Capturing Activities of Daily Living for Elderly at Home based on Environment Change and Speech Dialog","volume":"116","author":"Tamamizu","year":"2017","journal-title":"IEICE Tech. Rep."},{"key":"ref_3","unstructured":"Alam, M.A.U. (2017, January 13\u201317). Context-aware multi-inhabitant functional and physiological health assessment in smart home environment. Proceedings of the 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), Kona, HI, USA."},{"key":"ref_4","first-page":"693","article-title":"Unobtrusive activity recognition of elderly people living alone using anonymous binary sensors and DCNN","volume":"23","author":"Gochoo","year":"2018","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"11312","DOI":"10.3390\/s150511312","article-title":"The elderly\u2019s independent living in smart homes: A characterization of activities and sensing infrastructure survey to facilitate services development","volume":"15","author":"Ni","year":"2015","journal-title":"Sensors"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Tanwar, S., Tyagi, S., and Kumar, N. (2020). Introduction to Multimedia Big Data Computing for IoT. Multimedia Big Data Computing for IoT Applications: Concepts, Paradigms and Solutions, Springer Singapore.","DOI":"10.1007\/978-981-13-8759-3"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Singh, A., and Mahapatra, S. (2020). Network-Based Applications of Multimedia Big Data Computing in IoT Environment. Multimedia Big Data Computing for IoT Applications, Springer.","DOI":"10.1007\/978-981-13-8759-3_17"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1007\/s10916-019-1158-z","article-title":"Smart home-based IoT for real-time and secure remote health monitoring of triage and priority system using body sensors: Multi-driven systematic review","volume":"43","author":"Talal","year":"2019","journal-title":"J. Med. Syst."},{"key":"ref_9","unstructured":"Microsoft Azure (2020, January 09). Object detection - Computer Vision\u2014Azure Cognitive Services | Microsoft Docs. Available online: https:\/\/docs.microsoft.com\/en-us\/azure\/cognitive-services\/computer-vision\/concept-object-detection."},{"key":"ref_10","unstructured":"IBM Cloud (2020, January 09). Speech to Text - IBM Cloud API Docs. Available online: https:\/\/cloud.ibm.com\/apidocs\/speech-to-text\/speech-to-text."},{"key":"ref_11","unstructured":"Google Cloud (2020, January 09). Cloud Natural Language API documentation. Available online: https:\/\/cloud.google.com\/natural-language\/docs\/."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Triemvitaya, N., Butsri, S., Temtanapat, Y., and Suksudaj, S. (2019, January 24\u201325). Sound Tooth: Mobile Oral Health Exam Recording Using Individual Voice Recognition. Proceedings of the 2019 4th International Conference on Information Technology (InCIT), Bangkok, Thailand.","DOI":"10.1109\/INCIT.2019.8911926"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Alexakis, G., Panagiotakis, S., Fragkakis, A., Markakis, E., and Vassilakis, K. (2019). Control of Smart Home Operations Using Natural Language Processing, Voice Recognition and IoT Technologies in a Multi-Tier Architecture. Designs, 3.","DOI":"10.3390\/designs3030032"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lee, H.T., Chen, R.C., and Chung, W.H. (2018). Combining Voice and Image Recognition for Smart Home Security System. International Conference on Frontier Computing, Springer.","DOI":"10.1007\/978-981-13-3648-5_25"},{"key":"ref_15","unstructured":"Microsoft (2019, December 26). Computer Vision | Microsoft Azure. Available online: https:\/\/azure.microsoft.com\/en-us\/services\/cognitive-services\/face\/."},{"key":"ref_16","unstructured":"IBM (2018, July 23). Watson Visual Recognition. Available online: https:\/\/www.ibm.com\/watson\/services\/visual-recognition\/."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chen, S., Saiki, S., and Nakamura, M. (2020). Integrating Multiple Models Using Image-as-Documents Approach for Recognizing Fine-Grained Home Contexts. Sensors, 20.","DOI":"10.3390\/s20030666"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"16","DOI":"10.2991\/ijndc.k.191118.001","article-title":"Towards Affordable and Practical Home Context Recognition: - Framework and Implementation with Image-based Cognitive API-","volume":"8","author":"Chen","year":"2019","journal-title":"Int. J. Netw. Distrib. Comput. (IJNDC)"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chen, S., Saiki, S., and Nakamura, M. (2018, January 7\u20138). Evaluating Feasibility of Image-Based Cognitive APIs for Home Context Sensing. Proceedings of the International Conference on Signal Processing and Information Security (ICSPIS 2018), Dubai, UAE.","DOI":"10.1109\/CSPIS.2018.8642772"},{"key":"ref_20","unstructured":"Kamishima, T. (2018, July 23). Clustering. Available online: http:\/\/www.kamishima.net\/archive\/clustering.pdf."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Muflikhah, L., and Baharudin, B. (2009, January 13\u201315). Document clustering using concept space and cosine similarity measurement. Proceedings of the 2009 International Conference on Computer Technology and Development, Kota Kinabalu, Malaysia.","DOI":"10.1109\/ICCTD.2009.206"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1007\/s10489-011-0314-z","article-title":"An enhanced Support Vector Machine classification framework by using Euclidean distance function for text document categorization","volume":"37","author":"Lee","year":"2012","journal-title":"Appl. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"321","DOI":"10.2307\/2344237","article-title":"A review of classification","volume":"134","author":"Cormack","year":"1971","journal-title":"J. R. Stat. Soc. Ser. A Gen."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1007\/BF02293907","article-title":"An examination of the effect of six types of error perturbation on fifteen clustering algorithms","volume":"45","author":"Milligan","year":"1980","journal-title":"Psychometrika"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1007\/BF02293899","article-title":"A Monte Carlo study of thirty internal criterion measures for cluster analysis","volume":"46","author":"Milligan","year":"1981","journal-title":"Psychometrika"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF02294153","article-title":"An algorithm for generating artificial test clusters","volume":"50","author":"Milligan","year":"1985","journal-title":"Psychometrika"},{"key":"ref_27","unstructured":"Wagstaff, K., Cardie, C., Rogers, S., and Schr\u00f6dl, S. (July, January 28). Constrained k-means clustering with background knowledge. Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001), Williamstown, MA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"790","DOI":"10.1109\/34.400568","article-title":"Mean shift, mode seeking, and clustering","volume":"17","author":"Cheng","year":"1995","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Tax, N., Sidorova, N., Haakma, R., and van der Aalst, W.M. (2018, January 25\u201328). Mining local process models with constraints efficiently: Applications to the analysis of smart home data. Proceedings of the 2018 14th International Conference on Intelligent Environments (IE), Rome, Italy.","DOI":"10.1109\/IE.2018.00016"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1504\/IJSNET.2016.074701","article-title":"A distributed and efficient system architecture for smart home","volume":"20","author":"Hu","year":"2016","journal-title":"Int. J. Sens. Netw."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1109\/MCOM.2016.7470945","article-title":"Toward software defined smart home","volume":"54","author":"Xu","year":"2016","journal-title":"IEEE Commun. Mag."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Copos, B., Levitt, K., Bishop, M., and Rowe, J. (2016, January 22\u201326). Is anybody home? Inferring activity from smart home network traffic. Proceedings of the 2016 IEEE Security and Privacy Workshops (SPW), San Jose, CA, USA.","DOI":"10.1109\/SPW.2016.48"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Stojkoska, B.R., and Trivodaliev, K. (2017, January 21\u201322). Enabling internet of things for smart homes through fog computing. Proceedings of the 2017 25th Telecommunication Forum (TELFOR), Belgrade, Serbia.","DOI":"10.1109\/TELFOR.2017.8249316"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Roelleke, T., and Wang, J. (2008). TF-IDF Uncovered: A Study of Theories and Probabilities. Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM. SIGIR \u201908.","DOI":"10.1145\/1390334.1390409"},{"key":"ref_35","unstructured":"Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013, January 2\u20134). Efficient Estimation of Word Representations in Vector Space. Proceedings of the Workshop at International Conference on Learning Representations (ICLR 2013), Scottsdale, Arizona."},{"key":"ref_36","unstructured":"Le, Q., and Mikolov, T. (2014, January 22\u201324). Distributed Representations of Sentences and Documents. Proceedings of the ICML\u201914\u201431st International Conference on International Conference on Machine Learning\u2014Volume 32, Bejing, China."},{"key":"ref_37","unstructured":"Pennington, J., Socher, R., and Manning, C.D. (2019, April 15). GloVe: Global Vectors for Word Representation. Available online: https:\/\/nlp.stanford.edu\/projects\/glove\/."},{"key":"ref_38","unstructured":"Research, F. (2019, April 15). fastText: A library for efficient learning of word representations and sentence classification. Available online: https:\/\/github.com\/facebookresearch\/fastText."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.mcm.2010.07.022","article-title":"Cosine similarity measures for intuitionistic fuzzy sets and their applications","volume":"53","author":"Ye","year":"2011","journal-title":"Math. Comput. Model."},{"key":"ref_40","unstructured":"Yen, L., Vanvyve, D., Wouters, F., Fouss, F., Verleysen, M., and Saerens, M. (2005, January 27\u201329). Clustering using a random walk based distance measure. Proceedings of the ESANN, Bruges, Belgium."},{"key":"ref_41","unstructured":"Huang, A. (2008, January 14\u201318). Similarity measures for text document clustering. Proceedings of the Sixth New Zealand Computer Science Research Sudent Conference (NZCSRSC2008), Christchurch, New Zealand."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1080\/0094965031000136012","article-title":"A new partitioning around medoids algorithm","volume":"73","author":"Pollard","year":"2003","journal-title":"J. Stat. Comput. Simul."},{"key":"ref_43","unstructured":"Sheikholeslami, G., Chatterjee, S., and Zhang, A. (1998, January 24\u201327). Wavecluster: A multi-resolution clustering approach for very large spatial databases. Proceedings of the VLDB, New York, NY, USA."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1565","DOI":"10.1038\/nbt1206-1565","article-title":"What is a support vector machine?","volume":"24","author":"Noble","year":"2006","journal-title":"Nat. Biotechnol."},{"key":"ref_45","unstructured":"Anderson, D.Z. (1988). Supervised Learning of Probability Distributions by Neural Networks. Neural Information Processing Systems, American Institute of Physics."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1593","DOI":"10.1039\/b907946g","article-title":"Supervised learning with decision tree-based methods in computational and systems biology","volume":"5","author":"Geurts","year":"2009","journal-title":"Mol. Biosyst."},{"key":"ref_47","unstructured":"Microsoft (2019, November 27). Computer Vision | Microsoft Azure. Available online: https:\/\/azure.microsoft.com\/en-us\/services\/cognitive-services\/computer-vision\/."},{"key":"ref_48","unstructured":"Clarifai (2019, April 15). Enterprise AI Powered Computer Vision Solutions | Clarifai. Available online: https:\/\/clarifai.com\/."},{"key":"ref_49","unstructured":"Imagga (2019, April 15). Imagga API. Available online: https:\/\/docs.imagga.com\/."},{"key":"ref_50","unstructured":"ParallelDots (2019, April 15). Image Recognition. Available online: https:\/\/www.paralleldots.com\/object-recognizer."},{"key":"ref_51","unstructured":"Arthur, D., and Vassilvitskii, S. (2006). k-Means++: The advantages of Careful Seeding, Stanford InfoLab Publication Server. Technical Report, Stanford."},{"key":"ref_52","unstructured":"(2019, February 01). Azure Machine Learning Studio. Available online: https:\/\/azure.microsoft.com\/ja-jp\/services\/machine-learning-studio\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/5\/1442\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:04:47Z","timestamp":1760173487000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/5\/1442"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,6]]},"references-count":52,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["s20051442"],"URL":"https:\/\/doi.org\/10.3390\/s20051442","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,6]]}}}