{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:16:29Z","timestamp":1760242589409,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2017,12,1]],"date-time":"2017-12-01T00:00:00Z","timestamp":1512086400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>This paper presents a robotic sensing system that evaluates the texture of gel-like food, in which not only mechanical characteristics, but also geometrical characteristics of the texture are objectively and quantitatively evaluated. When a human chews a gel-like food, the person perceives the changes in the shape and contact force simultaneously on the tongue. Based on their impression, they evaluate the texture. To reproduce this procedure using a simple artificial mastication robot, the pressure distribution of the gel-like food is measured, and the information associated with both the geometrical and mechanical characteristics is simultaneously acquired. The relationship between the value of the human sensory evaluation of the texture and the pressure distribution image is then modeled by applying a convolutional neural network. Experimental results show that the proposed system succeeds in estimating the values of a human sensory evaluation for 23 types of gel-like food with a coefficient of determination greater than 0.92.<\/jats:p>","DOI":"10.3390\/robotics6040037","type":"journal-article","created":{"date-parts":[[2017,12,1]],"date-time":"2017-12-01T12:30:16Z","timestamp":1512131416000},"page":"37","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Convolutional Neural Network based Estimation of Gel-like Food Texture by a Robotic Sensing System"],"prefix":"10.3390","volume":"6","author":[{"given":"Akihide","family":"Shibata","sequence":"first","affiliation":[{"name":"Department of Mechanical Engineering, Graduate School of Engineering, Osaka University, 2-1 Yamadaoka, Suita 565-0871, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Akira","family":"Ikegami","sequence":"additional","affiliation":[{"name":"San-Ei Gen F.F.I., Inc., 1-1-11 Sanwa-cho, Toyonaka 561-8588, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Makoto","family":"Nakauma","sequence":"additional","affiliation":[{"name":"San-Ei Gen F.F.I., Inc., 1-1-11 Sanwa-cho, Toyonaka 561-8588, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mitsuru","family":"Higashimori","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, Graduate School of Engineering, Osaka University, 2-1 Yamadaoka, Suita 565-0871, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,12,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1109\/TOH.2011.2","article-title":"Tactile and Haptic Illusions","volume":"4","author":"Lederman","year":"2011","journal-title":"IEEE Trans. Haptics"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Jimenez, M.C., and Fishel, J.A. (2014, January 23\u201326). Evaluation of force, vibration and thermal tactile feedback in prosthetic limbs. Proceedings of the IEEE Haptics Symposium, Houston, TX, USA.","DOI":"10.1109\/HAPTICS.2014.6775495"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1109\/TOH.2010.4","article-title":"Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound","volume":"3","author":"Hoshi","year":"2010","journal-title":"IEEE Trans. Haptics"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"99","DOI":"10.3136\/fstr.15.99","article-title":"Texture and Rheology in Food and Health","volume":"15","author":"Nishinari","year":"2009","journal-title":"Food Sci. Technol. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1016\/j.foodhyd.2011.03.010","article-title":"Next Target for Food Hydrocolloid Studies: Texture Design of Foods Using Hydrocolloid Technology","volume":"25","author":"Funami","year":"2011","journal-title":"Food Hydrocoll."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1111\/j.1745-4603.2004.tb00828.x","article-title":"Rheology, Food Texture and Mastication","volume":"35","author":"Nishinari","year":"2004","journal-title":"J. Texture Stud."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1111\/j.1745-4603.2008.00157.x","article-title":"Comparative Study of Texture Terms: English, French, Japanese and Chinese","volume":"39","author":"Nishinari","year":"2008","journal-title":"J. Texture Stud."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/S0950-3293(01)00039-8","article-title":"Texture is a Sensory Property","volume":"13","author":"Szczesniak","year":"2002","journal-title":"Food Qual. Preference"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bourne, M.C. (2002). Food Texture and Viscosity, Second Edition: Concept and Measurement, Academic Press.","DOI":"10.1016\/B978-012119062-0\/50001-2"},{"key":"ref_10","unstructured":"(2017, November 24). Stable Micro Systems Ltd.. Available online: http:\/\/www.stablemicrosystems.com\/."},{"key":"ref_11","unstructured":"(2017, November 24). Illinois Tool Works Inc.. Available online: http:\/\/www.instron.com\/."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Iwata, H., Yano, H., Uemura, T., and Moriya, T. (2004, January 27\u201328). Food Texture Display. Proceedings of the 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, Chicago, IL, USA.","DOI":"10.1109\/HAPTIC.2004.1287214"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sun, C., Bronlund, J.E., Huang, L., Morgenstern, M.P., and Xu, W.L. (2008, January 2\u20134). A Linkage Chewing Machine for Food Texture Analysis. Proceedings of the 15th International Conference on Mechatronics and Machine Vision in Practice, Auckland, New Zealand.","DOI":"10.1109\/MMVIP.2008.4749550"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2121","DOI":"10.1109\/TIE.2008.918641","article-title":"Kinematics and Experiments of a Life-Sized Masticatory Robot for Characterizing Food Texture","volume":"55","author":"Xu","year":"2008","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1017\/S0007114598001494","article-title":"Physical and Chemical Transformations of Cereal Food During Oral Digestion in Human Subjects","volume":"80","author":"Hoebler","year":"1998","journal-title":"Br. J. Nutr."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","article-title":"Textural Features for Image Classification","volume":"SMC-3","author":"Haralick","year":"1973","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3245","DOI":"10.1021\/jf073145z","article-title":"Effect of Apple Particle State on the Release of Volatile Compounds in a New Artificial Mouth Device","volume":"56","author":"Arvisenet","year":"2008","journal-title":"J. Agric. Food Chem."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1016\/j.jfoodeng.2012.07.015","article-title":"Characterization of Bread Breakdown During Mastication by Image Texture Analysis","volume":"113","author":"Tournier","year":"2012","journal-title":"J. Food Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"922","DOI":"10.1111\/j.1365-2621.1997.tb15007.x","article-title":"Measuring Texture of Crackers with a Multiple-Point Sheet Sensor","volume":"62","author":"Kohyama","year":"1997","journal-title":"J. Food Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1016\/j.jfoodeng.2006.11.021","article-title":"Characterization of Spatiotemporal Stress Distribution During Food Fracture by Image Texture Analysis Methods","volume":"81","author":"Dan","year":"2007","journal-title":"J. Food Eng."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yamamoto, T., Higashimori, M., Nakauma, M., Nakao, S., Ikegami, A., and Ishihara, S. (2014, January 27\u201331). Pressure Distribution-Based Texture Sensing by Using a Simple Artificial Mastication System. Proceedings of the 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA.","DOI":"10.1109\/EMBC.2014.6943728"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Johnson, M.K., and Adelson, E.H. (2009, January 20\u201325). Retrographic sensing for the measurement of surface texture and shape. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206534"},{"key":"ref_23","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the Advances in Neural Information Processing Systems 25 (NIPS 2012), Lake Tahoe, NV, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_25","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going Deeper with Convolutions. Proceedings of the CVPR2015, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the CVPR2016, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_28","unstructured":"(2017, November 24). I-Scan System. Available online: http:\/\/www.tekscan.com\/products-solutions\/systems\/i-scan-system."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Tran, D., Bourdev, L., Fergus, R., Torresani, L., and Paluri, M. (2015, January 7\u201313). Learning Spatiotemporal Features With 3D Convolutional Networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Washington, DC, USA.","DOI":"10.1109\/ICCV.2015.510"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Saitoh, T., Zhou, Z., Zhao, G., and Pietikainen, M. (2016, January 20\u201324). Concatenated Frame Image Based CNN for Visual Speech Recognition. Proceedings of the Computer Vision \u2013 ACCV 2016 Workshops Part II, Taipei, Taiwan.","DOI":"10.1007\/978-3-319-54427-4_21"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1002\/nur.4770130405","article-title":"A Critical Review of Visual Analogue Scales in the Measurement of Clinical Phenomena","volume":"13","author":"Wewers","year":"1990","journal-title":"Res. Nurs. Health"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1214\/09-SS054","article-title":"A Survey of Cross-Validation Procedures for Model Selection","volume":"4","author":"Arlot","year":"2010","journal-title":"Stat. Surv."},{"key":"ref_33","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/6\/4\/37\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:52:07Z","timestamp":1760208727000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/6\/4\/37"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,1]]},"references-count":33,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2017,12]]}},"alternative-id":["robotics6040037"],"URL":"https:\/\/doi.org\/10.3390\/robotics6040037","relation":{},"ISSN":["2218-6581"],"issn-type":[{"type":"electronic","value":"2218-6581"}],"subject":[],"published":{"date-parts":[[2017,12,1]]}}}