{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T07:08:06Z","timestamp":1770275286290,"version":"3.49.0"},"reference-count":35,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2017,6,10]],"date-time":"2017-06-10T00:00:00Z","timestamp":1497052800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Active and Assisted Living ( AAL) programme","award":["HELICOPTER"],"award-info":[{"award-number":["HELICOPTER"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>A balanced diet is the key to a healthy lifestyle and is crucial for preventing or dealing with many chronic diseases such as diabetes and obesity. Therefore, monitoring diet can be an effective way of improving people\u2019s health. However, manual reporting of food intake has been shown to be inaccurate and often impractical. This paper presents a new approach to food intake quantity estimation using image-based modeling. The modeling method consists of three steps: firstly, a short video of the food is taken by the user\u2019s smartphone. From such a video, six frames are selected based on the pictures\u2019 viewpoints as determined by the smartphone\u2019s orientation sensors. Secondly, the user marks one of the frames to seed an interactive segmentation algorithm. Segmentation is based on a Gaussian Mixture Model alongside the graph-cut algorithm. Finally, a customized image-based modeling algorithm generates a point-cloud to model the food. At the same time, a stochastic object-detection method locates a checkerboard used as size\/ground reference. The modeling algorithm is optimized such that the use of six input images still results in an acceptable computation cost. In our evaluation procedure, we achieved an average accuracy of     92 %     on a test set that includes images of different kinds of pasta and bread, with an average processing time of about 23 s.<\/jats:p>","DOI":"10.3390\/a10020066","type":"journal-article","created":{"date-parts":[[2017,6,12]],"date-time":"2017-06-12T10:27:59Z","timestamp":1497263279000},"page":"66","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["A New Approach to Image-Based Estimation of Food Volume"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9578-1975","authenticated-orcid":false,"given":"Hamid","family":"Hassannejad","sequence":"first","affiliation":[{"name":"Dipartimento di Ingegneria dell\u2019Informazione, Universit\u00e0 degli Studi di Parma, 43124 Parma, Italy"}]},{"given":"Guido","family":"Matrella","sequence":"additional","affiliation":[{"name":"Dipartimento di Ingegneria dell\u2019Informazione, Universit\u00e0 degli Studi di Parma, 43124 Parma, Italy"}]},{"given":"Paolo","family":"Ciampolini","sequence":"additional","affiliation":[{"name":"Dipartimento di Ingegneria dell\u2019Informazione, Universit\u00e0 degli Studi di Parma, 43124 Parma, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9872-1695","authenticated-orcid":false,"given":"Ilaria","family":"Munari","sequence":"additional","affiliation":[{"name":"Dipartimento di Ingegneria dell\u2019Informazione, Universit\u00e0 degli Studi di Parma, 43124 Parma, Italy"}]},{"given":"Monica","family":"Mordonini","sequence":"additional","affiliation":[{"name":"Dipartimento di Ingegneria dell\u2019Informazione, Universit\u00e0 degli Studi di Parma, 43124 Parma, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4669-512X","authenticated-orcid":false,"given":"Stefano","family":"Cagnoni","sequence":"additional","affiliation":[{"name":"Dipartimento di Ingegneria dell\u2019Informazione, Universit\u00e0 degli Studi di Parma, 43124 Parma, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2017,6,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1111\/j.1467-789X.2011.00936.x","article-title":"Selected eating behaviours and excess body weight: A systematic review","volume":"13","author":"Mesas","year":"2012","journal-title":"Obes. Rev."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"895S","DOI":"10.1093\/jn\/133.3.895S","article-title":"Markers of the validity of reported energy intake","volume":"133","author":"Livingstone","year":"2003","journal-title":"J. Nutr."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/0026-0495(95)90204-X","article-title":"Limitations in the assessment of dietary energy intake by self-report","volume":"44","author":"Schoeller","year":"1995","journal-title":"Metabolism"},{"key":"ref_4","first-page":"52","article-title":"Short-term dietary recall and recording methods","volume":"4","author":"Witschi","year":"1990","journal-title":"Nutr. Epidemiol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hassannejad, H., Matrella, G., Ciampolini, P., De Munari, I., Mordonini, M., and Cagnoni, S. (2017). Automatic diet monitoring: A review of computer vision and wearable sensor-based methods. Int. J. Food Sci. Nutr.","DOI":"10.1080\/09637486.2017.1283683"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Martin, C.K., Kaya, S., and Gunturk, B.K. (2009, January 3\u20136). Quantification of food intake using food image analysis. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA.","DOI":"10.1109\/IEMBS.2009.5333123"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Xu, C., He, Y., Khannan, N., Parra, A., Boushey, C., and Delp, E. (2013, January 21). Image-based food volume estimation. Proceedings of the 5th International Workshop on Multimedia for Cooking & Eating Activities, Barcelona, Spain.","DOI":"10.1145\/2506023.2506037"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Almaghrabi, R., Villalobos, G., Pouladzadeh, P., and Shirmohammadi, S. (2012, January 13\u201316). A novel method for measuring nutrition intake based on food image. Proceedings of the 2012 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Graz, Austria.","DOI":"10.1109\/I2MTC.2012.6229581"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Puri, M., Zhu, Z., Yu, Q., Divakaran, A., and Sawhney, H. (2009, January 7\u20138). Recognition and volume estimation of food intake using a mobile device. Proceedings of the 2009 IEEE Workshop on Applications of Computer Vision (WACV), Snowbird, UT, USA.","DOI":"10.1109\/WACV.2009.5403087"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Dehais, J., Shevchik, S., Diem, P., and Mougiakakou, S.G. (2013, January 10\u201313). Food volume computation for self dietary assessment applications. Proceedings of the 2013 IEEE 13th International Conference on Bioinformatics and Bioengineering (BIBE), Chania, Greece.","DOI":"10.1109\/BIBE.2013.6701615"},{"key":"ref_11","unstructured":"Hassannejad, H., Matrella, G., Mordonini, M., Cagnoni, S., and Hassannejad, H. (2015, January 19\u201322). A Mobile App for Food Detection: New approach to interactive segmentation. Proceedings of the FORITAAL Conference, Lecco, Italy."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Hassannejad, H., Matrella, G., Mordonini, M., and Cagnoni, S. (2015). Using Small Checkerboards as Size Reference: A Model-Based Approach. New Trends in Image Analysis and Processing\u2013ICIAP 2015 Workshops, Springer.","DOI":"10.1007\/978-3-319-23222-5_48"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1109\/JSTSP.2010.2051471","article-title":"The use of mobile devices in aiding dietary assessment and evaluation","volume":"4","author":"Zhu","year":"2010","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Dehais, J., Anthimopoulos, M., and Mougiakakou, S. (2015). Dish Detection and Segmentation for Dietary Assessment on Smartphones. New Trends in Image Analysis and Processing\u2013ICIAP 2015 Workshops, Springer.","DOI":"10.1007\/978-3-319-23222-5_53"},{"key":"ref_15","unstructured":"Eskin, Y., and Mihailidis, A. (2012, January 2\u20134). An intelligent nutritional assessment system. In Proceedings of the 2012 AAAI Fall Symposium Series, Arlington, VA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1109\/JBHI.2014.2304925","article-title":"Multiple hypotheses image segmentation and classification with application to dietary assessment","volume":"19","author":"Zhu","year":"2015","journal-title":"IEEE J. Biomed. Health Inf."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kawano, Y., and Yanai, K. (2014). Foodcam: A real-time mobile food recognition system employing fisher vector. MultiMedia Modeling, Springer.","DOI":"10.1007\/978-3-319-04117-9_38"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Yanai, K., and Kawano, Y. (July, January 29). Food image recognition using deep convolutional network with pre-training and fine-tuning. Proceedings of the 2015 IEEE International Conference on Multimedia &, Expo Workshops (ICMEW), Turin, Italy.","DOI":"10.1109\/ICMEW.2015.7169816"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1941","DOI":"10.1016\/j.patcog.2013.12.006","article-title":"A mobile, lightweight, poll-based food identification system","volume":"47","author":"Oliveira","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2079","DOI":"10.1109\/TPAMI.2007.1128","article-title":"Dynamic graph cuts for efficient inference in markov random fields","volume":"29","author":"Kohli","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","unstructured":"Bishop, C. (2007). Pattern Recognition and Machine Learning, Springer Science."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Rahman, M.H., Li, Q., Pickering, M., Frater, M., Kerr, D., Bouchey, C., and Delp, E. (2012, January 25\u201329). Food volume estimation in a mobile phone based dietary assessment system. Proceedings of the 2012 IEEE Eighth International Conference on Signal Image Technology and Internet Based Systems (SITIS), Naples, Italy.","DOI":"10.1109\/SITIS.2012.146"},{"key":"ref_23","unstructured":"(2017, June 07). OpenCV. Available online: http:\/\/opencv.org\/."},{"key":"ref_24","first-page":"341","article-title":"Differential evolution\u2014A simple and efficient adaptive scheme for global optimization over continuous spaces","volume":"3","author":"Storn","year":"1995","journal-title":"J. Glob. Optim."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3092","DOI":"10.1016\/j.asoc.2012.11.027","article-title":"Particle swarm optimization and differential evolution for model-based object detection","volume":"13","author":"Ugolotti","year":"2013","journal-title":"Appl. Soft Comput."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lawson, C.L., and Hanson, R.J. (1995). Solving Least Squares Problems, SIAM.","DOI":"10.1137\/1.9781611971217"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s11263-007-0107-3","article-title":"Modeling the world from internet photo collections","volume":"80","author":"Snavely","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_28","unstructured":"Baggio, D.L. (2012). Mastering OpenCV with Practical Computer Vision Projects, Packt Publishing Ltd."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011, January 6\u201313). BRISK: Binary robust invariant scalable keypoints. Proceedings of the 2011 IEEE International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Raguram, R., Frahm, J.M., and Pollefeys, M. (2008, January 12\u201318). A comparative analysis of RANSAC techniques leading to adaptive real-time random sample consensus. Proceedings of the 10th European Conference on Computer Vision, Marseille, France.","DOI":"10.1007\/978-3-540-88688-4_37"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1006\/cviu.1997.0547","article-title":"Triangulation","volume":"68","author":"Hartley","year":"1997","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Triggs, B., McLauchlan, P.F., Hartley, R.I., and Fitzgibbon, A.W. (1999). Bundle adjustment\u2014A modern synthesis. Vision Algorithms: Theory and Practice, Springer.","DOI":"10.1007\/3-540-44480-7_21"},{"key":"ref_35","unstructured":"(2017, June 07). Qhull. Available online: http:\/\/www.qhull.org\/."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/10\/2\/66\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:38:32Z","timestamp":1760207912000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/10\/2\/66"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,10]]},"references-count":35,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2017,6]]}},"alternative-id":["a10020066"],"URL":"https:\/\/doi.org\/10.3390\/a10020066","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,6,10]]}}}