{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T13:59:01Z","timestamp":1777039141385,"version":"3.51.4"},"reference-count":43,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2018,10,12]],"date-time":"2018-10-12T00:00:00Z","timestamp":1539302400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>The use of ontological knowledge to improve classification results is a promising line of research. The availability of a probabilistic ontology raises the possibility of combining the probabilities coming from the ontology with the ones produced by a multi-class classifier that detects particular objects in an image. This combination not only provides the relations existing between the different segments, but can also improve the classification accuracy. In fact, it is known that the contextual information can often give information that suggests the correct class. This paper proposes a possible model that implements this integration, and the experimental assessment shows the effectiveness of the integration, especially when the classifier\u2019s accuracy is relatively low. To assess the performance of the proposed model, we designed and implemented a simulated classifier that allows a priori decisions of its performance with sufficient precision.<\/jats:p>","DOI":"10.3390\/info9100252","type":"journal-article","created":{"date-parts":[[2018,10,12]],"date-time":"2018-10-12T10:54:03Z","timestamp":1539341643000},"page":"252","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Integration of Context Information through Probabilistic Ontological Knowledge into Image Classification"],"prefix":"10.3390","volume":"9","author":[{"given":"Andrea","family":"Apicella","sequence":"first","affiliation":[{"name":"Dipartimento di Ingegneria Elettrica e delle Tecnologie dell\u2019Informazione, Universit\u00e0 degli Studi di Napoli Federico II, Via Claudio 21, 80125 Napoli, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anna","family":"Corazza","sequence":"additional","affiliation":[{"name":"Dipartimento di Ingegneria Elettrica e delle Tecnologie dell\u2019Informazione, Universit\u00e0 degli Studi di Napoli Federico II, Via Claudio 21, 80125 Napoli, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9342-5291","authenticated-orcid":false,"given":"Francesco","family":"Isgr\u00f2","sequence":"additional","affiliation":[{"name":"Dipartimento di Ingegneria Elettrica e delle Tecnologie dell\u2019Informazione, Universit\u00e0 degli Studi di Napoli Federico II, Via Claudio 21, 80125 Napoli, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giuseppe","family":"Vettigli","sequence":"additional","affiliation":[{"name":"Dipartimento di Ingegneria Elettrica e delle Tecnologie dell\u2019Informazione, Universit\u00e0 degli Studi di Napoli Federico II, Via Claudio 21, 80125 Napoli, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,10,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Apicella, A., Corazza, A., Isgr\u00f2, F., and Vettigli, G. (2017, January 21\u201323). Integrating a priori probabilistic knowledge into classification for image description. Proceedings of the 26th IEEE WETICE Conference, Poznan, Poland.","DOI":"10.1109\/WETICE.2017.47"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Apicella, A., Corazza, A., Isgr\u00f2, F., and Vettigli, G. (2017, January 11\u201315). Exploiting context information for image description. Proceedings of the International Conference on Image Analysis and Processing, Catania, Italy.","DOI":"10.1007\/978-3-319-68560-1_29"},{"key":"ref_3","unstructured":"Ding, Z., and Peng, Y. (2004, January 5\u20138). A Probabilistic Extension to Ontology Language OWL. Proceedings of the 37th Annual Hawaii International Conference on System Sciences (HICSS\u201904)\u2014Track 4, Big Island, HI, USA."},{"key":"ref_4","unstructured":"Bach, N., and Badaskar, S. (2007). A Review of Relation Extraction, Language Technologies Institute, Carnegie Mellon University. Technical Report."},{"key":"ref_5","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Vinyals, O., Toshev, A., Bengio, S., and Erhan, D. (2015, January 7\u201312). Show and tell: A neural image caption generator. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298935"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Farhadi, A., Hejrati, M., Sadeghi, M.A., Young, P., Rashtchian, C., Hockenmaier, J., and Forsyth, D. (2010, January 5\u201311). Every Picture Tells a Story: Generating Sentences from Images. Proceedings of the 11th European Conference on Computer Vision: Part IV, Crete, Greece.","DOI":"10.1007\/978-3-642-15561-1_2"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kulkarni, G., Premraj, V., Dhar, S., Li, S., Choi, Y., Berg, A.C., and Berg, T.L. (2011, January 20\u201325). Baby Talk: Understanding and Generating Simple Image Descriptions. Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995466"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Elliott, D., and Keller, F. (2013, January 18\u201321). Image Description using Visual Dependency Representations. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA.","DOI":"10.18653\/v1\/D13-1128"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Fang, H., Gupta, S., Iandola, F., Srivastava, R.K., Deng, L., Dollar, P., Gao, J., He, X., Mitchell, M., and Platt, J.C. (2015, January 7\u201312). From Captions to Visual Concepts and Back. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298754"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, X., and Zitnick, C.L. (2015, January 7\u201312). Mind\u2019s eye: A recurrent visual representation for image caption generation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298856"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1109\/TPAMI.2016.2598339","article-title":"Deep Visual-Semantic Alignments for Generating Image Descriptions","volume":"39","author":"Karpathy","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"You, Q., Jin, H., Wang, Z., Fang, C., and Luo, J. (2016, January 27\u201330). Image Captioning With Semantic Attention. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.503"},{"key":"ref_14","unstructured":"Wang, C., Blei, D.M., and Fei-Fei, L. (2009, January 20\u201325). Simultaneous image classification and annotation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.patcog.2011.05.017","article-title":"Semantic Hierarchies for Image Annotation: A Survey","volume":"45","author":"Tousch","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1016\/j.procs.2013.09.105","article-title":"Ontology based Image Retrieval Framework Using Qualitative Semantic Image Descriptions","volume":"22","author":"Sarwar","year":"2013","journal-title":"Procedia Comput. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1929","DOI":"10.1016\/j.fss.2008.02.011","article-title":"Fuzzy spatial relation ontology for image interpretation","volume":"159","author":"Hudelot","year":"2008","journal-title":"Fuzzy Sets Syst."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mezaris, V., Kompatsiaris, I., and Strintzis, M.G. (2003, January 14\u201318). An ontology approach to object-based image retrieval. Proceedings of the 2003 International Conference on Image Processing, Catalonia, Spain.","DOI":"10.1142\/9789812704337_0018"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Hlel, E., Jamoussi, S., and Hamadou, A.B. (2015, January 21\u201323). A Probabilistic Ontology for the Prediction of Author\u00ecs Interests. Proceedings of the International Conference on Computational Collective Intelligence Technologies and Applications, Madrid, Spain. Lectures Notes in Computer Science.","DOI":"10.1007\/978-3-319-24306-1_48"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/j.knosys.2017.01.025","article-title":"Probabilistic ontology based activity recognition in smart homes using Markov Logic Network","volume":"121","author":"Gayathri","year":"2017","journal-title":"Knowl. Based Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"255","DOI":"10.3233\/SW-160219","article-title":"An infrastructure for probabilistic reasoning with web ontologies","volume":"8","author":"Huber","year":"2017","journal-title":"Semant. Web"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Jules, O., Hafid, A., and Serhani, M.A. (2014, January 8\u201310). Bayesian network, and probabilistic ontology driven trust model for SLA management of Cloud services. Proceedings of the IEEE International Conference on Cloud Networking, Luxembourg.","DOI":"10.1109\/CloudNet.2014.6968972"},{"key":"ref_23","unstructured":"Lunardi, G.M., Machado, G.M., Machot, F.A., Maran, V., Machado, A., Mayr, H.C., Shekhovtsov, V.A., and de Oliveira, J.P.M. (2018, January 16\u201318). Probabilistic Ontology Reasoning in Ambient Assistance: Predicting Human Actions. Proceedings of the IEEE 32nd International Conference on Advanced Information Networking and Applications, Krakow, Poland."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/0031-3203(78)90027-4","article-title":"The use of context in pattern recognition","volume":"10","author":"Toussaint","year":"1978","journal-title":"Pattern Recognit."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1016\/j.tics.2007.09.009","article-title":"The role of context in object recognition","volume":"11","author":"Oliva","year":"2007","journal-title":"Trends Cognit. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1068\/p250343","article-title":"Spatial context in recognition","volume":"25","author":"Bar","year":"1996","journal-title":"Perception"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"583","DOI":"10.3758\/BF03211301","article-title":"Features and their configuration in face recognition","volume":"25","author":"Tanaka","year":"1997","journal-title":"Mem. Cognit."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1016\/j.patrec.2004.08.009","article-title":"Fusion of spatial relationships for guiding recognition, example of brain structure recognition in 3D MRI","volume":"26","author":"Bloch","year":"2005","journal-title":"Pattern Recognit. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Choi, W., Shahid, K., and Savarese, S. (2011, January 20\u201325). Learning context for collective activity recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2011, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995707"},{"key":"ref_30","unstructured":"Schneiderman, H., and Kanade, T. (1998, January 23\u201325). Probabilistic Modeling of Local Appearance and Spatial Relationships for Object Recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Santa Barbara, CA, USA."},{"key":"ref_31","unstructured":"Schmid, C. (1999, January 23\u201325). A structured probabilistic model for recognition. Proceedings of the 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Fort Collins, CO, USA."},{"key":"ref_32","unstructured":"Zhang, R., Zhang, Z., Li, M., Ma, W.Y., and Zhang, H.J. (2005, January 17\u201320). A probabilistic semantic model for image annotation and multimodal image retrieval. Proceedings of the ICCV 2005 Tenth IEEE International Conference on Computer Vision, Beijing, China."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1109\/TIP.2012.2231088","article-title":"View-Based Discriminative Probabilistic Modeling for 3D Object Retrieval and Recognition","volume":"22","author":"Wang","year":"2013","journal-title":"Trans. Image Proc."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4150","DOI":"10.1109\/TIP.2014.2344433","article-title":"A Probabilistic Associative Model for Segmenting Weakly Supervised Images","volume":"23","author":"Zhang","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.patrec.2014.07.017","article-title":"Action recognition in still images by learning spatial interest regions from videos","volume":"51","author":"Eweiwi","year":"2015","journal-title":"Pattern Recognit. Lett."},{"key":"ref_36","unstructured":"Costa, P.C.G.D. (2005). Bayesian Semantics for the Semantic Web. [Ph.D. Thesis, George Mason University]."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Klinov, P., and Parsia, B. (2013). Uncertainty Reasoning for the Semantic Web II: International Workshops URSW 2008\u20132010 Held at ISWC and UniDL 2010 Held at FLoC, Revised Selected Papers, Springer. Chapter Pronto: A Practical Probabilistic Description Logic Reasoner.","DOI":"10.1007\/978-3-642-35975-0_4"},{"key":"ref_38","unstructured":"Abhyankar, S., Brown, J., Constantinescu, E.M., Ghosh, D., Smith, B.F., and Zhang, H. (arXiv, 2018). PETSc\/TS: A Modern Scalable ODE\/DAE Solver Library, arXiv."},{"key":"ref_39","unstructured":"Fletcher, R. (1987). Practical Methods of Optimization, Jonh Wiley & Sons. [2nd ed.]."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer Inc.. [1st ed.].","DOI":"10.1007\/978-1-84882-935-0"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zouari, H., Heutte, L., and Lecourtier, Y. (2004, January 23\u201326). Simulating classifier ensembles of fixed diversity for studying plurality voting performance. Proceedings of the 17th International Conference on Pattern Recognition, Cambridge, UK.","DOI":"10.1109\/ICPR.2004.1334066"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Quattoni, A., and Torralba, A. (2009, January 20\u201325). Recognizing indoor scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206537"},{"key":"ref_43","unstructured":"Gonzalez, R.C., and Woods, R.E. (2017). Digital Image Processing, Pearson."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/9\/10\/252\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T19:44:08Z","timestamp":1775245448000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/9\/10\/252"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,12]]},"references-count":43,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2018,10]]}},"alternative-id":["info9100252"],"URL":"https:\/\/doi.org\/10.3390\/info9100252","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,12]]}}}