{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T10:20:29Z","timestamp":1777890029412,"version":"3.51.4"},"reference-count":50,"publisher":"SAGE Publications","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SW"],"published-print":{"date-parts":[[2021,3,9]]},"abstract":"<jats:p>Storage and analysis of video surveillance data is a significant challenge, requiring video interpretation and event detection in the relevant context. To perform this task, the low-level features including shape, texture, and color information are extracted and represented in symbolic forms. In this work, a methodology is proposed, which extracts the salient features and properties using machine learning techniques and represent this information as Linked Data using a domain ontology that is explicitly tailored for detection of certain activities. An ontology is also developed to include concepts and properties which may be applicable in the domain of surveillance and its applications. The proposed approach is validated with actual implementation and is thus evaluated by recognizing suspicious activity in an open parking space. The suspicious activity detection is formalized through inference rules and SPARQL queries. Eventually, Semantic Web Technology has proven to be a remarkable toolchain to interpret videos, thus opening novel possibilities for video scene representation, and detection of complex events, without any human involvement. The proposed novel approach can thus have representation of frame-level information of a video in structured representation and perform event detection while reducing storage and enhancing semantically-aided retrieval of video data.<\/jats:p>","DOI":"10.3233\/sw-200393","type":"journal-article","created":{"date-parts":[[2020,9,25]],"date-time":"2020-09-25T06:20:56Z","timestamp":1601014856000},"page":"467-491","source":"Crossref","is-referenced-by-count":7,"title":["Video representation and suspicious event detection using semantic technologies"],"prefix":"10.1177","volume":"12","author":[{"given":"Ashish Singh","family":"Patel","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, DSPM International Institute of Information Technology Naya Raipur, Atal Nagar, Raipur, India. E-mails:\u00a0ashish@iiitnr.edu.in,\u00a0muneendra@iiitnr.edu.in"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giovanni","family":"Merlino","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Messina, Messina, Italy. E-mails:\u00a0gmerlino@unime.it,\u00a0dbruneo@unime.it,\u00a0apuliafito@unime.it"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dario","family":"Bruneo","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Messina, Messina, Italy. E-mails:\u00a0gmerlino@unime.it,\u00a0dbruneo@unime.it,\u00a0apuliafito@unime.it"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antonio","family":"Puliafito","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Messina, Messina, Italy. E-mails:\u00a0gmerlino@unime.it,\u00a0dbruneo@unime.it,\u00a0apuliafito@unime.it"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"O.P.","family":"Vyas","sequence":"additional","affiliation":[{"name":"Department of Information Technology, Indian Institute of Information Technology-Allahabad, Prayagraj, India. E-mail:\u00a0dropvyas@gmail.com"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muneendra","family":"Ojha","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, DSPM International Institute of Information Technology Naya Raipur, Atal Nagar, Raipur, India. E-mails:\u00a0ashish@iiitnr.edu.in,\u00a0muneendra@iiitnr.edu.in"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"issue":"8","key":"10.3233\/SW-200393_ref1","doi-asserted-by":"publisher","first-page":"10933","DOI":"10.1007\/s11042-018-6618-9","article-title":"Versatile loitering detection based on non-verbal cues using dense trajectory descriptors","volume":"78","author":"Arivazhagan","year":"2019","journal-title":"Multimedia Tools and Applications"},{"key":"10.3233\/SW-200393_ref2","doi-asserted-by":"crossref","unstructured":"S.\u00a0Auer, C.\u00a0Bizer, G.\u00a0Kobilarov, J.\u00a0Lehmann and Z.\u00a0Ives, DBpedia: A nucleus for a web of open data, in: 6th Int\u2019l Semantic Web Conference, Springer, Busan, Korea, 2007, pp.\u00a011\u201315.","DOI":"10.1007\/978-3-540-76298-0_52"},{"key":"10.3233\/SW-200393_ref3","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00056"},{"key":"10.3233\/SW-200393_ref4","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1016\/j.eswa.2017.09.029","article-title":"Abnormal behavior recognition for intelligent video surveillance systems: A review","volume":"91","author":"Ben Mabrouk","year":"2018","journal-title":"Expert Systems with Applications"},{"issue":"1\u20132","key":"10.3233\/SW-200393_ref5","first-page":"47","article-title":"Ontology based road traffic management in emergency situations","volume":"20","author":"Bermejo","year":"2013","journal-title":"Ad-Hoc and Sensor Wireless Networks"},{"issue":"3","key":"10.3233\/SW-200393_ref6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4018\/jswis.2009081901","article-title":"Linked data-the story so far","volume":"5","author":"Bizer","year":"2009","journal-title":"International journal on Semantic Web and Information Systems"},{"key":"10.3233\/SW-200393_ref7","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.04.031"},{"issue":"9","key":"10.3233\/SW-200393_ref8","doi-asserted-by":"publisher","first-page":"2407","DOI":"10.1109\/TMM.2019.2896515","article-title":"Generating video descriptions with latent topic guidance","volume":"21","author":"Chen","year":"2019","journal-title":"IEEE Transactions on Multimedia"},{"key":"10.3233\/SW-200393_ref9","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2914765"},{"key":"10.3233\/SW-200393_ref11","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299036"},{"issue":"1","key":"10.3233\/SW-200393_ref12","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1016\/j.eswa.2014.07.046","article-title":"A collaborative algorithm for semantic video annotation using a consensus-based social network analysis","volume":"42","author":"Duong","year":"2015","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/SW-200393_ref13","doi-asserted-by":"publisher","DOI":"10.1145\/2237827.2237828"},{"issue":"5","key":"10.3233\/SW-200393_ref14","doi-asserted-by":"publisher","first-page":"939","DOI":"10.1109\/TMM.2007.900143","article-title":"Incorporating concept ontology for hierarchical video classification, annotation, and visualization","volume":"9","author":"Fan","year":"2007","journal-title":"IEEE Transactions on Multimedia"},{"key":"10.3233\/SW-200393_ref15","unstructured":"J.\u00a0Ferryman, PETS 2006 Benchmark Data, 2006, http:\/\/www.cvg.reading.ac.uk\/PETS2006\/data.html."},{"key":"10.3233\/SW-200393_ref16","unstructured":"J.\u00a0Ferryman, PETS 2007 Benchmark Data, 2007, http:\/\/www.cvg.reading.ac.uk\/PETS2007\/data.html."},{"key":"10.3233\/SW-200393_ref17","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2004.1334530"},{"issue":"4","key":"10.3233\/SW-200393_ref18","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1109\/MMUL.2005.87","article-title":"VERL: An ontology framework for representing and annotating video events","volume":"12","author":"Fran\u00e7ois","year":"2005","journal-title":"IEEE Multimedia"},{"key":"10.3233\/SW-200393_ref19","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298872"},{"issue":"6","key":"10.3233\/SW-200393_ref20","doi-asserted-by":"publisher","first-page":"7494","DOI":"10.1016\/j.eswa.2010.12.118","article-title":"Ontology-based context representation and reasoning for object tracking and scene interpretation in video","volume":"38","author":"G\u00f3mez-Romero","year":"2011","journal-title":"Expert Systems with Applications"},{"issue":"4","key":"10.3233\/SW-200393_ref21","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1007\/s12559-012-9172-1","article-title":"A collaborative video annotation system based on semantic web technologies","volume":"4","author":"Grassi","year":"2012","journal-title":"Cognitive Computation"},{"key":"10.3233\/SW-200393_ref22","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2007.4408894"},{"issue":"5","key":"10.3233\/SW-200393_ref23","doi-asserted-by":"publisher","first-page":"958","DOI":"10.1109\/TMM.2007.900150","article-title":"Can high-level concepts fill the semantic gap in video retrieval? A case study with broadcast news","volume":"9","author":"Hauptmann","year":"2007","journal-title":"IEEE Transactions on Multimedia"},{"issue":"79","key":"10.3233\/SW-200393_ref25","first-page":"1","article-title":"SWRL: A semantic web rule language combining OWL and RuleML","volume":"21","author":"Horrocks","year":"2004","journal-title":"W3C Member Submission"},{"key":"10.3233\/SW-200393_ref26","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-5828-8_72"},{"key":"10.3233\/SW-200393_ref27","doi-asserted-by":"publisher","DOI":"10.5194\/isprs-annals-IV-1-W1-19-2017"},{"key":"10.3233\/SW-200393_ref28","doi-asserted-by":"publisher","DOI":"10.1109\/GCCE.2015.7398708"},{"issue":"4","key":"10.3233\/SW-200393_ref29","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1145\/2757001.2757003","article-title":"The prot\u00e9g\u00e9 project: A look back and a look forward","volume":"1","author":"Musen","year":"2015","journal-title":"AI Matters"},{"issue":"3","key":"10.3233\/SW-200393_ref30","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/MMUL.2006.63","article-title":"Large-scale concept ontology for multimedia","volume":"13","author":"Naphade","year":"2006","journal-title":"IEEE Multimedia"},{"key":"10.3233\/SW-200393_ref31","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2004.301"},{"key":"10.3233\/SW-200393_ref32","doi-asserted-by":"publisher","DOI":"10.1109\/SMARTCOMP.2018.00039"},{"key":"10.3233\/SW-200393_ref33","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2016.157"},{"key":"10.3233\/SW-200393_ref34","doi-asserted-by":"publisher","DOI":"10.1109\/AVSS.2014.6918694"},{"key":"10.3233\/SW-200393_ref35","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.590"},{"key":"10.3233\/SW-200393_ref36","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.91"},{"issue":"11","key":"10.3233\/SW-200393_ref37","doi-asserted-by":"publisher","first-page":"1587","DOI":"10.1109\/TCSVT.2008.2005607","article-title":"Modality mixture projections for semantic video event detection","volume":"18","author":"Shen","year":"2008","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"},{"key":"10.3233\/SW-200393_ref38","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126223"},{"key":"10.3233\/SW-200393_ref39","doi-asserted-by":"crossref","unstructured":"L.F.\u00a0Sikos, A novel approach to multimedia ontology engineering for automated reasoning over audiovisual LOD datasets, in: ACIIDS, 2016.","DOI":"10.1007\/978-3-662-49381-6_1"},{"key":"10.3233\/SW-200393_ref40","isbn-type":"print","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-3-319-54066-5","volume-title":"Description Logics in Multimedia Reasoning","author":"Sikos","year":"2017","ISBN":"https:\/\/id.crossref.org\/isbn\/9783319540665"},{"issue":"2","key":"10.3233\/SW-200393_ref41","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/24751839.2018.1437696","article-title":"VidOnt: A core reference ontology for reasoning over video scenes scenes *","volume":"2","author":"Sikos","year":"2018","journal-title":"Journal of Information and Telecommunication"},{"key":"10.3233\/SW-200393_ref42","doi-asserted-by":"publisher","DOI":"10.1145\/2810133.2810141"},{"issue":"4","key":"10.3233\/SW-200393_ref43","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1561\/1500000014","article-title":"Concept-based video retrieval","volume":"2","author":"Snoek","year":"2008","journal-title":"Foundations and Trends in Information Retrieval"},{"key":"10.3233\/SW-200393_ref44","doi-asserted-by":"crossref","unstructured":"M.Y.K.\u00a0Tani, A.\u00a0Lablack, A.\u00a0Ghomari and I.M.\u00a0Bilasco, Events detection using a video-surveillance ontology and a rule-based approach, Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol.\u00a08926, 2015, pp.\u00a0299\u2013308. ISBN 9783319161808.","DOI":"10.1007\/978-3-319-16181-5_21"},{"key":"10.3233\/SW-200393_ref45","doi-asserted-by":"publisher","DOI":"10.1109\/IVS.2017.7995933"},{"issue":"3","key":"10.3233\/SW-200393_ref46","doi-asserted-by":"publisher","first-page":"336","DOI":"10.1109\/TCSVT.2007.890633","article-title":"Personalized content retrieval in context using ontological knowledge","volume":"17","author":"Vallet","year":"2007","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"},{"key":"10.3233\/SW-200393_ref47","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299071"},{"issue":"4","key":"10.3233\/SW-200393_ref48","doi-asserted-by":"publisher","first-page":"623","DOI":"10.1109\/JPROC.2008.916362","article-title":"Event mining in multimedia streams","volume":"96","author":"Xie","year":"2008","journal-title":"Proceedings of the IEEE"},{"key":"10.3233\/SW-200393_ref49","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1016\/j.jss.2014.07.024","article-title":"Semantic based representing and organizing surveillance big data using video structural description technology","volume":"102","author":"Xu","year":"2015","journal-title":"Journal of Systems and Software"},{"issue":"4","key":"10.3233\/SW-200393_ref50","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1016\/j.image.2010.02.001","article-title":"A semantic framework for video genre classification and event analysis","volume":"25","author":"You","year":"2010","journal-title":"Signal Processing: Image Communication"},{"key":"10.3233\/SW-200393_ref51","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2014.103"},{"issue":"5","key":"10.3233\/SW-200393_ref52","doi-asserted-by":"publisher","first-page":"665","DOI":"10.1109\/TKDE.2005.83","article-title":"Video data mining: Semantic indexing and event detection from the association perspective","volume":"17","author":"Zhu","year":"2005","journal-title":"IEEE Transactions on Knowledge and Data Engineering"}],"container-title":["Semantic Web"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/SW-200393","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T05:24:59Z","timestamp":1777613099000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/SW-200393"}},"subtitle":[],"editor":[{"given":"Armin","family":"Haller","sequence":"additional","affiliation":[{"name":"Australian National University, Australia"}],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,3,9]]},"references-count":50,"journal-issue":{"issue":"3"},"URL":"https:\/\/doi.org\/10.3233\/sw-200393","relation":{},"ISSN":["2210-4968","1570-0844"],"issn-type":[{"value":"2210-4968","type":"electronic"},{"value":"1570-0844","type":"print"}],"subject":[],"published":{"date-parts":[[2021,3,9]]}}}