{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:27:26Z","timestamp":1777696046084,"version":"3.51.4"},"reference-count":41,"publisher":"SAGE Publications","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDA"],"published-print":{"date-parts":[[2021,7,9]]},"abstract":"<jats:p>Knowledge extraction, data mining, e-learning or web applications platforms use heterogeneous and distributed data. The proliferation of these multifaceted platforms faces many challenges such as high scalability, the coexistence of complex similarity metrics, and the requirement of data quality evaluation. In this study, an extended complete formal taxonomy and some algorithms that utilize in achieving the detection and correction of contextual data quality anomalies were developed and implemented on structured data. Our methods were effective in detecting and correcting more data anomalies than existing taxonomy techniques, and also highlighted the demerit of Support Vector Machine (SVM). These proposed techniques, therefore, will be of relevance in detection and correction of errors in large contextual data (Big data).<\/jats:p>","DOI":"10.3233\/ida-205282","type":"journal-article","created":{"date-parts":[[2021,7,13]],"date-time":"2021-07-13T14:25:24Z","timestamp":1626186324000},"page":"763-787","source":"Crossref","is-referenced-by-count":4,"title":["Methods for detecting and correcting contextual data quality problems"],"prefix":"10.1177","volume":"25","author":[{"given":"Alladoumbaye","family":"Ngueilbaye","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongzhi","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daouda Ahmat","family":"Mahamat","sequence":"additional","affiliation":[{"name":"Department d\u2019Informatique, Universit\u00e9 de N\u2019Djamena, , N\u2019Djamena, Tchad"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ibrahim A.","family":"Elgendy","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Harbin Institute of Technology, Harbin, Heilongjiang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sahalu B.","family":"Junaidu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Ahmadu Bello University, Zaria, Nigeria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"issue":"2","key":"10.3233\/IDA-205282_ref2","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1145\/269012.269025","article-title":"The impact of poor data quality on the typical enterprise","volume":"41","author":"Redman","year":"1998","journal-title":"Communications of the ACM"},{"issue":"1","key":"10.3233\/IDA-205282_ref5","first-page":"4","article-title":"Data and information quality issues in ambient assisted living systems","volume":"4","author":"McNaull","year":"2012","journal-title":"Journal of Data and Information Quality (JDIQ)"},{"key":"10.3233\/IDA-205282_ref6","unstructured":"W. Li, J. Zhang and R. Bheemavaram, Efficient algorithms for grouping data to improve data quality, in: Proc. 2006 International Conference on Information and Knowledge Engineering, Las Vegas, 2006."},{"issue":"3","key":"10.3233\/IDA-205282_ref7","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.ijinfomgt.2017.01.003","article-title":"Open data: quality over quantity","volume":"37","author":"Sadiq","year":"2017","journal-title":"International Journal of Information Management"},{"issue":"4","key":"10.3233\/IDA-205282_ref9","first-page":"3","article-title":"Data cleaning: problems and current approaches","volume":"23","author":"Rahm","year":"2000","journal-title":"IEEE Data Eng. Bull."},{"key":"10.3233\/IDA-205282_ref13","doi-asserted-by":"crossref","unstructured":"T. Dasu, G.T. Vesonder and J.R. Wright, Data quality through knowledge engineering, in: Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, 2003.","DOI":"10.1145\/956750.956844"},{"issue":"2\u20133","key":"10.3233\/IDA-205282_ref14","first-page":"8","article-title":"Data quality challenges in cyber-physical systems","volume":"6","author":"Sha","year":"2015","journal-title":"Journal of Data and Information Quality (JDIQ)"},{"key":"10.3233\/IDA-205282_ref15","unstructured":"N. Abdullah et al., Data quality in big data: a review, International Journal of Advances in Soft Computing & Its Applications 7(3) (2015)."},{"key":"10.3233\/IDA-205282_ref17","unstructured":"P. Oliveira et al., A taxonomy of data quality problems, in: 2nd Int. Workshop on Data and Information Quality, Citeseer, 2005."},{"key":"10.3233\/IDA-205282_ref18","doi-asserted-by":"crossref","unstructured":"P. Patidar and A. Tiwari, Handling missing value in decision tree algorithm, International Journal of Computer Applications 70(13) (2013).","DOI":"10.5120\/12023-8063"},{"issue":"5\u20136","key":"10.3233\/IDA-205282_ref19","doi-asserted-by":"crossref","first-page":"684","DOI":"10.1016\/j.neunet.2005.06.025","article-title":"Handling missing values in support vector machine classifiers","volume":"18","author":"Pelckmans","year":"2005","journal-title":"Neural Networks"},{"issue":"1","key":"10.3233\/IDA-205282_ref20","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1023\/A:1021564703268","article-title":"A taxonomy of dirty data","volume":"7","author":"Kim","year":"2003","journal-title":"Data Mining and Knowledge Discovery"},{"issue":"4","key":"10.3233\/IDA-205282_ref22","first-page":"15","article-title":"Improving data quality by source analysis","volume":"2","author":"M\u00fcller","year":"2012","journal-title":"Journal of Data and Information Quality (JDIQ)"},{"key":"10.3233\/IDA-205282_ref26","unstructured":"I. Bedini, B. Nguyen and G. Gardarin, Automatic Ontology Builder from XSD Files, in: World Wide Web Conference, 2008."},{"issue":"6","key":"10.3233\/IDA-205282_ref28","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1016\/S0306-4379(02)00043-1","article-title":"Improving the quality of data models: empirical validation of a quality management framework","volume":"28","author":"Moody","year":"2003","journal-title":"Information Systems"},{"key":"10.3233\/IDA-205282_ref30","doi-asserted-by":"crossref","unstructured":"M.F. Bosu and S.G. MacDonell, Data quality in empirical software engineering: a targeted review, in: Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering, ACM, 2013.","DOI":"10.1145\/2460999.2461024"},{"issue":"15\u201321","key":"10.3233\/IDA-205282_ref31","first-page":"48","article-title":"A survey of data quality tools","volume":"14","author":"Barateiro","year":"2005","journal-title":"Datenbank-Spektrum"},{"issue":"11","key":"10.3233\/IDA-205282_ref32","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1145\/240455.240479","article-title":"Anchoring data quality dimensions in ontological foundations","volume":"39","author":"Wand","year":"1996","journal-title":"Communications of the ACM"},{"issue":"11","key":"10.3233\/IDA-205282_ref33","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1145\/240455.240479","article-title":"Anchoring data quality dimensions in ontological foundations","volume":"39","author":"Wand","year":"1996","journal-title":"Communications of the ACM"},{"issue":"1","key":"10.3233\/IDA-205282_ref34","doi-asserted-by":"crossref","first-page":"550","DOI":"10.14778\/1687627.1687690","article-title":"Integrating conflicting data: the role of source dependence","volume":"2","author":"Dong","year":"2009","journal-title":"Proceedings of the VLDB Endowment"},{"key":"10.3233\/IDA-205282_ref37","doi-asserted-by":"crossref","unstructured":"F. Boufares and A.B. Salem, Heterogeneous data-integration and data quality: Overview of conflicts, in: Sciences of Electronics, Technologies of Information and Telecommunications (SETIT), 2012 6th International Conference on, IEEE, 2012.","DOI":"10.1109\/SETIT.2012.6482029"},{"issue":"4","key":"10.3233\/IDA-205282_ref38","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1007\/s007780050029","article-title":"Semantic and schematic similarities between database objects: a context-based approach","volume":"5","author":"Kashyap","year":"1996","journal-title":"The VLDB Journal \u2013 The International Journal on Very Large Data Bases"},{"key":"10.3233\/IDA-205282_ref39","doi-asserted-by":"crossref","unstructured":"T. Dasu et al., Mining database structure; or, how to build a data quality browser, in: Proceedings of the 2002 ACM SIGMOD International Conference on Management of Data, ACM, 2002.","DOI":"10.1145\/564691.564719"},{"key":"10.3233\/IDA-205282_ref41","doi-asserted-by":"crossref","unstructured":"S. Sarawagi and A. Bhamidipaty, Interactive deduplication using active learning, in: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, 2002.","DOI":"10.1145\/775047.775087"},{"key":"10.3233\/IDA-205282_ref42","doi-asserted-by":"crossref","unstructured":"N. Koudas, S. Sarawagi and D. Srivastava, Record linkage: similarity measures and algorithms, in: Proceedings of the 2006 ACM SIGMOD International Conference on Management of Data, ACM, 2006.","DOI":"10.1145\/1142473.1142599"},{"issue":"1","key":"10.3233\/IDA-205282_ref43","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1007\/s00778-008-0098-x","article-title":"Swoosh: a generic approach to entity resolution","volume":"18","author":"Benjelloun","year":"2009","journal-title":"The VLDB Journal \u2013 The International Journal on Very Large Data Bases"},{"key":"10.3233\/IDA-205282_ref44","doi-asserted-by":"crossref","unstructured":"F. Boufares et al., Similar data elimination: MFB algorithm, in Control, Decision and Information Technologies (CoDIT), 2013 International Conference on, IEEE, 2013.","DOI":"10.1109\/CoDIT.2013.6689559"},{"issue":"10","key":"10.3233\/IDA-205282_ref46","doi-asserted-by":"crossref","first-page":"13448","DOI":"10.1016\/j.eswa.2011.04.063","article-title":"A review of data mining applications for quality improvement in manufacturing industry","volume":"38","author":"K\u00f6ksal","year":"2011","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/IDA-205282_ref47","doi-asserted-by":"crossref","unstructured":"A. Ngueilbaye, L. Lei and H. Wang, Comparative study of data mining techniques on heart disease prediction system: a case study for the \u201cRepublic of Chad\u201d, International Journal of Science and Research 5(5) (2016), 1564-1571.","DOI":"10.21275\/v5i5.NOV163704"},{"key":"10.3233\/IDA-205282_ref50","doi-asserted-by":"crossref","unstructured":"U. Fayyad, P.G. Shapiro and P. Smyth, Data mining and knowledge discovery in databases: an overview, Communications of the ACM 39(11) (1996).","DOI":"10.1145\/240455.240463"},{"key":"10.3233\/IDA-205282_ref52","doi-asserted-by":"crossref","unstructured":"P. Phannachitta et al., Case consistency: a necessary data quality property for software engineering data sets, in: Proceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering, ACM, 2015.","DOI":"10.1145\/2745802.2745820"},{"key":"10.3233\/IDA-205282_ref53","doi-asserted-by":"crossref","unstructured":"T. Joachims, Training linear SVMs in linear time, in: Proceedings of the 12th ACM SIGKDD International Conference On Knowledge Discovery and Data Mining, ACM, 2006, pp. 217\u2013226.","DOI":"10.1145\/1150402.1150429"},{"key":"10.3233\/IDA-205282_ref54","doi-asserted-by":"crossref","unstructured":"T. Joachims, Text categorization with support vector machines: Learning with many relevant features, in: European Conference on Machine Learning, Springer, 1998, pp. 137\u2013142.","DOI":"10.1007\/BFb0026683"},{"key":"10.3233\/IDA-205282_ref57","doi-asserted-by":"crossref","unstructured":"S. R\u00fcping, Support vector machines in relational databases, in: International Workshop on Support Vector Machines, Springer, 2002, pp. 310\u2013320.","DOI":"10.1007\/3-540-45665-1_24"},{"issue":"4","key":"10.3233\/IDA-205282_ref58","first-page":"655","article-title":"Learning to classify text using support vector machines: methods, theory and algorithms","volume":"29","author":"Thorsten","year":"2002","journal-title":"Comput Linguist"},{"issue":"10","key":"10.3233\/IDA-205282_ref59","doi-asserted-by":"crossref","first-page":"13448","DOI":"10.1016\/j.eswa.2011.04.063","article-title":"A review of data mining applications for quality improvement in manufacturing industry","volume":"38","author":"K\u00f6ksal","year":"2011","journal-title":"Expert Systems with Applications"},{"issue":"2","key":"10.3233\/IDA-205282_ref60","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1080\/18756891.2013.868148","article-title":"Fast support vector machine classification for large data sets","volume":"7","author":"Li","year":"2014","journal-title":"International Journal of Computational Intelligence Systems"},{"key":"10.3233\/IDA-205282_ref62","doi-asserted-by":"crossref","unstructured":"Vieira, Priscilla Kelly Machado and L\u00f3scio, Bernadette Farias and Salgado, Ana Carolina, Incremental entity resolution process over query results for data integration systems, Journal of Intelligent Information Systems 52(2) (2019), 451\u2013471.","DOI":"10.1007\/s10844-019-00544-1"},{"key":"10.3233\/IDA-205282_ref63","doi-asserted-by":"crossref","unstructured":"S. Gole and B. Tidke, A survey of big data in social media using data mining techniques, in: International Conference on Advanced Computing and Communication Systems, 2015, pp. 1\u20136.","DOI":"10.1109\/ICACCS.2015.7324059"},{"issue":"3","key":"10.3233\/IDA-205282_ref64","doi-asserted-by":"crossref","first-page":"303","DOI":"10.3233\/SW-160239","article-title":"Detecting linked data quality issues via crowdsourcing: a dbpedia study","volume":"9","author":"Acosta","year":"2018","journal-title":"Semantic Web"},{"issue":"1","key":"10.3233\/IDA-205282_ref65","first-page":"16","article-title":"Big data and five v\u2019s characteristics","volume":"2","author":"Hadi","year":"2015","journal-title":"International Journal of Advances in Electronics and Computer Science"}],"container-title":["Intelligent Data Analysis"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDA-205282","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:19:08Z","timestamp":1777454348000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDA-205282"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,9]]},"references-count":41,"journal-issue":{"issue":"4"},"URL":"https:\/\/doi.org\/10.3233\/ida-205282","relation":{},"ISSN":["1088-467X","1571-4128"],"issn-type":[{"value":"1088-467X","type":"print"},{"value":"1571-4128","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,9]]}}}