{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T10:20:11Z","timestamp":1777890011916,"version":"3.51.4"},"reference-count":84,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2021,6,1]],"date-time":"2021-06-01T00:00:00Z","timestamp":1622505600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Web Intelligence"],"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:p>Web data extraction has seen significant development in the last decade since its inception in the early nineties. It has evolved from a simple manual way of extracting data from web page and documents to automated extraction to an intelligent extraction using machine learning algorithms, tools and techniques. Data extraction is one of the key components of end-to-end life cycle in web data extraction process that includes navigation, extraction, data enrichment and visualization. This paper presents the journey of web data extraction over the last many years highlighting evolution of tools, techniques, frameworks and algorithms for building intelligent web data extraction systems. The paper also throws light into challenges, opportunities for future research and emerging trends over the years in web data extraction with specific focus on machine learning techniques. Both traditional and machine learning approaches to manual and automated web data extraction are experimented and results published with few use cases demonstrating the challenges in web data extraction in the event of changes in the website layout. This paper introduces novel ideas such as self-healing capability in web data extraction and proactive error detection in the event of changes in website layout as an area of future research. This unique perspective will help readers to get deeper insights in to the present and future of web data extraction.<\/jats:p>","DOI":"10.3233\/web-210465","type":"journal-article","created":{"date-parts":[[2021,11,16]],"date-time":"2021-11-16T12:30:04Z","timestamp":1637065804000},"page":"169-190","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":3,"title":["Trends in web data extraction using machine learning"],"prefix":"10.1177","volume":"19","author":[{"given":"Sudhir Kumar","family":"Patnaik","sequence":"first","affiliation":[{"name":"Department of Computer Science, MS Ramaiah University of Applied Sciences, MSR Nagar, Bangalore, India. E-mails:\u00a0,\u00a0"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C.","family":"Narendra Babu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, MS Ramaiah University of Applied Sciences, MSR Nagar, Bangalore, India. E-mails:\u00a0,\u00a0"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2021,11,15]]},"reference":[{"issue":"18","key":"e_1_3_1_2_2","first-page":"7194","article-title":"A comparative study on data extraction and its processes","volume":"12","author":"Akash G.","year":"2017","unstructured":"G.\u00a0Akash, S.\u00a0Anand and C.R.\u00a0Manjunath, A comparative study on data extraction and its processes, International Journal of Applied Engineering Research12(18) (2017), 7194\u20137201.","journal-title":"International Journal of Applied Engineering Research"},{"key":"e_1_3_1_3_2","doi-asserted-by":"crossref","unstructured":"M.\u00a0Andrea and G.\u00a0Paolo Unsupervised Data Driven Feature Extraction by Means of Mutual Information Maximization IEEE Transaction on Computational Imaging3(2) (2017).","DOI":"10.1109\/TCI.2017.2669731"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.3233\/IDT-200001"},{"key":"e_1_3_1_5_2","doi-asserted-by":"crossref","unstructured":"A.\u00a0Arasu and Garcia-Molina Extracting structured data from web pages in: ACM SIGMOD International Conference Managing Data 2003 pp.\u00a0337\u2013348.","DOI":"10.1145\/872757.872799"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","unstructured":"G.O.\u00a0Arocena and A.O.\u00a0Mendelzon WebOQL: Restructuring documents databases and webs in: Proceedings of the 14th IEEE International Conference on Data Engineering (ICDE) 1998 pp.\u00a024\u201333. doi:10.1109\/ICDE.1998.655754.","DOI":"10.1109\/ICDE.1998.655754"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","unstructured":"R.\u00a0Baumgartner M.\u00a0Ceresna and G.\u00a0Ledermuller DeepWeb navigation in web data extraction in: International Conference on Computational Intelligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and Internet Commerce (CIMCA-IAWTIC\u201906) Vienna 2006 pp.\u00a0698\u2013703. doi:10.1109\/CIMCA.2005.1631550.","DOI":"10.1109\/CIMCA.2005.1631550"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2993767"},{"key":"e_1_3_1_9_2","doi-asserted-by":"crossref","unstructured":"A.\u00a0Burrell and A.C.\u00a0Sodan Web interface navigation design: Which style of navigation-link menus do users prefer? in: 22nd International Conference on Data Engineering Workshops 2006.","DOI":"10.1109\/ICDEW.2006.163"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.5334\/dsj-2015-002"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","unstructured":"C.\u00a0Chang and S.-C.\u00a0Lui IEPAD: Information extraction based on pattern discovery in: Proceedings of the 10th International Conference on World Wide Web \u2013 WWW 2001 pp.\u00a0681\u2013688. doi:10.1145\/371920.372182.","DOI":"10.1145\/371920.372182"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2004.71"},{"key":"e_1_3_1_13_2","doi-asserted-by":"crossref","unstructured":"C.\u00a0Chia-Hui K.\u00a0Mohammed R.G.\u00a0Moheb and F.S.\u00a0Khaled A Survey of Web Information Extraction Systems IEEE Transactions on Knowledge and Data Engineering18(10) (2006).","DOI":"10.1109\/TKDE.2006.152"},{"key":"e_1_3_1_14_2","unstructured":"C.\u00a0Clarissa and S.\u00a0Marlo Extraction and classification of semantic data from Twitter in: WebMedia\u201918 October 16\u201319 Salvador-BA Brazil 2018."},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4379(98)00028-3"},{"key":"e_1_3_1_16_2","doi-asserted-by":"crossref","unstructured":"V.\u00a0Crescenzi G.\u00a0Mecca and P.\u00a0Merialdo RoadRunner: Towards automatic data extraction from large web sites in: Proceedings of the 27th VLDB Conference Roma Italy 2001.","DOI":"10.1145\/564772.564778"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","unstructured":"R.\u00a0Diouf E.N.\u00a0Sarr O.\u00a0Sall B.\u00a0Birregah M.\u00a0Bousso and S.N.\u00a0Mbaye Web scraping: State-of-the-art and areas of application in: 2019 IEEE International Conference on Big Data (Big Data) Los Angeles CA USA 2019 pp.\u00a06040\u20136042. doi:10.1109\/BigData47090.2019.9005594.","DOI":"10.1109\/BigData47090.2019.9005594"},{"key":"e_1_3_1_18_2","unstructured":"F.\u00a0Emilio D.M.\u00a0Pasquale F.\u00a0Giacomo and B.\u00a0Robert Web data extraction applications and techniques: A survey in: Knowledge-Based Systems 2014."},{"key":"e_1_3_1_19_2","unstructured":"D.\u00a0Freitag Information extraction from HTML: Application of a general learning approach in: Proceedings of the 15th Conference on Artificial Intelligence (AAAI-98) 1998."},{"key":"e_1_3_1_20_2","doi-asserted-by":"crossref","unstructured":"H.\u00a0Galih A.\u00a0Azhari and M.\u00a0Khabib Trend of Supervised Web Data Extraction International Journal of Computer Applications180(19) (2018).","DOI":"10.5120\/ijca2018916431"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","unstructured":"R.\u00a0Girshick Fast R-CNN in: 2015 IEEE International Conference on Computer Vision (ICCV) Santiago 2015 pp.\u00a01440\u20131448. doi:10.1109\/ICCV.2015.169.","DOI":"10.1109\/ICCV.2015.169"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/bbt026"},{"key":"e_1_3_1_23_2","doi-asserted-by":"crossref","unstructured":"T.\u00a0Gogar O.\u00a0Hubacek and J.\u00a0Sedivy Deep neural networks for web page information extraction in: Artificial Intelligence Applications and Innovations. AIAI 2016 L.\u00a0Iliadis and I.\u00a0Maglogiannis eds IFIP Advances in Information and Communication Technology Vol.\u00a0475 Springer Cham 2016.","DOI":"10.1007\/978-3-319-44944-9_14"},{"key":"e_1_3_1_24_2","doi-asserted-by":"crossref","unstructured":"J.\u00a0Hammer J.\u00a0McHugh and H.\u00a0Garcia-Molina Semistructured data: The TSIMMIS experience in: Proceedings of the First East-European Symposium Advances 1997.","DOI":"10.14236\/ewic\/ADBIS1997.22"},{"key":"e_1_3_1_25_2","doi-asserted-by":"crossref","unstructured":"A.S.\u00a0Hassan and C.\u00a0Rafael Trinity: On Using Trinary Trees for Unsupervised Web Data Extraction IEEE Transactions on Knowledge and Data Engineering26(6) (2014).","DOI":"10.1109\/TKDE.2013.161"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","unstructured":"K.\u00a0He G.\u00a0Gkioxari P.\u00a0Doll\u00e1r and R.\u00a0Girshick Mask R-CNN in: 2017 IEEE International Conference on Computer Vision (ICCV) Venice 2017 pp.\u00a02980\u20132988. doi:10.1109\/ICCV.2017.322.","DOI":"10.1109\/ICCV.2017.322"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","unstructured":"A.\u00a0Hogue and D.\u00a0Karger Thresher: Automating the unwrapping of semantic content from the world wide web in: Proceedings 14th International Conference on World Wide Web \u2013 WWW\u201905 2005 pp.\u00a086\u201395. doi:10.1145\/1060745.1060762.","DOI":"10.1145\/1060745.1060762"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4379(98)00027-1"},{"key":"e_1_3_1_29_2","unstructured":"M.\u00a0Jatinder Design and development of automated tool to study sitemap as design issue in websites in: 2nd International Conference on Computing for Sustainable Global Development 2015."},{"key":"e_1_3_1_30_2","unstructured":"W.\u00a0Jiying and H.\u00a0Lochovsky Data extraction and label assignment for web databases in: WWW2003 May 20\u201324 2003 Budapest Hungary ACM 2003 1-58113-680-3\/03\/0005."},{"key":"e_1_3_1_31_2","unstructured":"N.\u00a0Karthik Y.\u00a0Adam and B.\u00a0Regina Improving information extraction by acquiring external evidence with reinforcement learning in: CSAIL MIT 2016 1603.07954v3 [cs.CL]."},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","unstructured":"M.\u00a0Kayed C.-H.\u00a0Chang K.\u00a0Shaalan and M.\u00a0Girgis FiVaTech: Page-level web data extraction from template pages in: 7th IEEE International Conference on Data Mining 2007. doi:10.1109\/ICDMW.2007.95.","DOI":"10.1109\/ICDMW.2007.95"},{"key":"e_1_3_1_33_2","unstructured":"K.\u00a0Kei F.\u00a0Yotaro and T.\u00a0Motomichi Ducky: A data extraction system for various structured web documents in: Proceeding IDEAS\u201914 Proceedings of the 18th International Database Engineering & Applications Symposium 2014."},{"key":"e_1_3_1_34_2","unstructured":"P.\u00a0Korawit and N.\u00a0Winai Towards Data Extraction of Dynamic Content from JavaScript Web Applications IEEE Journal ICOIN (2018)."},{"key":"e_1_3_1_35_2","unstructured":"N.\u00a0Kushmerick Wrapper Induction for Information Extraction A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy 1997."},{"key":"e_1_3_1_36_2","doi-asserted-by":"crossref","unstructured":"N.\u00a0Kushmerick and B.\u00a0Thomas Adaptive Information Extraction: Core Technologies for Information Agents University of Koblenz-Landau Institute of Informatik Koblenz 2003.","DOI":"10.1007\/3-540-36561-3_4"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-023X(01)00047-7"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","unstructured":"J.\u00a0Lang Hong Deep web data extraction in: 2010 IEEE International Conference on Systems Man and Cybernetics Istanbul 2010 pp.\u00a03420\u20133427. doi:10.1109\/ICSMC.2010.5642466.","DOI":"10.1109\/ICSMC.2010.5642466"},{"key":"e_1_3_1_39_2","unstructured":"V.\u00a0Le and S.\u00a0Gulwani FlashExtract: A framework for data extraction by examples in: PLDI\u201914 Edinburgh United Kingdom 2014 pp.\u00a009\u201311."},{"key":"e_1_3_1_40_2","unstructured":"J.J.\u00a0Li U.\u00a0Andreas B.\u00a0Xiaoying and B.\u00a0Antonia Advances in test automation for software with special focus on artificial intelligence and machine learning Software Quality Journal 2019."},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","unstructured":"S.\u00a0Li C.\u00a0Chen K.\u00a0Luo and B.\u00a0Song Review of deep web data extraction in: 2019 IEEE Symposium Series on Computational Intelligence (SSCI) Xiamen China 2019 pp.\u00a01068\u20131070. doi:10.1109\/SSCI44817.2019.9002877.","DOI":"10.1109\/SSCI44817.2019.9002877"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","unstructured":"S.\u00a0Li C.\u00a0Chen K.\u00a0Luo and B.\u00a0Song Review of deep web data extraction in: 2019 IEEE Symposium Series on Computational Intelligence (SSCI) Xiamen China 2019 pp.\u00a01068\u20131070. doi:10.1109\/SSCI44817.2019.9002877.","DOI":"10.1109\/SSCI44817.2019.9002877"},{"key":"e_1_3_1_43_2","doi-asserted-by":"crossref","unstructured":"B.\u00a0Liu R.\u00a0Grossman and Y.\u00a0Zhai Mining data records in web pages in: Proceedings of International Conference on Knowledge Discovery in Databases and Data Mining (KDD) 2003 pp.\u00a0601\u2013606.","DOI":"10.1145\/956750.956826"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","unstructured":"D.\u00a0Liu L.\u00a0Ma and X.\u00a0Liu Research on adaptive wrapper in deep web data extraction in: Internet of Vehicles \u2013 Safe and Intelligent Mobility. IOV 2015 C.H.\u00a0Hsu F.\u00a0Xia X.\u00a0Liu and S.\u00a0Wang eds Lecture Notes in Computer Science Vol.\u00a09502 2015. doi:10.1007\/978-3-319-27293-1.","DOI":"10.1007\/978-3-319-27293-1"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","unstructured":"L.\u00a0Liu C.\u00a0Pu and W.\u00a0Han XWRAP: An XML-enabled wrapper construction system for web information sources in: Proceedings of the 16th International Conference on Data Engineering (Cat. No. 00CB37073) 2000 pp.\u00a0611\u2013621. doi:10.1109\/ICDE.2000.839475.","DOI":"10.1109\/ICDE.2000.839475"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","unstructured":"W.\u00a0Liu X.\u00a0Meng and W.\u00a0Meng ViDE: A Vision-Based Approach for Deep Web Data Extraction IEEE Transactions on Knowledge and Data Engineering22(3) (2010). doi:10.1109\/TKDE.2009.109.","DOI":"10.1109\/TKDE.2009.109"},{"key":"e_1_3_1_47_2","doi-asserted-by":"crossref","unstructured":"A.\u00a0Manjaramkar and R.L.\u00a0Lokhande DEPTA: An efficient technique for web data extraction and alignment in: International Conference on Advances in Computing Communications and Informatics ICACCI 2016 pp.\u00a02307\u20132310.","DOI":"10.1109\/ICACCI.2016.7732397"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","unstructured":"J.L.\u00a0Martinez-Rodriguez A.\u00a0Hogan and I.\u00a0Lopez-Arevalo in: Information Extraction Meets the Semantic Web: A Survey 2020 pp.\u00a0255\u2013335. doi:10.3233\/SW-180333.","DOI":"10.3233\/SW-180333"},{"key":"e_1_3_1_49_2","first-page":"177","article-title":"Bottom-up relational learning of pattern matching rules for information extraction","volume":"4","author":"Mary E.C.","year":"2003","unstructured":"E.C.\u00a0Mary and J.M.\u00a0Raymond, Bottom-up relational learning of pattern matching rules for information extraction, Journal of Machine Learning Research4 (2003), 177\u2013210.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_1_50_2","unstructured":"C.\u00a0Michael Computer vision-based analysis of web page structure for assistive interfaces 2016 in: 13th web for All conference."},{"key":"e_1_3_1_51_2","doi-asserted-by":"crossref","unstructured":"R.\u00a0Mohammad and G.\u00a0Sumit Automated data extraction using predictive program synthesis Microsoft corporation in: Proceedings of the 31st AAAI Conference on Artificial Intelligence (AAAI-17) Association for the Advancement of Artificial Intelligence 2017.","DOI":"10.1609\/aaai.v31i1.10668"},{"key":"e_1_3_1_52_2","doi-asserted-by":"crossref","unstructured":"I.\u00a0Muslea S.\u00a0Minton and C.\u00a0Knoblock A hierarchical approach to wrapper induction in: Proceedings of the 3rd International Conference on Autonomous Agents 1999.","DOI":"10.1145\/301136.301191"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","unstructured":"S.\u00a0Nagarajan and K.\u00a0Perumal A deep neural network for information extraction from web pages in: 2017 IEEE International Conference on Power Control Signals and Instrumentation Engineering (ICPCSI) Chennai 2017 pp.\u00a0918\u2013922. doi:10.1109\/ICPCSI.2017.8391845.","DOI":"10.1109\/ICPCSI.2017.8391845"},{"key":"e_1_3_1_54_2","doi-asserted-by":"crossref","unstructured":"K.\u00a0Narasimhan A.\u00a0Yala and R.\u00a0Barzilay Improving Information Extraction by Acquiring External Evidence with Reinforcement Learning: Supplementary Material 2016 1603.07954v3 [cs.CL].","DOI":"10.18653\/v1\/D16-1261"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2019.2918327"},{"key":"e_1_3_1_56_2","doi-asserted-by":"crossref","unstructured":"S.K.\u00a0Patnaik and C.N.\u00a0Babu Information retrieval from web with faster R-CNN deep learning networks: A new perspective in: 6th International Computer Science and Engineering Conference (UBMK 2021) 2021.","DOI":"10.1109\/UBMK52708.2021.9558956"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.26599\/BDMA.2021.9020012"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000464"},{"key":"e_1_3_1_59_2","unstructured":"H.\u00a0Rao and M.\u00a0Sashikumar A survey on automated web data extraction techniques for product specification from E-commerce web sites International Journal of Advanced Research in Computer Science and Software Engineering6(8) (2016)."},{"key":"e_1_3_1_60_2","unstructured":"K.\u00a0Raymond and B.\u00a0Hendrik Web Mining Research: A Survey ACM SIGKDD 2000."},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","unstructured":"J.\u00a0Redmon S.\u00a0Divvala R.\u00a0Girshick and A.\u00a0Farhadi You only look once: Unified real-time object detection in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Las Vegas NV 2016 pp.\u00a0779\u2013788. doi:10.1109\/CVPR.2016.91.","DOI":"10.1109\/CVPR.2016.91"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","unstructured":"J.\u00a0Redmon and A.\u00a0Farhadi YOLO 9000: Better faster stronger in: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Honolulu HI 2017 pp.\u00a06517\u20136525. doi:10.1109\/CVPR.2017.690.","DOI":"10.1109\/CVPR.2017.690"},{"key":"e_1_3_1_63_2","unstructured":"S.\u00a0Ren K.\u00a0He R.\u00a0Girshick and J.\u00a0Sun Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks 2016 1506.01497v3 [cs.CV]."},{"key":"e_1_3_1_64_2","unstructured":"L.\u00a0Rinaldo O.\u00a0Hil\u00e1rio F.\u00a0Fred E.\u00a0Bernard and P.\u00a0Laura Information extraction from the web: An ontology\u2013 based method using inductive logic programming in: IEEE 25th International Conference on Tools with Artificial Intelligence 2013."},{"key":"e_1_3_1_65_2","unstructured":"P.\u00a0Sabev and K.\u00a0Grigorova Comparative study of GUI automated tools for software testing SOFTENG 2017 in: The 3rd International Conference on Advances and Trends in Software Engineering Vol.\u00a03 Venice Italy 2017."},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","unstructured":"A.\u00a0Sahuguet and A.\u00a0Fabien Building Intelligent Web Applications Using Lightweight Wrappers Data Knowledge Engineering (2001) 283\u2013316. doi:10.1016\/S0169-023X(00)00051-3.","DOI":"10.1016\/S0169-023X(00)00051-3"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","unstructured":"M.\u00a0Salah B.A.\u00a0Okush and M.A.\u00a0Rifaee A comparison of web data extraction techniques in: 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT) Amman Jordan 2019 pp.\u00a0785\u2013789. doi:10.1109\/JEEIT.2019.8717519.","DOI":"10.1109\/JEEIT.2019.8717519"},{"key":"e_1_3_1_68_2","doi-asserted-by":"crossref","unstructured":"S.\u00a0Shengsheng W.\u00a0Wu L.\u00a0Yulong W.\u00a0Haitao L.\u00a0Lei Y.\u00a0Chunfeng and H.\u00a0Yihua NEXIR: A novel web extraction rule language toward a three-stage web data extraction model in: International Conference on Web Information Systems Engineering WISE 2013: Web Information Systems Engineering \u2013 WISE 2013 2013 pp.\u00a029\u201342.","DOI":"10.1007\/978-3-642-41230-1_3"},{"key":"e_1_3_1_69_2","unstructured":"U.\u00a0Shreya Articulating the Construction of a Web Scraper for Massive Data Extraction 2017 978-1-5090-3239-6\/17\/IEEE."},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","unstructured":"J.\u00a0Singh and M.\u00a0Sharma A Comprehensive Review of Web-based Automation Testing Tools International Journal of Innovative Research in Computer and Communication Engineering3(10) (2015). doi:10.15680\/IJIRCCE.2016.0410010.","DOI":"10.15680\/IJIRCCE.2016.0410010"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","unstructured":"C.\u00a0Slametet al. Web scraping and na\u00efve Bayes classification for job search engine IOP Conf. Ser.: Mater. Sci. Eng.288 (2018) 012038. doi:10.1088\/1757-899X\/288\/1\/012038.","DOI":"10.1088\/1757-899X\/288\/1\/012038"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","unstructured":"S.\u00a0Soderland Learning Information Extraction Rules for Semi-Structured and Free Text J. Mach. Learn. (1999) 233\u2013272. doi:10.1023\/A:1007562322031.","DOI":"10.1023\/A:1007562322031"},{"key":"e_1_3_1_73_2","unstructured":"N.\u00a0Thomas Web Data Extraction Master Thesis Department of Software Engineering Faculty of Mathematics and Physics Charles University Prague 2016."},{"key":"e_1_3_1_74_2","unstructured":"W.\u00a0Tim P.\u00a0Rodrigo C.\u00a0Valter G.\u00a0Thomas and M.\u00a0Paolo Web Content Extraction \u2013 a Meta-Analysis of its Past and Thoughts on its Future 2015 1508.04066 [cs]."},{"key":"e_1_3_1_75_2","doi-asserted-by":"crossref","unstructured":"B.\u00a0Ujwal G.\u00a0Bharat K.\u00a0Abhishek H.\u00a0Anusha and R.\u00a0Mukund Classification-based adaptive web scraper in: 16th IEEE International Conference on Machine Learning and Applications 2017.","DOI":"10.1109\/ICMLA.2017.0-168"},{"key":"e_1_3_1_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2984503"},{"key":"e_1_3_1_77_2","doi-asserted-by":"publisher","unstructured":"D.\u00a0Vidroha B.\u00a0Lance Y.\u00a0Matthew and E.\u00a0Archana Automating web application testing from the ground up: Experiences and lessons learned in an industrial setting in: 2018 IEEE 11th International Conference on Software Testing Verification and Validation (ICST) 2018. doi:10.1109\/ICST.2018.00042.","DOI":"10.1109\/ICST.2018.00042"},{"key":"e_1_3_1_78_2","doi-asserted-by":"publisher","unstructured":"C.\u00a0Wang and P.\u00a0Wei A novel web page text information extraction method in: 2019 IEEE 3rd Information Technology Networking Electronic and Automation Control Conference (ITNEC) Chengdu China 2019 pp.\u00a02213\u20132218. doi:10.1109\/ITNEC.2019.8729329.","DOI":"10.1109\/ITNEC.2019.8729329"},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","unstructured":"K.\u00a0Wiklund S.\u00a0Eldh and D.\u00a0Sundmark Impediments for software test automation: A systematic literature review Journal of Software: Testing Verification and Reliability (2017). doi:10.1002\/stvr.1639.","DOI":"10.1002\/stvr.1639"},{"key":"e_1_3_1_80_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2938768"},{"key":"e_1_3_1_81_2","doi-asserted-by":"publisher","DOI":"10.3233\/WEB-2005-wia00071"},{"key":"e_1_3_1_82_2","doi-asserted-by":"publisher","unstructured":"Y.\u00a0Zhai and L.\u00a0Bing Extracting Web Data Using Instance-Based Learning 2007. doi:10.1007\/s11280-007-0022-0.","DOI":"10.1007\/s11280-007-0022-0"},{"key":"e_1_3_1_83_2","doi-asserted-by":"crossref","unstructured":"Y.\u00a0Zhai and B.\u00a0Liu Web Data Extraction Based on Partial Tree Alignment Department of Computer Science University of Illinois at Chicago USA 2005.","DOI":"10.1145\/1060745.1060761"},{"key":"e_1_3_1_84_2","doi-asserted-by":"publisher","DOI":"10.3233\/JIFS-179996"},{"key":"e_1_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.3233\/THC-202638"}],"container-title":["Web Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/WEB-210465","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/WEB-210465","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/WEB-210465","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T05:27:26Z","timestamp":1777613246000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/WEB-210465"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6]]},"references-count":84,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["10.3233\/WEB-210465"],"URL":"https:\/\/doi.org\/10.3233\/web-210465","relation":{},"ISSN":["2405-6456","2405-6464"],"issn-type":[{"value":"2405-6456","type":"print"},{"value":"2405-6464","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6]]}}}