{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T14:41:09Z","timestamp":1781880069187,"version":"3.54.5"},"reference-count":59,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2025,4,28]],"date-time":"2025-04-28T00:00:00Z","timestamp":1745798400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Nowadays, accessibility to academic papers has been significantly improved with electric publications on the internet, where open access has become common. At the same time, it has increased workloads in literature surveys for researchers who usually manually download PDF files and check their contents. To solve this drawback, we have proposed a reference paper collection system using a web scraping technology and natural language models. However, our previous system often finds a limited number of relevant reference papers after taking long time, since it relies on one paper search website and runs on a single thread at a multi-core CPU. In this paper, we present an improved reference paper collection system with three enhancements to solve them: (1) integrating the APIs from multiple paper search web sites, namely, the bulk search endpoint in the Semantic Scholar API, the article search endpoint in the DOAJ API, and the search and fetch endpoint in the PubMed API to retrieve article metadata, (2) running the program on multiple threads for multi-core CPU, and (3) implementing Dynamic URL Redirection, Regex-based URL Parsing, and HTML Scraping with URL Extraction for fast checking of PDF file accessibility, along with sentence embedding to assess relevance based on semantic similarity. For evaluations, we compare the number of obtained reference papers and the response time between the proposal, our previous work, and common literature search tools in five reference paper queries. The results show that the proposal increases the number of relevant reference papers by 64.38% and reduces the time by 59.78% on average compared to our previous work, while outperforming common literature search tools in reference papers. Thus, the effectiveness of the proposed system has been demonstrated in our experiments.<\/jats:p>","DOI":"10.3390\/fi17050195","type":"journal-article","created":{"date-parts":[[2025,4,28]],"date-time":"2025-04-28T09:39:47Z","timestamp":1745833187000},"page":"195","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["An Improved Reference Paper Collection System Using Web Scraping with Three Enhancements"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9895-2442","authenticated-orcid":false,"given":"Tresna Maulana","family":"Fahrudin","sequence":"first","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 700-8530, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nobuo","family":"Funabiki","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 700-8530, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2896-6686","authenticated-orcid":false,"given":"Komang Candra","family":"Brata","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 700-8530, Japan"},{"name":"Department of Informatics Engineering, Universitas Brawijaya, Malang 65145, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-4395-4164","authenticated-orcid":false,"given":"Inzali","family":"Naing","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 700-8530, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-4598-0878","authenticated-orcid":false,"given":"Soe Thandar","family":"Aung","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 700-8530, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-4161-8277","authenticated-orcid":false,"given":"Amri","family":"Muhaimin","sequence":"additional","affiliation":[{"name":"Department of Data Science, Universitas Pembangunan Nasional Veteran Jawa Timur, Surabaya 60294, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0281-9928","authenticated-orcid":false,"given":"Dwi Arman","family":"Prasetya","sequence":"additional","affiliation":[{"name":"Department of Data Science, Universitas Pembangunan Nasional Veteran Jawa Timur, Surabaya 60294, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,4,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1186\/s13244-024-01794-6","article-title":"Publishing in open access journals","volume":"15","author":"Quaia","year":"2024","journal-title":"Insights Imaging"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1080\/02763869.2017.1259918","article-title":"Sci-Hub: What librarians should know and do about article piracy","volume":"36","author":"Hoy","year":"2017","journal-title":"Med. Ref. Serv. Q."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1177\/02666669221144429","article-title":"Jumping over the paywall: Strategies and motivations for scholarly piracy and other alternatives","volume":"40","year":"2024","journal-title":"Inf. Dev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1038\/545145a","article-title":"Science publishers try new tack to combat unauthorized paper sharing","volume":"545","author":"Schiermeier","year":"2017","journal-title":"Nature"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Pagallo, U., and Ciani, J. (2023). Anatomy of web data scraping: Ethics, standards, and the troubles of the law. Soc. Sci. Res. Netw., 1\u201312.","DOI":"10.57230\/ejplt232PS"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Cao, Y., Cheung, N.A., Giustini, D., LeDue, J., and Murphy, T.H. (2024). Scholar Metrics Scraper (SMS): Automated retrieval of citation and author data. Front. Res. Metrics Anal., 9.","DOI":"10.3389\/frma.2024.1335454"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Naing, I., Aung, S.T., Wai, K.H., and Funabiki, N. (2024). A reference paper collection system using web scraping. Electronics, 13.","DOI":"10.3390\/electronics13142700"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"145","DOI":"10.5195\/jmla.2018.280","article-title":"Semantic Scholar","volume":"106","author":"Fricke","year":"2018","journal-title":"J. Med. Libr. Assoc."},{"key":"ref_9","first-page":"47","article-title":"Directory of Open Access Journals (DOAJ) and its application in academic libraries","volume":"16","author":"Sopan","year":"2022","journal-title":"Pearl A J. Libr. Inf. Sci."},{"key":"ref_10","first-page":"16","article-title":"Exploring PubMed as a reliable resource for scholarly communications services","volume":"107","author":"Williamson","year":"2019","journal-title":"J. Med. Libr. Assoc."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Vignesh, U., Parvathi, R., and Goncalves, R. (2023). Covid live multi-threaded live COVID 19 data scraper. Structural and Functional Aspects of Biocomputing Systems for Data Processing, IGI Global Scientific Publishing.","DOI":"10.4018\/978-1-6684-6523-3"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"022077","DOI":"10.1088\/1742-6596\/1569\/2\/022077","article-title":"Extraction system web content sports new based on web crawler multi thread","volume":"1569","author":"Pramudita","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bayly, D., Kruse, B., and Reidy, C. (2024, January 21\u201325). Streamlit App for Cluster Publication Impact Exploration. Proceedings of the Practice and Experience in Advanced Research Computing 2024: Human Powered Computing (PEARC \u201924), New York, NY, USA.","DOI":"10.1145\/3626203.3670633"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"103385","DOI":"10.1016\/j.ipm.2023.103385","article-title":"New trends in bibliometric APIs: A comparative analysis","volume":"60","author":"Perez","year":"2023","journal-title":"Inf. Process. Manag."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Dhalla, H.K. (2020, January 2\u20136). A Performance analysis of native JSON parsers in Java, Python, MS.NET Core, JavaScript, and PHP. Proceedings of the 2020 16th International Conference on Network and Service Management (CNSM), Izmir, Turkey.","DOI":"10.23919\/CNSM50824.2020.9269101"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Fumagalli, S., Soletta, G., Agostinetto, G., Striani, M., Labra, M., Casiraghi, M., and Bruno, A. (2023). MADAME: A user-friendly bioinformatic tool for data and metadata retrieval in microbiome research. bioRxiv.","DOI":"10.1101\/2023.10.14.562335"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Goto, A., Rodriguez-Esteban, R., Scharf, S.H., and Morris, G.M. (2022). Understanding the genetics of viral drug resistance by integrating clinical data and mining of the scientific literature. Sci. Rep., 12.","DOI":"10.1038\/s41598-022-17746-3"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sodian, L., Wen, J.P., Davidson, L., and Loskot, P. (2022, January 23\u201325). Concurrency and parallelism in speeding up I\/O and CPU-Bound tasks in Python 3.10. Proceedings of the 2022 2nd International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology (CEI), Nanjing, China.","DOI":"10.1109\/CEI57409.2022.9950068"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Thivaharan, S., Srivatsun, G., and Sarathambekai, S. (2020, January 10\u201312). A survey on Python libraries used for social media content scraping. Proceedings of the 2020 International Conference on Smart Electronics and Communication (ICOSEC), Trichy, India.","DOI":"10.1109\/ICOSEC49089.2020.9215357"},{"key":"ref_20","unstructured":"Adhikari, N.S., and Shradha, A. (2024). A comparative study of PDF parsing tools across diverse document categories. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Stankevi\u010dius, L., and Luko\u0161evi\u010dius, M. (2024). Extracting sentence embeddings from pre-trained transformer models. Appl. Sci., 14.","DOI":"10.3390\/app14198887"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1635","DOI":"10.1007\/s11192-015-1642-2","article-title":"Open access and sources of full text articles in Google Scholar in different subject fields","volume":"105","author":"Jamali","year":"2015","journal-title":"Scientometrics"},{"key":"ref_23","first-page":"904","article-title":"Evaluating web scraping performance using XPath, CSS Selector, Regular Expression, and HTML DOM with multiprocessing technical applications","volume":"6","author":"Darmawan","year":"2022","journal-title":"JOIV Int. J. Inform. Vis."},{"key":"ref_24","unstructured":"(2024, November 01). Publish or Perish. Available online: https:\/\/harzing.com\/resources\/publish-or-perish."},{"key":"ref_25","unstructured":"(2024, November 01). OpenAIRE. Available online: https:\/\/explore.openaire.eu."},{"key":"ref_26","unstructured":"(2024, November 01). OpenAlex. Available online: https:\/\/openalex.org."},{"key":"ref_27","unstructured":"(2025, April 01). Google Scholar. Available online: https:\/\/scholar.google.com\/."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wu, J., Kim, K., and Giles, C.L. (2019, January 13\u201315). CiteSeerX: 20 Years of Service to Scholarly Big Data. Proceedings of the Conference on Artificial Intelligence for Data Discovery and Reuse (AIDR \u201919), New York, NY, USA.","DOI":"10.1145\/3359115.3359119"},{"key":"ref_29","first-page":"35","article-title":"CiteSeerX: AI in a digital library search engine","volume":"36","author":"Wu","year":"2015","journal-title":"AI Mag."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1038\/s41597-023-02208-w","article-title":"CORE: A global aggregation service for open access papers","volume":"10","author":"Knoth","year":"2023","journal-title":"Sci. Data"},{"key":"ref_31","unstructured":"Priem, J., Piwowar, H., and Orr, R. (2022). OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts. arXiv."},{"key":"ref_32","unstructured":"(2024, November 05). OurResearch GitHub-OpenAlex. Available online: https:\/\/github.com\/ourresearch."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Maraver, P., Arma\u00f1anzas, R., Gillette, T.A., and Ascoli, G.A. (2019). PaperBot: Open-source web-based search and metadata organization of scientific literature. BMC Bioinform., 20.","DOI":"10.1186\/s12859-019-2613-z"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Atzori, C., Bardi, A., Manghi, P., and Mannocci, A. (2017, January 25). The OpenAIRE workflows for data management. Proceedings of the Italian Research Conference on Digital Libraries (IRCDL), Modena, Italy.","DOI":"10.1007\/978-3-319-68130-6_8"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"e8462","DOI":"10.3897\/rio.2.e8462","article-title":"Paperity Central: An open catalog of all scholarly literature","volume":"2","author":"Wojnarski","year":"2016","journal-title":"Res. Ideas Outcomes"},{"key":"ref_36","first-page":"95","article-title":"URL redirect links and its importance calculated using parallel programming to drastically reduced the execution time","volume":"7","author":"Dande","year":"2018","journal-title":"Int. J. Eng. Technol. (UAE)"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Du, J., and Liu, Y. (2016, January 16\u201318). An Application Based on Regular Expression. Proceedings of the International Conference on Computer Networks and Communication Technology (CNCT 2016), Xiamen, China.","DOI":"10.2991\/cnct-16.2017.17"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Pant, S., Yadav, E.N., Sharma, M., Bedi, Y., and Raturi, A. (2024, January 18\u201319). Web scraping using Beautiful Soup. Proceedings of the 2024 International Conference on Knowledge Engineering and Communication Systems (ICKECS), Chikkaballapur, India.","DOI":"10.1109\/ICKECS61492.2024.10617017"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Galli, C., Donos, N., and Calciolari, E. (2024). Performance of 4 pre-trained sentence transformer models in the semantic query of a systematic review dataset on peri-implantitis. Information, 15.","DOI":"10.3390\/info15020068"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Colangelo, M.T., Meleti, M., Guizzardi, S., Calciolari, E., and Galli, C. (2025). A comparative analysis of sentence transformer models for automated journal recommendation using PubMed metadata. Big Data Cogn. Comput., 9.","DOI":"10.20944\/preprints202501.1334.v1"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1080\/20421338.2022.2124689","article-title":"Google Scholar as a pointer to open full-text sources of research articles: A useful tool for researchers in regions with poor access to scientific literature","volume":"15","author":"Singh","year":"2022","journal-title":"Afr. J. Sci. Technol. Innov. Dev."},{"key":"ref_42","first-page":"2149","article-title":"A comparative analysis of sentence embedding techniques for document ranking","volume":"21","author":"Gupta","year":"2022","journal-title":"J. Web Eng."},{"key":"ref_43","first-page":"215","article-title":"An investigation of information usefulness of Google Scholar in comparison with Web of Science","volume":"15","author":"Kim","year":"2014","journal-title":"J. Korean BIBLIA Soc. Libr. Inf. Sci."},{"key":"ref_44","unstructured":"(2024, November 07). Semantic Scholar API Documentation. Available online: https:\/\/api.semanticscholar.org\/api-docs."},{"key":"ref_45","unstructured":"(2024, November 07). DOAJ API Documentation. Available online: https:\/\/doaj.org\/api\/v4\/docs."},{"key":"ref_46","unstructured":"(2024, November 07). Entrez Programming Utilities Help by National Center for Biotechnology Information, Available online: https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK25501."},{"key":"ref_47","unstructured":"(2024, November 10). Python Requests for JSON Response. Available online: https:\/\/www.geeksforgeeks.org\/response-json-python-requests\/."},{"key":"ref_48","unstructured":"(2024, November 10). The Python Standard Library Documentation\u2014ElementTree XML API. Available online: https:\/\/docs.python.org\/3\/library\/xml.etree.elementtree.html."},{"key":"ref_49","unstructured":"(2024, November 12). BeautifulSoup Documentation. Available online: https:\/\/beautiful-soup-4.readthedocs.io\/en\/latest."},{"key":"ref_50","unstructured":"(2024, November 12). The Python Standard Library Documentation\u2014Regular Expression. Available online: https:\/\/docs.python.org\/3\/library\/re.html."},{"key":"ref_51","unstructured":"(2024, November 15). The Python Standard Library Documentation\u2014Concurrent.futures. Available online: https:\/\/docs.python.org\/3\/library\/concurrent.futures.html."},{"key":"ref_52","unstructured":"(2025, April 01). PyPDF2 Documentation. Available online: https:\/\/pypdf2.readthedocs.io\/en\/3.x\/."},{"key":"ref_53","unstructured":"(2025, April 01). Sentence Transformer Documentation. Available online: https:\/\/www.sbert.net\/index.html."},{"key":"ref_54","unstructured":"(2024, November 15). Streamlit.io Documentation. Available online: https:\/\/docs.streamlit.io\/get-started."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"170","DOI":"10.21449\/ijate.479404","article-title":"The effect of the normalization method used in different sample sizes on the success of artificial neural network model","volume":"6","author":"Aksu","year":"2019","journal-title":"Int. J. Assess. Tools Educ."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1152\/advan.00018.2015","article-title":"Explorations in statistics: The analysis of change","volume":"39","author":"Williams","year":"2015","journal-title":"Adv. Physiol. Educ."},{"key":"ref_57","unstructured":"(2025, April 01). Semantic Scholar API License Agreement. Available online: https:\/\/www.semanticscholar.org\/product\/api\/license."},{"key":"ref_58","unstructured":"(2025, April 01). DOAJ API Terms and Conditions. Available online: https:\/\/doaj.org\/terms\/."},{"key":"ref_59","unstructured":"(2025, April 01). PubMed API Terms of Service, Available online: https:\/\/documentation.uts.nlm.nih.gov\/terms-of-service.html."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/5\/195\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:23:21Z","timestamp":1760030601000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/5\/195"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,28]]},"references-count":59,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,5]]}},"alternative-id":["fi17050195"],"URL":"https:\/\/doi.org\/10.3390\/fi17050195","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,28]]}}}