{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T01:45:12Z","timestamp":1760060712406,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2025,9,15]],"date-time":"2025-09-15T00:00:00Z","timestamp":1757894400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>This study addresses the limitations of traditional job recommendation systems that rely on static datasets, making them less responsive to dynamic job market changes. While existing job platforms address job search with an untransparent logic following their business goals, job seekers may benefit from a solution actively and dynamically crawling and evaluating job offers from a variety of sites according to their objectives. To address this gap, a hybrid system was developed that integrates large language models (LLMs) for semantic analysis with near real-time data acquisition through web crawling. The system extracts and ranks job-specific keywords from user inputs, such as resumes, while dynamically retrieving job listings from online platforms. User evaluations indicated strong performance in keyword extraction and system usability but revealed challenges in web crawler performance, affecting recommendation accuracy. Compared with a state-of-the-art commercial tool, user tests indicate a smaller accuracy of our prototype but a higher functionality satisfaction. Test users highlighted its great potential for further development. The results highlight the benefits of combining LLMs and web crawling while emphasizing the need for improved near real-time data handling to enhance recommendation precision and user satisfaction.<\/jats:p>","DOI":"10.3390\/computers14090387","type":"journal-article","created":{"date-parts":[[2025,9,15]],"date-time":"2025-09-15T10:51:33Z","timestamp":1757933493000},"page":"387","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Integrating Large Language Models with near Real-Time Web Crawling for Enhanced Job Recommendation Systems"],"prefix":"10.3390","volume":"14","author":[{"given":"David","family":"Gauhl","sequence":"first","affiliation":[{"name":"School of Business, University of Applied Sciences and Arts Northwestern Switzerland, 4600 Olten, Switzerland"}]},{"given":"Kevin","family":"Kakkanattu","sequence":"additional","affiliation":[{"name":"School of Business, University of Applied Sciences and Arts Northwestern Switzerland, 4600 Olten, Switzerland"}]},{"given":"Melbin","family":"Mukkattu","sequence":"additional","affiliation":[{"name":"School of Business, University of Applied Sciences and Arts Northwestern Switzerland, 4600 Olten, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5636-1660","authenticated-orcid":false,"given":"Thomas","family":"Hanne","sequence":"additional","affiliation":[{"name":"Institute for Information Systems, University of Applied Sciences and Arts Northwestern Switzerland, 4600 Olten, Switzerland"}]}],"member":"1968","published-online":{"date-parts":[[2025,9,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Pei, Y., Pang, Y.W., Cai, W., Sengupta, N., and Toshniwal, D. (2024, January 14\u201318). Leveraging LLM generated labels to reduce bad matches in job recommendations. Proceedings of the 18th ACM Conference on Recommender Systems, Bari, Italy.","DOI":"10.1145\/3640457.3688043"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"9178","DOI":"10.1609\/aaai.v38i8.28769","article-title":"Exploring Large Language Model for Graph Data Understanding in Online Job Recommendations","volume":"Volume 38","author":"Wu","year":"2024","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"7797548","DOI":"10.1155\/2022\/7797548","article-title":"Technical Job Recommendation System Using APIs and Web Crawling","volume":"2022","author":"Kumar","year":"2022","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_4","unstructured":"Zheng, Z., Qiu, Z., Hu, X., Wu, L., Zhu, H., and Xiong, H. (2023). Generative Job Recommendations with Large Language Model. arXiv."},{"key":"ref_5","unstructured":"Ghosh, P., and Sadaphal, V. (2023). JobRecoGPT\u2014Explainable job recommendations using LLMs. arXiv."},{"key":"ref_6","first-page":"29","article-title":"Job Recommendation System Using Profile Matching and Web-Crawling","volume":"1","author":"Musale","year":"2016","journal-title":"Int. J. Adv. Sci. Res. Eng. Trends"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mankawade, A., Pungliya, V., Bhonsle, R., Pate, S., Purohit, A., and Raut, A. (2023, January 7\u20139). Resume Analysis and Job Recommendation. Proceedings of the 2023 IEEE 8th International Conference for Convergence in Technology (I2CT), Pune, India.","DOI":"10.1109\/I2CT57861.2023.10126171"},{"key":"ref_8","first-page":"172","article-title":"An AI-based Personalised Job Recommendation and Application Assistant Agent for Enhanced Employment Matching: A Scrapus Use Case","volume":"1","year":"2025","journal-title":"J. Data Anal. Artif. Intell. Appl."},{"key":"ref_9","first-page":"482","article-title":"Real-Time Job Seeker Automation: Applying Jobs Across Platforms Effortlessly","volume":"2","author":"Gore","year":"2025","journal-title":"Int. J. Sci. Innov. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.32628\/IJSRSET2512145","article-title":"AI-Driven Intelligent Resume Recommendation Engine","volume":"12","author":"Akhtar","year":"2025","journal-title":"Int. J. Sci. Res. Sci. Eng. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"13286","DOI":"10.1609\/aaai.v34i08.7038","article-title":"Implicit Skills Extraction Using Document Embedding and Its Use in Job Recommendation","volume":"Volume 34","author":"Gugnani","year":"2020","journal-title":"Proceedings of the Thirty-Second Innovative Applications of Artificial Intelligence Conference"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1016\/j.procs.2017.11.448","article-title":"Topic Modeling Driven Content Based Jobs Recommendation Engine for Recruitment Industry","volume":"122","author":"Bansal","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1186\/s40537-025-01173-y","article-title":"Job recommender systems: A systematic literature review, applications, open issues, and challenges","volume":"12","author":"Bitirim","year":"2025","journal-title":"J. Big Data"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Vom Brocke, J., Hevner, A., and Maedche, A. (2020). Introduction to design science research. Design Science Research. Cases, Springer International Publishing.","DOI":"10.1007\/978-3-030-46781-4"},{"key":"ref_15","unstructured":"Venable, J.R., Pries-Heje, J., and Baskerville, R.L. (2017). Choosing a Design Science Research Methodology. ACIS 2017 Proceedings, The Association for Information Systems (AIS). Available online: https:\/\/aisel.aisnet.org\/acis2017\/112."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jay, R. (2024). Introduction to LangChain and LLMs. Generative AI Apps with LangChain and Python: A Project-Based Approach to Building Real-World LLM Apps, Apress.","DOI":"10.1007\/979-8-8688-0882-1"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"823","DOI":"10.32996\/jcsts.2025.7.7.88","article-title":"Designing High-Throughput FastAPI Gateways for Microservice Communication","volume":"7","author":"Alla","year":"2025","journal-title":"J. Comput. Sci. Technol. Stud."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Vadlamani, V. (2024). PostgreSQL Skills Development on Cloud: A Practical Guide to Database Management with AWS and Azure, Apress.","DOI":"10.1007\/979-8-8688-0817-3"},{"key":"ref_19","unstructured":"Gemini Team Google (2024). Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. arXiv."},{"key":"ref_20","unstructured":"Mitchell, R. (2024). Web Scraping with Python, O\u2019Reilly Media, Inc."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Srivastava, S., Shukla, H., Landge, N., Srivastava, A., and Jindal, D. (2024, January 16\u201317). A Comprehensive Review of Next.js Technology: Advancements, Features, and Applications. Proceedings of the International Conference on Innovative Computing & Communication (ICICC 2024), Delhi, India.","DOI":"10.2139\/ssrn.4831070"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Muzumdar, P., Bhosale, A., Basyal, G.P., and Kurian, G. (2024). Navigating the Docker ecosystem: A comprehensive taxonomy and survey. arXiv.","DOI":"10.9734\/ajrcos\/2024\/v17i1411"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Divakaran, A. (2025). Packaging. Deep Dive Python: Techniques and Best Practices for Developers, Apress.","DOI":"10.1007\/979-8-8688-1261-3"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Shaikym, A., Zhalgassova, Z., and Sadyk, U. (2023, January 1\u20132). Design and Evaluation of a Personalized Job Recommendation System for Computer Science Students Using Hybrid Approach. Proceedings of the 2023 17th International Conference on Electronics Computer and Computation (ICECCO), Kaskelen, Kazakhstan.","DOI":"10.1109\/ICECCO58239.2023.10147147"},{"key":"ref_25","unstructured":"Frew, A.J. (2005). An Experimental Usability Test for different Destination Recommender Systems. Information and Communication Technologies in Tourism, Springer."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Pu, P., Chen, L., and Hu, R. (2011, January 23\u201327). A user-centric evaluation framework for recommender systems. Proceedings of the Fifth ACM Conference on Recommender Systems, Chicago, IL, USA.","DOI":"10.1145\/2043932.2043962"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Vijayan, A. (2023, January 22\u201324). A Prompt Engineering Approach for Structured Data Extraction from Unstructured Text Using Conversational LLMs. Proceedings of the 2023 6th International Conference on Algorithms, Computing and Artificial Intelligence, Sanya, China.","DOI":"10.1145\/3639631.3639663"},{"key":"ref_28","first-page":"5","article-title":"Intelligent Web Crawling (WI-IAT 2013 Tutorial)","volume":"14","author":"Shestakov","year":"2013","journal-title":"IEEE Intell. Inform. Bull."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/9\/387\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:45:40Z","timestamp":1760035540000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/9\/387"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,15]]},"references-count":28,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2025,9]]}},"alternative-id":["computers14090387"],"URL":"https:\/\/doi.org\/10.3390\/computers14090387","relation":{},"ISSN":["2073-431X"],"issn-type":[{"type":"electronic","value":"2073-431X"}],"subject":[],"published":{"date-parts":[[2025,9,15]]}}}