{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,26]],"date-time":"2025-03-26T14:06:39Z","timestamp":1742997999449,"version":"3.40.3"},"publisher-location":"Cham","reference-count":29,"publisher":"Springer Nature Switzerland","isbn-type":[{"type":"print","value":"9783031657931"},{"type":"electronic","value":"9783031657948"}],"license":[{"start":{"date-parts":[[2024,1,1]],"date-time":"2024-01-01T00:00:00Z","timestamp":1704067200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,8,15]],"date-time":"2024-08-15T00:00:00Z","timestamp":1723680000000},"content-version":"vor","delay-in-days":227,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper aims to tackle the challenge posed by the increasing integration of software tools in research across various disciplines by investigating the application of Falcon-7b for the detection and classification of software mentions within scholarly texts. Specifically, the study focuses on solving Subtask I of the Software Mention Detection in Scholarly Publications (SOMD), which entails identifying and categorizing software mentions from academic literature. Through comprehensive experimentation, the paper explores different training strategies, including a dual-classifier approach, adaptive sampling, and weighted loss scaling, to enhance detection accuracy while overcoming the complexities of class imbalance and the nuanced syntax of scholarly writing. The findings highlight the benefits of selective labelling and adaptive sampling in improving the model\u2019s performance. However, they also indicate that integrating multiple strategies does not necessarily result in cumulative improvements. This research offers insights into the effective application of large language models for specific tasks such as SOMD, underlining the importance of tailored approaches to address the unique challenges presented by academic text analysis.<\/jats:p>","DOI":"10.1007\/978-3-031-65794-8_20","type":"book-chapter","created":{"date-parts":[[2024,8,14]],"date-time":"2024-08-14T06:02:44Z","timestamp":1723615364000},"page":"278-288","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Falcon 7b for\u00a0Software Mention Detection in\u00a0Scholarly Documents"],"prefix":"10.1007","author":[{"given":"AmeerAli","family":"Khan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8159-918X","authenticated-orcid":false,"given":"Qusai","family":"Ramadan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8314-0935","authenticated-orcid":false,"given":"Cong","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9778-9164","authenticated-orcid":false,"given":"Zeyd","family":"Boukhers","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,8,15]]},"reference":[{"key":"20_CR1","unstructured":"Ahmed, R.M.W.: Metadata Extraction using Geometric and Layout Features from Research Publications. Ph.D. thesis, Capital University (2022)"},{"key":"20_CR2","doi-asserted-by":"crossref","unstructured":"Alfred, R., Leong, L.C., On, C.K., Anthony, P.: Malay named entity recognition based on rule-based approach (2014)","DOI":"10.7763\/IJMLC.2014.V4.428"},{"key":"20_CR3","doi-asserted-by":"publisher","unstructured":"Almazrouei, E., et al.: The Falcon Series of Open Language Models (Nov 2023). https:\/\/doi.org\/10.48550\/arXiv.2311.16867, http:\/\/arxiv.org\/abs\/2311.16867, arXiv:2311.16867 [cs]","DOI":"10.48550\/arXiv.2311.16867"},{"key":"20_CR4","doi-asserted-by":"crossref","unstructured":"Boukhers, Z., Ambhore, S., Staab, S.: An end-to-end approach for extracting and segmenting high-variance references from pdf documents. In: 2019 ACM\/IEEE Joint Conference on Digital Libraries (JCDL), pp. 186\u2013195. IEEE (2019)","DOI":"10.1109\/JCDL.2019.00035"},{"key":"20_CR5","doi-asserted-by":"crossref","unstructured":"Boukhers, Z., Beili, N., Hartmann, T., Goswami, P., Zafar, M.A.: Mexpub: deep transfer learning for metadata extraction from German publications. In: 2021 ACM\/IEEE Joint Conference on Digital Libraries (JCDL), pp. 250\u2013253. IEEE (2021)","DOI":"10.1109\/JCDL52503.2021.00076"},{"key":"20_CR6","unstructured":"Brown, T.B., et al.: Language models are few-shot learners (2020)"},{"key":"20_CR7","doi-asserted-by":"publisher","first-page":"103381","DOI":"10.1016\/j.jbi.2020.103381","volume":"103","author":"M Cho","year":"2020","unstructured":"Cho, M., Ha, J., Park, C., Park, S.: Combinatorial feature embedding based on CNN and LSTM for biomedical named entity recognition. J. Biomed. Inform. 103, 103381 (2020)","journal-title":"J. Biomed. Inform."},{"key":"20_CR8","unstructured":"Cu\u00e9llar-Hidalgo, R., Reyes-Salgado, G., Torres-Moreno, J.M.: Automatic reference mining: review and perspectives. In: TextMine (2022)"},{"key":"20_CR9","doi-asserted-by":"publisher","unstructured":"Gholami-Dastgerdi, P., Feizi-Derakhshi, M., Forouzandeh, A.: Named entities detection by beam search algorithm. Concurrency Comput. Pract. Exp.34(27), e7325 (2022). https:\/\/doi.org\/10.1002\/cpe.7325, https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cpe.7325","DOI":"10.1002\/cpe.7325"},{"key":"20_CR10","doi-asserted-by":"crossref","unstructured":"Guo, M., et al.: Investigations on scientific literature meta information extraction using large language models. In: 2023 IEEE International Conference on Knowledge Graph (ICKG), pp. 249\u2013254. IEEE (2023)","DOI":"10.1109\/ICKG59574.2023.00036"},{"key":"20_CR11","doi-asserted-by":"crossref","unstructured":"Jin, X., Vinzamuri, B., Venkatapathy, S., Ji, H., Natarajan, P.: Adversarial robustness for large language NER models using disentanglement and word attributions. In: The 2023 Conference on Empirical Methods in Natural Language Processing (2023)","DOI":"10.18653\/v1\/2023.findings-emnlp.830"},{"key":"20_CR12","doi-asserted-by":"publisher","unstructured":"Kesim, E., Deliahmetoglu, A.: Named entity recognition in resumes, June 2023. https:\/\/doi.org\/10.48550\/arXiv.2306.13062, http:\/\/arxiv.org\/abs\/2306.13062, arXiv:2306.13062 [cs]","DOI":"10.48550\/arXiv.2306.13062"},{"key":"20_CR13","doi-asserted-by":"publisher","first-page":"103737","DOI":"10.1016\/j.jbi.2021.103737","volume":"116","author":"J Kong","year":"2021","unstructured":"Kong, J., Zhang, L., Jiang, M., Liu, T.: Incorporating multi-level CNN and attention mechanism for chinese clinical named entity recognition. J. Biomed. Inform. 116, 103737 (2021)","journal-title":"J. Biomed. Inform."},{"key":"20_CR14","doi-asserted-by":"publisher","unstructured":"Li, W.: The Advance of deep learning based named entity recognition. Highlights in Sci. Eng. Technol. 12, 68\u201373 (2022). https:\/\/doi.org\/10.54097\/hset.v12i.1368, https:\/\/drpress.org\/ojs\/index.php\/HSET\/article\/view\/1368","DOI":"10.54097\/hset.v12i.1368"},{"key":"20_CR15","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1007\/978-3-030-23367-9_12","volume-title":"Artificial Intelligence and Mobile Services \u2013 AIMS 2019","author":"C Liu","year":"2019","unstructured":"Liu, C., Li, J., Liu, Y., Du, J., Tang, B., Xu, R.: Named entity recognition in clinical text based on capsule-LSTM for privacy protection. In: Wang, D., Zhang, L.-J. (eds.) AIMS 2019. LNCS, vol. 11516, pp. 166\u2013178. Springer, Cham (2019). https:\/\/doi.org\/10.1007\/978-3-030-23367-9_12"},{"key":"20_CR16","doi-asserted-by":"crossref","unstructured":"Morwal, S., Jahan, N., Chopra, D.: Named entity recognition using hidden markov model (HMM). Int. J. Nat. Lang. Comput. (IJNLC) 1 (2012)","DOI":"10.5121\/ijnlc.2012.1402"},{"key":"20_CR17","doi-asserted-by":"crossref","unstructured":"Oliveira, V., Nogueira, G., Faleiros, T., Marcacini, R.: Combining prompt-based language models and weak supervision for labeling named entity recognition on legal documents. Artif. Intell. Law 1\u201321 (2024)","DOI":"10.1007\/s10506-023-09388-1"},{"key":"20_CR18","unstructured":"Paszke, A., et al.: Pytorch: an imperative style, high-performance deep learning library. In: Advances in Neural Information Processing Systems 32, pp. 8024\u20138035. Curran Associates, Inc. (2019). http:\/\/papers.neurips.cc\/paper\/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf"},{"key":"20_CR19","doi-asserted-by":"publisher","first-page":"217231","DOI":"10.1109\/ACCESS.2020.3042455","volume":"8","author":"STR Rizvi","year":"2020","unstructured":"Rizvi, S.T.R., Dengel, A., Ahmed, S.: A hybrid approach and unified framework for bibliographic reference extraction. IEEE Access 8, 217231\u2013217245 (2020)","journal-title":"IEEE Access"},{"key":"20_CR20","doi-asserted-by":"publisher","unstructured":"Schindler, D., Bensmann, F., Dietze, S., Kr\u00fcger, F.: Somesci- a 5 star open data gold standard knowledge graph of software mentions in scientific articles. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, CIKM 2021, pp. 4574-4583. Association for Computing Machinery, New York, NY, USA (2021). https:\/\/doi.org\/10.1145\/3459637.3482017","DOI":"10.1145\/3459637.3482017"},{"key":"20_CR21","doi-asserted-by":"publisher","unstructured":"Schindler, D., Bensmann, F., Dietze, S., Kr\u00fcger, F.: SoMeSci- a 5 star open data gold standard knowledge graph of software mentions in scientific articles. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 4574\u20134583. ACM, Virtual Event Queensland Australia, October 2021. https:\/\/doi.org\/10.1145\/3459637.3482017, https:\/\/dl.acm.org\/doi\/10.1145\/3459637.3482017","DOI":"10.1145\/3459637.3482017"},{"key":"20_CR22","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1007\/978-3-030-49461-2_16","volume-title":"The Semantic Web","author":"D Schindler","year":"2020","unstructured":"Schindler, D., Zapilko, B., Kr\u00fcger, F.: Investigating software usage in the social sciences: a knowledge graph approach. In: Harth, A., et al. (eds.) ESWC 2020. LNCS, vol. 12123, pp. 271\u2013286. Springer, Cham (2020). https:\/\/doi.org\/10.1007\/978-3-030-49461-2_16"},{"key":"20_CR23","doi-asserted-by":"publisher","unstructured":"Singh, A., Garg, A.: Named entity recognition (NER) and relation extraction in scientific publications. Int. J. Recent Technol. Eng. (IJRTE) 12(2), 110\u2013113 (2023). https:\/\/doi.org\/10.35940\/ijrte.B7846.0712223, https:\/\/www.ijrte.org\/portfolio-item\/B78460712223\/","DOI":"10.35940\/ijrte.B7846.0712223"},{"key":"20_CR24","unstructured":"Touvron, H., et al.: Llama 2: open foundation and fine-tuned chat models (2023)"},{"key":"20_CR25","doi-asserted-by":"publisher","unstructured":"VeeraSekharReddy, B., Rao, K.S., Koppula, N.: named entity recognition using CRF with active learning algorithm in English texts. In: 2022 6th International Conference on Electronics, Communication and Aerospace Technology, pp. 1041\u20131044, December 2022. https:\/\/doi.org\/10.1109\/ICECA55336.2022.10009592, https:\/\/ieeexplore.ieee.org\/document\/10009592","DOI":"10.1109\/ICECA55336.2022.10009592"},{"key":"20_CR26","unstructured":"Wang, S., et al.: GPT-NER: named entity recognition via large language models. arXiv preprint arXiv:2304.10428 (2023)"},{"key":"20_CR27","doi-asserted-by":"publisher","unstructured":"Wilkinson, M.D., et al.: The fair guiding principles for scientific data management and stewardship. Sci. Data 3(1) (2016). https:\/\/doi.org\/10.1038\/sdata.2016.18","DOI":"10.1038\/sdata.2016.18"},{"key":"20_CR28","doi-asserted-by":"publisher","unstructured":"Wolf, T., et al.: HuggingFace\u2019s transformers: state-of-the-art natural language processing, July 2020. https:\/\/doi.org\/10.48550\/arXiv.1910.03771, http:\/\/arxiv.org\/abs\/1910.03771, arXiv:1910.03771 [cs]","DOI":"10.48550\/arXiv.1910.03771"},{"key":"20_CR29","doi-asserted-by":"crossref","unstructured":"Zhang, Z., et al.: E-ner: evidential deep learning for trustworthy named entity recognition. In: Findings of the Association for Computational Linguistics: ACL 2023, pp. 1619\u20131634 (2023)","DOI":"10.18653\/v1\/2023.findings-acl.103"}],"container-title":["Lecture Notes in Computer Science","Natural Scientific Language Processing and Research Knowledge Graphs"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-65794-8_20","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,14]],"date-time":"2024-08-14T06:06:08Z","timestamp":1723615568000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-65794-8_20"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024]]},"ISBN":["9783031657931","9783031657948"],"references-count":29,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-65794-8_20","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"type":"print","value":"0302-9743"},{"type":"electronic","value":"1611-3349"}],"subject":[],"published":{"date-parts":[[2024]]},"assertion":[{"value":"15 August 2024","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"NSLP","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Workshop on Natural Scientific Language Processing and Research Knowledge Graphs","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Hersonissos, Crete","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Greece","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2024","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"26 May 2024","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"26 May 2024","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"1","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"nslp2024","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/nfdi4ds.github.io\/nslp2024\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}