{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,12,13]],"date-time":"2024-12-13T05:23:31Z","timestamp":1734067411236,"version":"3.30.2"},"reference-count":45,"publisher":"Cambridge University Press (CUP)","issue":"6","license":[{"start":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T00:00:00Z","timestamp":1691625600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2024,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>A competitive and cost-effective public procurement (PP) process is essential for the effective use of public resources. In this work, we explore whether descriptions of procurement calls can be used to predict their outcomes. In particular, we focus on predicting four well-known economic metrics: (i) the number of offers, (ii) whether only a single offer is received, (iii) whether a foreign firm is awarded the contract, and (iv) whether the contract price exceeds the expected price. We extract the European Union\u2019s multilingual PP notices, covering 22 different languages. We investigate fine-tuning multilingual transformer models and propose two approaches: (1) multilayer perceptron (MLP) models with transformer embeddings for each business sector in which the training data are filtered based on the procurement category and (2) a k-nearest neighbor (KNN)-based approach fine-tuned using triplet networks. The fine-tuned MBERT model outperforms all other models in predicting calls with a single offer and foreign contract awards, whereas our MLP-based filtering approach yields state-of-the-art results in predicting contracts in which the contract price exceeds the expected price. Furthermore, our KNN-based approach outperforms all the baselines in all tasks and our other proposed models in predicting the number of offers. Moreover, we investigate cross-lingual and multilingual training for our tasks and observe that multilingual training improves prediction accuracy in all our tasks. Overall, our experiments suggest that notice descriptions play an important role in the outcomes of PP calls.<\/jats:p>","DOI":"10.1017\/s135132492300030x","type":"journal-article","created":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T04:45:02Z","timestamp":1691642702000},"page":"1255-1276","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":1,"title":["How you describe procurement calls matters: Predicting outcome of public procurement using call descriptions"],"prefix":"10.1017","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0381-8831","authenticated-orcid":false,"given":"Utku Umur","family":"Acikalin","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mustafa Kaan","family":"Gorgun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mucahid","family":"Kutlu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bedri Kamil Onur","family":"Tas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2023,8,10]]},"reference":[{"key":"S135132492300030X_ref14","first-page":"35","article-title":"The extent and cost of corruption in transport infrastructure. New evidence from Europe","volume":"113","author":"Fazekas","year":"2018","journal-title":"Transportation Research Part A: Policy and Practice"},{"key":"S135132492300030X_ref27","doi-asserted-by":"publisher","DOI":"10.1007\/s10290-016-0251-3"},{"key":"S135132492300030X_ref9","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2016.2628"},{"key":"S135132492300030X_ref25","first-page":"1245","volume-title":"ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction","author":"Jang","year":"2019"},{"key":"S135132492300030X_ref22","doi-asserted-by":"publisher","DOI":"10.1007\/s11151-006-0012-x"},{"key":"S135132492300030X_ref16","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2020.06.006"},{"key":"S135132492300030X_ref29","first-page":"1580","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings","author":"Lima","year":"2020"},{"volume-title":"How Large Is Public Procurement?","year":"2020","author":"Bosio","key":"S135132492300030X_ref5"},{"key":"S135132492300030X_ref39","doi-asserted-by":"publisher","DOI":"10.1007\/s11149-020-09409-w"},{"key":"S135132492300030X_ref18","doi-asserted-by":"publisher","DOI":"10.1109\/UBMK50275.2020.9219404"},{"key":"S135132492300030X_ref11","first-page":"4171","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers)","author":"Devlin","year":"2019"},{"key":"S135132492300030X_ref36","first-page":"1","volume-title":"2021 IEEE International Conference on Consumer Electronics (ICCE)","author":"Piscitelli","year":"2021"},{"key":"S135132492300030X_ref4","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00288"},{"key":"S135132492300030X_ref3","unstructured":"Aluru, S. S. , Mathew, B. , Saha, P. and Mukherjee, A. (2020). Deep learning models for multilingual hate speech detection. arXiv preprint arXiv:2004.06465 ."},{"key":"S135132492300030X_ref43","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2014.02.014"},{"key":"S135132492300030X_ref44","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1077"},{"key":"S135132492300030X_ref7","doi-asserted-by":"publisher","DOI":"10.1086\/687209"},{"key":"S135132492300030X_ref35","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1493"},{"key":"S135132492300030X_ref31","first-page":"200","volume-title":"DATA","author":"Modrusan","year":"2020"},{"key":"S135132492300030X_ref21","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24261-3_7"},{"volume-title":"Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)","year":"2018","author":"Ahmia","key":"S135132492300030X_ref1"},{"key":"S135132492300030X_ref15","unstructured":"Feng, F. , Yang, Y. , Cer, D. , Arivazhagan, N. and Wang, W. (2020). Language-agnostic bert sentence embedding. arXiv preprint arXiv:2007.01852 ."},{"key":"S135132492300030X_ref28","doi-asserted-by":"publisher","DOI":"10.3390\/app7111141"},{"key":"S135132492300030X_ref19","doi-asserted-by":"crossref","first-page":"01655515221141042","DOI":"10.1177\/01655515221141042","article-title":"Information is essential for competitive and cost-effective public procurement","author":"Gorgun","year":"2022","journal-title":"Journal of Information Science"},{"key":"S135132492300030X_ref20","doi-asserted-by":"publisher","DOI":"10.1016\/j.euroecorev.2014.10.007"},{"key":"S135132492300030X_ref23","doi-asserted-by":"publisher","DOI":"10.1016\/j.irle.2021.106016"},{"key":"S135132492300030X_ref30","doi-asserted-by":"publisher","DOI":"10.1016\/j.aei.2018.04.005"},{"key":"S135132492300030X_ref6","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.118246"},{"key":"S135132492300030X_ref38","first-page":"317","volume-title":"Research Conference on Metadata and Semantics Research","author":"Simperl","year":"2018"},{"key":"S135132492300030X_ref41","first-page":"1966","volume-title":"Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume","author":"Van der Heijden","year":"2021"},{"key":"S135132492300030X_ref42","doi-asserted-by":"publisher","DOI":"10.1007\/s41060-019-00204-1"},{"key":"S135132492300030X_ref8","first-page":"8440","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online, July 5-10, 2020","author":"Conneau","year":"2020"},{"volume-title":"International Conference on Learning Representations","year":"2019","author":"Karthikeyan","key":"S135132492300030X_ref26"},{"key":"S135132492300030X_ref45","unstructured":"Zhang, Z. , Jasaitis, T. , Freeman, R. , Alfrjani, R. and Funk, A. (2023). Mining healthcare procurement data using text mining and natural language processing\u2013reflection from an industrial project. arXiv preprint arXiv:2301.03458 ."},{"key":"S135132492300030X_ref2","unstructured":"Aldana, A. , Falc\u00f3n-Cort\u00e9s, A. and Larralde, H. (2022). A machine learning model to identify corruption in M\u00e9xico\u2019s public procurement contracts. arXiv preprint arXiv:2211.01478 ."},{"key":"S135132492300030X_ref24","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijindorg.2008.05.006"},{"volume-title":"Policy Research Working Paper; No. 9690","year":"2021","author":"Fazekas","key":"S135132492300030X_ref12"},{"key":"S135132492300030X_ref10","first-page":"433","volume-title":"3rd Workshop on Social and Algorithmic Issues in Business Support (SAIBS)","author":"Demiray","year":"2015"},{"key":"S135132492300030X_ref32","doi-asserted-by":"publisher","DOI":"10.1007\/s11151-011-9299-3"},{"key":"S135132492300030X_ref33","doi-asserted-by":"publisher","DOI":"10.1007\/s11151-011-9299-3"},{"key":"S135132492300030X_ref34","first-page":"1015","volume-title":"Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Pappas","year":"2017"},{"key":"S135132492300030X_ref37","first-page":"333","volume-title":"KMIS","author":"Rabuzin","year":"2019"},{"key":"S135132492300030X_ref40","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1017\/S1474745618000290","article-title":"Does the wto government procurement agreement deliver what it promises?","volume":"18","author":"Ta\u015f","year":"2019","journal-title":"World Trade Review"},{"key":"S135132492300030X_ref13","doi-asserted-by":"publisher","DOI":"10.1017\/S0007123417000461"},{"key":"S135132492300030X_ref17","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/2360610"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S135132492300030X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,12]],"date-time":"2024-12-12T11:12:30Z","timestamp":1734001950000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S135132492300030X\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,10]]},"references-count":45,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,11]]}},"alternative-id":["S135132492300030X"],"URL":"https:\/\/doi.org\/10.1017\/s135132492300030x","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"type":"print","value":"1351-3249"},{"type":"electronic","value":"1469-8110"}],"subject":[],"published":{"date-parts":[[2023,8,10]]},"assertion":[{"value":"\u00a9 The Author(s), 2023. Published by Cambridge University Press","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http:\/\/creativecommons.org\/licenses\/by\/4.0\/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.","name":"license","label":"License","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This content has been made available to all.","name":"free","label":"Free to read"}]}}