{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T16:39:54Z","timestamp":1777567194762,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":19,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,25]],"date-time":"2023-10-25T00:00:00Z","timestamp":1698192000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,10,25]]},"DOI":"10.1145\/3639856.3639892","type":"proceedings-article","created":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T11:49:10Z","timestamp":1715946550000},"page":"1-5","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["Observations on LLMs for Telecom Domain: Capabilities and Limitations"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1926-3065","authenticated-orcid":false,"given":"Sumit","family":"Soman","sequence":"first","affiliation":[{"name":"Ericsson, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4202-2967","authenticated-orcid":false,"given":"Ranjani","family":"H. G.","sequence":"additional","affiliation":[{"name":"Ericsson, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,5,17]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Large Language Models for Telecom: The Next Big Thing?arXiv preprint arXiv:2306.10249","author":"Bariah Lina","year":"2023","unstructured":"Lina Bariah, Qiyang Zhao, Hang Zou, Yu Tian, Faouzi Bader, and Merouane Debbah. 2023. Large Language Models for Telecom: The Next Big Thing?arXiv preprint arXiv:2306.10249 (2023)."},{"key":"e_1_3_2_1_2_1","volume-title":"Understanding Telecom Language Through Large Language Models. arXiv preprint arXiv:2306.07933","author":"Bariah Lina","year":"2023","unstructured":"Lina Bariah, Hang Zou, Qiyang Zhao, Belkacem Mouhouche, Faouzi Bader, and Merouane Debbah. 2023. Understanding Telecom Language Through Large Language Models. arXiv preprint arXiv:2306.07933 (2023)."},{"key":"e_1_3_2_1_3_1","volume-title":"Sparks of Artificial General Intelligence: Early experiments with GPT-4. arXiv preprint arXiv:2303.12712 (March","author":"Bubeck S\u00e9bastien","year":"2023","unstructured":"S\u00e9bastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin\u00a0Tat Lee, Yuanzhi Li, Scott Lundberg, Harsha Nori, Hamid Palangi, Marco\u00a0Tulio Ribeiro, and Yi Zhang. 2023. Sparks of Artificial General Intelligence: Early experiments with GPT-4. arXiv preprint arXiv:2303.12712 (March 2023). arxiv:2303.12712\u00a0[cs.CL] https:\/\/www.microsoft.com\/en-us\/research\/publication\/sparks-of-artificial-general-intelligence-early-experiments-with-gpt-4\/"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3532682"},{"key":"e_1_3_2_1_5_1","volume-title":"TKG: Telecom Knowledge Governance Framework for LLM Application.","author":"Cai Haoran","year":"2023","unstructured":"Haoran Cai and Sijie Wu. 2023. TKG: Telecom Knowledge Governance Framework for LLM Application. (2023)."},{"key":"e_1_3_2_1_6_1","volume-title":"Palm: Scaling language modeling with pathways. arXiv preprint arXiv:2204.02311","author":"Chowdhery Aakanksha","year":"2022","unstructured":"Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung\u00a0Won Chung, Charles Sutton, Sebastian Gehrmann, 2022. Palm: Scaling language modeling with pathways. arXiv preprint arXiv:2204.02311 (2022)."},{"key":"e_1_3_2_1_7_1","volume-title":"LaMDA: Language models for dialog applications. CoRR abs\/2201.08239","author":"Cohen Aaron\u00a0Daniel","year":"2022","unstructured":"Aaron\u00a0Daniel Cohen, Adam Roberts, Alejandra Molina, Alena Butryna, Alicia Jin, Apoorv Kulshreshtha, Ben Hutchinson, Ben Zevenbergen, Blaise\u00a0Hilary Aguera-Arcas, Chung-ching Chang, 2022. LaMDA: Language models for dialog applications. CoRR abs\/2201.08239 (2022). arXiv:2201.08239https:\/\/arxiv.org\/abs\/2201.08239"},{"key":"e_1_3_2_1_8_1","volume-title":"Measuring nominal scale agreement among many raters.Psychological bulletin 76, 5","author":"Fleiss L","year":"1971","unstructured":"Joseph\u00a0L Fleiss. 1971. Measuring nominal scale agreement among many raters.Psychological bulletin 76, 5 (1971), 378."},{"key":"e_1_3_2_1_9_1","volume-title":"Scaling Laws for Reward Model Overoptimization. arXiv preprint arXiv:2210.10760","author":"Gao Leo","year":"2022","unstructured":"Leo Gao, John Schulman, and Jacob Hilton. 2022. Scaling Laws for Reward Model Overoptimization. arXiv preprint arXiv:2210.10760 (2022)."},{"key":"e_1_3_2_1_10_1","volume-title":"Lisa\u00a0Anne Hendricks","author":"Hoffmann Jordan","year":"2022","unstructured":"Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de\u00a0Las Casas, Lisa\u00a0Anne Hendricks, Johannes Welbl, Aidan Clark, 2022. Training compute-optimal large language models. arXiv preprint arXiv:2203.15556 (2022)."},{"key":"e_1_3_2_1_11_1","unstructured":"ITU-T. 2017. Vocabulary for Performance Quality of Service and Quality of Experience."},{"key":"e_1_3_2_1_12_1","volume-title":"Large Language Models for Telecom: Forthcoming Impact on the Industry. arXiv preprint arXiv:2308.06013","author":"Maatouk Ali","year":"2023","unstructured":"Ali Maatouk, Nicola Piovesan, Fadhel Ayed, Antonio De\u00a0Domenico, and Merouane Debbah. 2023. Large Language Models for Telecom: Forthcoming Impact on the Industry. arXiv preprint arXiv:2308.06013 (2023)."},{"key":"e_1_3_2_1_13_1","volume-title":"793\u2013795","author":"Martin T","year":"2023","unstructured":"Joel\u00a0T Martin. 2023. Hello, LaMDA!Brain 146, 3 (2023), 793\u2013795."},{"key":"e_1_3_2_1_14_1","unstructured":"OpenAI. 2023. GPT-4 Technical Report. arXiv preprint arXiv:2303.08774 (2023). arxiv:2303.08774\u00a0[cs.CL]"},{"key":"e_1_3_2_1_15_1","volume-title":"Md Nafizur, The AI Race is on","author":"Rahaman Md","year":"2023","unstructured":"Md Rahaman, MM Ahsan, Nishath Anjum, Md Rahman, and Md\u00a0Nafizur Rahman. 2023. The AI Race is On! Google\u2019s Bard and OpenAI\u2019s ChatGPT Head to Head: An Opinion Article. Mizanur and Rahman, Md Nafizur, The AI Race is on (2023)."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.30574\/wjaets.2023.8.1.0045"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco_a_01563"},{"key":"e_1_3_2_1_18_1","first-page":"3008","article-title":"Learning to summarize with human feedback","volume":"33","author":"Stiennon Nisan","year":"2020","unstructured":"Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul\u00a0F Christiano. 2020. Learning to summarize with human feedback. Advances in Neural Information Processing Systems 33 (2020), 3008\u20133021.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_19_1","volume-title":"Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971","author":"Touvron Hugo","year":"2023","unstructured":"Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timoth\u00e9e Lacroix, Baptiste Rozi\u00e8re, Naman Goyal, Eric Hambro, Faisal Azhar, 2023. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023)."}],"event":{"name":"AIMLSystems 2023: The Third International Conference on Artificial Intelligence and Machine Learning Systems","location":"Bangalore India","acronym":"AIMLSystems 2023"},"container-title":["The Third International Conference on Artificial Intelligence and Machine Learning Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639856.3639892","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3639856.3639892","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T16:59:03Z","timestamp":1755881943000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639856.3639892"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,25]]},"references-count":19,"alternative-id":["10.1145\/3639856.3639892","10.1145\/3639856"],"URL":"https:\/\/doi.org\/10.1145\/3639856.3639892","relation":{},"subject":[],"published":{"date-parts":[[2023,10,25]]},"assertion":[{"value":"2024-05-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}