{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:12:27Z","timestamp":1750219947976,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":40,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,24]],"date-time":"2022-10-24T00:00:00Z","timestamp":1666569600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,10,24]]},"DOI":"10.1145\/3551661.3561363","type":"proceedings-article","created":{"date-parts":[[2022,10,19]],"date-time":"2022-10-19T03:36:44Z","timestamp":1666150604000},"page":"37-44","source":"Crossref","is-referenced-by-count":0,"title":["FORLORN: A Framework for Comparing Offline Methods and Reinforcement Learning for Optimization of RAN Parameters"],"prefix":"10.1145","author":[{"given":"Vegard","family":"Edvardsen","sequence":"first","affiliation":[{"name":"Telenor Research, Oslo, Norway"}]},{"given":"Gard","family":"Spreemann","sequence":"additional","affiliation":[{"name":"Telenor Research, Oslo, Norway"}]},{"given":"Jeriek","family":"Van den Abeele","sequence":"additional","affiliation":[{"name":"Telenor Research, Oslo, Norway"}]}],"member":"320","published-online":{"date-parts":[[2022,10,24]]},"reference":[{"key":"#cr-split#-e_1_3_2_1_1_1.1","unstructured":"M. Polese etal 2022. Understanding O-RAN: Architecture Interfaces Algorithms Security and Research Challenges. arXiv (Feb. 2022). doi: 10.48550\/arXiv.2202.01032. 10.48550\/arXiv.2202.01032"},{"key":"#cr-split#-e_1_3_2_1_1_1.2","unstructured":"M. Polese et al. 2022. Understanding O-RAN: Architecture Interfaces Algorithms Security and Research Challenges. arXiv (Feb. 2022). doi: 10.48550\/arXiv.2202.01032."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-03051-4"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-021-04301-9"},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the 2008 SIGCOMM Conference. ACM. http:\/\/conferences.sigcomm.org\/sigcomm\/2008\/papers\/p527-hendersonA.pdf.","author":"Henderson T. R.","year":"2008","unstructured":"T. R. Henderson 2008 . Network simulations with the ns-3 simulator (demonstration) . In Proceedings of the 2008 SIGCOMM Conference. ACM. http:\/\/conferences.sigcomm.org\/sigcomm\/2008\/papers\/p527-hendersonA.pdf. T. R. Henderson et al. 2008. Network simulations with the ns-3 simulator (demonstration). In Proceedings of the 2008 SIGCOMM Conference. ACM. http:\/\/conferences.sigcomm.org\/sigcomm\/2008\/papers\/p527-hendersonA.pdf."},{"key":"e_1_3_2_1_6_1","volume-title":"Optuna: A Next-generation Hyperparameter Optimization Framework. In KDD '19: Proceedings of 25th SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, (July","author":"Akiba T.","year":"2019","unstructured":"T. Akiba 2019 . Optuna: A Next-generation Hyperparameter Optimization Framework. In KDD '19: Proceedings of 25th SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, (July 2019), 2623--2631. doi: 10.1145\/3292500.3330701. 10.1145\/3292500.3330701 T. Akiba et al. 2019. Optuna: A Next-generation Hyperparameter Optimization Framework. In KDD '19: Proceedings of 25th SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, (July 2019), 2623--2631. doi: 10.1145\/3292500.3330701."},{"key":"e_1_3_2_1_7_1","unstructured":"A. Raffin etal 2021. Stable-Baselines3: Reliable Reinforcement Learning Implementations. JMLR 22 268 1--8. https:\/\/jmlr.csail.mit.edu\/papers\/v22\/20--1364.html.  A. Raffin et al. 2021. Stable-Baselines3: Reliable Reinforcement Learning Implementations. JMLR 22 268 1--8. https:\/\/jmlr.csail.mit.edu\/papers\/v22\/20--1364.html."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2017.2727878"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3041765"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/OJCOMS.2022.3146618"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCCN.2017.2758370"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/3504035.3504129"},{"key":"e_1_3_2_1_13_1","first-page":"1","article-title":"2020. Prediction-Based Conditional Handover for 5G mm-Wave Networks","volume":"15","author":"Lee C.","year":"2020","unstructured":"C. Lee 2020. Prediction-Based Conditional Handover for 5G mm-Wave Networks : A Deep-Learning Approach. IEEE Veh. Technol. Mag. , 15 , 1 , ( Jan. 2020 ), 54--62. doi: 10.1109\/MVT.2019.2959065. 10.1109\/MVT.2019.2959065 C. Lee et al. 2020. Prediction-Based Conditional Handover for 5G mm-Wave Networks: A Deep-Learning Approach. IEEE Veh. Technol. Mag., 15, 1, (Jan. 2020), 54--62. doi: 10.1109\/MVT.2019.2959065.","journal-title":"A Deep-Learning Approach. IEEE Veh. Technol. Mag."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098822.3098843"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2021.3107458"},{"key":"e_1_3_2_1_16_1","volume-title":"Deep Reinforcement Learning-based CIO and Energy Control for LTE Mobility Load Balancing. In IEEE Consumer Communications & Networking Conference (CCNC). IEEE. (Jan.","author":"Alsuhli G.","year":"2021","unstructured":"G. Alsuhli 2021 . Deep Reinforcement Learning-based CIO and Energy Control for LTE Mobility Load Balancing. In IEEE Consumer Communications & Networking Conference (CCNC). IEEE. (Jan. 2021), 1--6. doi: 10.1109\/CCNC49032.2021.9369525. 10.1109\/CCNC49032.2021.9369525 G. Alsuhli et al. 2021. Deep Reinforcement Learning-based CIO and Energy Control for LTE Mobility Load Balancing. In IEEE Consumer Communications & Networking Conference (CCNC). IEEE. (Jan. 2021), 1--6. doi: 10.1109\/CCNC49032.2021.9369525."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/WCNC49053.2021.9417360"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3345768.3355908"},{"key":"e_1_3_2_1_19_1","volume-title":"ACM, (June","author":"Yin H.","year":"2020","unstructured":"H. Yin 2020 . ns3-ai: Fostering Artificial Intelligence Algorithms for Networking Research. In WNS3 2020: Proceedings of the 2020 Workshop on ns-3 . ACM, (June 2020), 57--64. doi: 10.1145\/3389400.3389404. 10.1145\/3389400.3389404 H. Yin et al. 2020. ns3-ai: Fostering Artificial Intelligence Algorithms for Networking Research. In WNS3 2020: Proceedings of the 2020 Workshop on ns-3. ACM, (June 2020), 57--64. doi: 10.1145\/3389400.3389404."},{"key":"#cr-split#-e_1_3_2_1_20_1.1","unstructured":"M. Polese etal 2021. ColO-RAN: Developing Machine Learning-based xApps for Open RAN Closed-loop Control on Programmable Experimental Platforms. arXiv (Dec. 2021). doi: 10.48550\/arXiv.2112.09559. 10.48550\/arXiv.2112.09559"},{"key":"#cr-split#-e_1_3_2_1_20_1.2","doi-asserted-by":"crossref","unstructured":"M. Polese et al. 2021. ColO-RAN: Developing Machine Learning-based xApps for Open RAN Closed-loop Control on Programmable Experimental Platforms. arXiv (Dec. 2021). doi: 10.48550\/arXiv.2112.09559.","DOI":"10.1109\/TMC.2022.3188013"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477086.3480842"},{"key":"#cr-split#-e_1_3_2_1_22_1.1","unstructured":"S. Niknam etal 2020. Intelligent O-RAN for Beyond 5G and 6G Wireless Networks. arXiv (May 2020). doi: 10.48550\/arXiv.2005.08374. 10.48550\/arXiv.2005.08374"},{"key":"#cr-split#-e_1_3_2_1_22_1.2","unstructured":"S. Niknam et al. 2020. Intelligent O-RAN for Beyond 5G and 6G Wireless Networks. arXiv (May 2020). doi: 10.48550\/arXiv.2005.08374."},{"key":"e_1_3_2_1_23_1","first-page":"10","article-title":"2021","volume":"59","author":"Bonati L.","year":"2021","unstructured":"L. Bonati 2021 . Intelligence and Learning in O-RAN for Data-Driven NextG Cellular Networks. IEEE Commun. Mag. , 59 , 10 , ( Oct. 2021 ), 21--27. doi: 10.1109\/MCOM.101.2001120. 10.1109\/MCOM.101.2001120 L. Bonati et al. 2021. Intelligence and Learning in O-RAN for Data-Driven NextG Cellular Networks. IEEE Commun. Mag., 59, 10, (Oct. 2021), 21--27. doi: 10.1109\/MCOM.101.2001120.","journal-title":"IEEE Commun. Mag."},{"key":"#cr-split#-e_1_3_2_1_24_1.1","doi-asserted-by":"crossref","unstructured":"L. Bonati etal 2022. OpenRAN Gym: An Open Toolbox for Data Collection and Experimentation with AI in O-RAN. arXiv (Feb. 2022). doi: 10.48550\/arXi v.2202.10318. 10.48550\/arXi","DOI":"10.1109\/WCNC51071.2022.9771908"},{"key":"#cr-split#-e_1_3_2_1_24_1.2","doi-asserted-by":"crossref","unstructured":"L. Bonati et al. 2022. OpenRAN Gym: An Open Toolbox for Data Collection and Experimentation with AI in O-RAN. arXiv (Feb. 2022). doi: 10.48550\/arXi v.2202.10318.","DOI":"10.1109\/WCNC51071.2022.9771908"},{"key":"#cr-split#-e_1_3_2_1_25_1.1","unstructured":"P. Li etal 2021. RLOps: Development Life-cycle of Reinforcement Learning Aided Open RAN. arXiv (Nov. 2021). doi: 10.48550\/arXiv.2111.06978. 10.48550\/arXiv.2111.06978"},{"key":"#cr-split#-e_1_3_2_1_25_1.2","unstructured":"P. Li et al. 2021. RLOps: Development Life-cycle of Reinforcement Learning Aided Open RAN. arXiv (Nov. 2021). doi: 10.48550\/arXiv.2111.06978."},{"key":"e_1_3_2_1_26_1","unstructured":"J. Bergstra etal 2011. Algorithms for Hyper-Parameter Optimization. NeurIPS 2011 24. https:\/\/papers.nips.cc\/paper\/2011\/hash\/86e8f7ab32cfd12577bc2619bc635690-Abstract.html.  J. Bergstra et al. 2011. Algorithms for Hyper-Parameter Optimization. NeurIPS 2011 24. https:\/\/papers.nips.cc\/paper\/2011\/hash\/86e8f7ab32cfd12577bc2619bc635690-Abstract.html."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSDE53843.2021.9718485"},{"key":"e_1_3_2_1_28_1","volume-title":"Asynchronous Methods for Deep Reinforcement Learning. In International Conference on Machine Learning. PMLR, (June 2016)","author":"Mnih V.","year":"2016","unstructured":"V. Mnih 2016 . Asynchronous Methods for Deep Reinforcement Learning. In International Conference on Machine Learning. PMLR, (June 2016) , 1928--1937. https:\/\/proceedings.mlr.press\/v48\/mniha16.html. V. Mnih et al. 2016. Asynchronous Methods for Deep Reinforcement Learning. In International Conference on Machine Learning. PMLR, (June 2016), 1928--1937. https:\/\/proceedings.mlr.press\/v48\/mniha16.html."},{"key":"#cr-split#-e_1_3_2_1_29_1.1","unstructured":"J. Schulman etal 2017. Proximal Policy Optimization Algorithms. arXiv (July 2017). doi: 10.48550\/arXiv.1707.06347. 10.48550\/arXiv.1707.06347"},{"key":"#cr-split#-e_1_3_2_1_29_1.2","unstructured":"J. Schulman et al. 2017. Proximal Policy Optimization Algorithms. arXiv (July 2017). doi: 10.48550\/arXiv.1707.06347."},{"key":"e_1_3_2_1_30_1","unstructured":"S. Huang etal 2022. The 37 implementation details of proximal policy optimization. In ICLR Blog Track. https:\/\/iclr-blog-track.github.io\/2022\/03\/25\/ppoimplementation-details\/.  S. Huang et al. 2022. The 37 implementation details of proximal policy optimization. In ICLR Blog Track. https:\/\/iclr-blog-track.github.io\/2022\/03\/25\/ppoimplementation-details\/."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1080\/09540099108946587"},{"key":"#cr-split#-e_1_3_2_1_32_1.1","unstructured":"J. Schulman etal 2015. High-Dimensional Continuous Control Using Generalized Advantage Estimation. arXiv (June 2015). doi: 10.48550\/arXiv.1506.02438. 10.48550\/arXiv.1506.02438"},{"key":"#cr-split#-e_1_3_2_1_32_1.2","unstructured":"J. Schulman et al. 2015. High-Dimensional Continuous Control Using Generalized Advantage Estimation. arXiv (June 2015). doi: 10.48550\/arXiv.1506.02438."},{"key":"e_1_3_2_1_33_1","unstructured":"A. Raffin. 2020. RL Baselines3 Zoo. https:\/\/github.com\/DLR-RM\/rl-baselines3-zoo. (2020).  A. Raffin. 2020. RL Baselines3 Zoo. https:\/\/github.com\/DLR-RM\/rl-baselines3-zoo. (2020)."}],"event":{"name":"MSWiM '22: Int'l ACM Conference on Modeling Analysis and Simulation of Wireless and Mobile Systems","sponsor":["SIGSIM ACM Special Interest Group on Simulation and Modeling"],"location":"Montreal Quebec Canada","acronym":"MSWiM '22"},"container-title":["Proceedings of the 18th ACM International Symposium on QoS and Security for Wireless and Mobile Networks on 18th ACM International Symposium on QoS and Security for Wireless and Mobile Networks"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3551661.3561363","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3551661.3561363","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:00Z","timestamp":1750182540000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3551661.3561363"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,24]]},"references-count":40,"alternative-id":["10.1145\/3551661.3561363","10.1145\/3551661"],"URL":"https:\/\/doi.org\/10.1145\/3551661.3561363","relation":{},"subject":[],"published":{"date-parts":[[2022,10,24]]}}}