{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T04:02:53Z","timestamp":1747108973965,"version":"3.40.5"},"reference-count":16,"publisher":"American Institute of Aeronautics and Astronautics (AIAA)","issue":"4","license":[{"start":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T00:00:00Z","timestamp":1764806400000},"content-version":"am","delay-in-days":247,"URL":"https:\/\/www.aiaa.org\/userlicenses\/1.0\/#CompEndUserLicense"}],"funder":[{"DOI":"10.13039\/100006195","name":"Ames Research Center","doi-asserted-by":"publisher","award":["NNA16BD14C"],"award-info":[{"award-number":["NNA16BD14C"]}],"id":[{"id":"10.13039\/100006195","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["arc.aiaa.org"],"crossmark-restriction":true},"short-container-title":["Journal of Aerospace Information Systems"],"published-print":{"date-parts":[[2025,4]]},"abstract":"<jats:p> Runway configuration management deals with the optimal selection of runways and their direction of operation for aircraft arrivals and departures. The configurations are chosen based on the traffic, surface winds, and other meteorological conditions that are complex to model and difficult to predict. In this paper, we develop the runway configuration assistance tool, an automated approach based on offline model-free reinforcement learning (RL) that provides decision support for air traffic controllers (ATCOs). The proposed tool processes historical data of interest, including decisions made regarding the runway configuration, and their subsequent outcome, to identify a policy that encourages good decisions. The policy search is guided by an appropriately chosen weighted multi-objective utility function (e.g., based on maximizing traffic throughput, minimizing transit times on the surface of the airport, and mitigating safety issues such as go-arounds). The proposed tool is validated using data from two major U.S. airports based on performance metrics developed in collaboration with subject matter experts and is compared against several baseline approaches such as the most frequent configuration chosen by ATCOs, supervised learning, and other RL-based approaches. <\/jats:p>","DOI":"10.2514\/1.i011470","type":"journal-article","created":{"date-parts":[[2024,12,4]],"date-time":"2024-12-04T09:17:19Z","timestamp":1733303839000},"page":"275-287","update-policy":"https:\/\/doi.org\/10.2514\/aiaa_crossmarkpolicy","source":"Crossref","is-referenced-by-count":0,"title":["Runway Configuration Assistance: Offline Reinforcement Learning Method for Air Traffic Management"],"prefix":"10.2514","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7672-6033","authenticated-orcid":false,"given":"Milad","family":"Memarzadeh","sequence":"first","affiliation":[{"name":"NASA Ames Research Center"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Krishna","family":"Kalyanam","sequence":"additional","affiliation":[{"name":"NASA Ames Research Center"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1387","reference":[{"key":"r1","unstructured":"\u201cNational Safety and Operational Criteria for Runway Selection Plans and Noise Abatement Runway Use Programs,\u201d Federal Aviation Administration, 2014, https:\/\/www.faa.gov\/air_traffic\/flight_info\/aeronav\/acf\/media\/Presentations\/14-02_DRAFT_FAA_Order_8400_9_Runway_Selection_and_Use_Plan.pdf."},{"key":"r2","unstructured":"PrecupR.E.RomanR.C.SafaeiA., Data-Driven Model-Free Controllers, CRC Press, Boca Raton, FL, 2022."},{"key":"r5","doi-asserted-by":"publisher","DOI":"10.3141\/2600-01"},{"key":"r6","doi-asserted-by":"publisher","DOI":"10.1287\/opre.1110.0956"},{"key":"r8","doi-asserted-by":"publisher","DOI":"10.1287\/trsc.2015.0644"},{"key":"r9","doi-asserted-by":"publisher","DOI":"10.2514\/1.G003964"},{"key":"r11","unstructured":"SuttonR. S.BartoA. G., Introduction to Reinforcement Learning, MIT Press, Cambridge, MA, 2018."},{"key":"r12","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2024.108911"},{"key":"r13","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2012.2186810"},{"key":"r14","unstructured":"WatkinsC. \u201cLearning from Delayed Rewards,\u201d Ph.D. Dissertation, Univ. of Cambridge, Cambridge, England, U.K. 1989, https:\/\/www.cs.rhul.ac.uk\/~chrisw\/thesis.html."},{"key":"r15","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"r16","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"volume-title":"AIAA Aviation Forum","year":"2021","author":"Khater S.","key":"r19"},{"journal-title":"AIAA Aviation Forum","year":"2021","author":"Churchill A.","key":"r20"},{"journal-title":"ArXiv","year":"2020","author":"Levine S.","key":"r21"},{"key":"r24","first-page":"1179","author":"Kumar A.","year":"2020","journal-title":"Proceedings of NeurIPS"}],"container-title":["Journal of Aerospace Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/arc.aiaa.org\/doi\/am-pdf\/10.2514\/1.I011470","content-type":"application\/pdf","content-version":"am","intended-application":"unspecified"},{"URL":"https:\/\/arc.aiaa.org\/doi\/pdf\/10.2514\/1.I011470","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/arc.aiaa.org\/doi\/pdf\/10.2514\/1.I011470","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,12]],"date-time":"2025-05-12T12:43:38Z","timestamp":1747053818000},"score":1,"resource":{"primary":{"URL":"https:\/\/arc.aiaa.org\/doi\/10.2514\/1.I011470"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4]]},"references-count":16,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,4]]}},"alternative-id":["10.2514\/1.I011470"],"URL":"https:\/\/doi.org\/10.2514\/1.i011470","relation":{},"ISSN":["1940-3151","2327-3097"],"issn-type":[{"type":"print","value":"1940-3151"},{"type":"electronic","value":"2327-3097"}],"subject":[],"published":{"date-parts":[[2025,4]]},"assertion":[{"value":"2024-04-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-08","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}