{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T16:21:43Z","timestamp":1784996503364,"version":"3.55.0"},"reference-count":24,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2016,7,15]],"date-time":"2016-07-15T00:00:00Z","timestamp":1468540800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2017,1,31]]},"abstract":"<jats:p>Flight delays are frequent all over the world (about 20% of airline flights arrive more than 15min late) and they are estimated to have an annual cost of billions of dollars. This scenario makes the prediction of flight delays a primary issue for airlines and travelers. The main goal of this work is to implement a predictor of the arrival delay of a scheduled flight due to weather conditions. The predicted arrival delay takes into consideration both flight information (origin airport, destination airport, scheduled departure and arrival time) and weather conditions at origin airport and destination airport according to the flight timetable. Airline flight and weather observation datasets have been analyzed and mined using parallel algorithms implemented as MapReduce programs executed on a Cloud platform. The results show a high accuracy in predicting delays above a given threshold. For instance, with a delay threshold of 15min, we achieve an accuracy of 74.2% and 71.8% recall on delayed flights, while with a threshold of 60min, the accuracy is 85.8% and the delay recall is 86.9%. Furthermore, the experimental results demonstrate the predictor scalability that can be achieved performing data preparation and mining tasks as MapReduce applications on the Cloud.<\/jats:p>","DOI":"10.1145\/2888402","type":"journal-article","created":{"date-parts":[[2016,7,15]],"date-time":"2016-07-15T18:37:09Z","timestamp":1468607829000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":67,"title":["Using Scalable Data Mining for Predicting Flight Delays"],"prefix":"10.1145","volume":"8","author":[{"given":"Loris","family":"Belcastro","sequence":"first","affiliation":[{"name":"University of Calabria, Rende (CS), Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7887-1314","authenticated-orcid":false,"given":"Fabrizio","family":"Marozzo","sequence":"additional","affiliation":[{"name":"University of Calabria, Rende (CS), Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Domenico","family":"Talia","sequence":"additional","affiliation":[{"name":"University of Calabria, Rende (CS), Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paolo","family":"Trunfio","sequence":"additional","affiliation":[{"name":"University of Calabria, Rende (CS), Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,7,15]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jairtraman.2008.04.010"},{"key":"e_1_2_1_2_1","volume-title":"4th USA\/Europe Air Traffic Management R&D Seminar.","author":"Allan Shawn","unstructured":"Shawn Allan , J. A. Beesley , Jim Evans , and Steve Gaddy . 2001. Analysis of delay causality at Newark international airport . In 4th USA\/Europe Air Traffic Management R&D Seminar. Shawn Allan, J. A. Beesley, Jim Evans, and Steve Gaddy. 2001. Analysis of delay causality at Newark international airport. In 4th USA\/Europe Air Traffic Management R&D Seminar."},{"key":"e_1_2_1_3_1","volume-title":"Total delay impact study: A comprehensive assessment of the costs and impacts of flight delay in the United States. NEXTOR Report prepared for the Federal Aviation Administration","author":"Ball Michael","year":"2010","unstructured":"Michael Ball , Cynthia Barnhart , Martin Dresner , Mark Hansen , Kevin Neels , Amedeo Odoni , Everett Peterson , Lance Sherry , Antonio A. Trani , and Bo Zou . 2010. Total delay impact study: A comprehensive assessment of the costs and impacts of flight delay in the United States. NEXTOR Report prepared for the Federal Aviation Administration ( 2010 ). Michael Ball, Cynthia Barnhart, Martin Dresner, Mark Hansen, Kevin Neels, Amedeo Odoni, Everett Peterson, Lance Sherry, Antonio A. Trani, and Bo Zou. 2010. Total delay impact study: A comprehensive assessment of the costs and impacts of flight delay in the United States. NEXTOR Report prepared for the Federal Aviation Administration (2010)."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807273"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_6_1","volume-title":"4th USA\/Europe Air Traffic Management R&D Symposium.","author":"Callaham Michael","unstructured":"Michael Callaham , James DeArmon , Arlene Cooper , Jason Goodfriend , Debra Moch-Mooney , and George Solomos . 2001. Assessing NAS performance: Normalizing for the effects of weather . In 4th USA\/Europe Air Traffic Management R&D Symposium. Michael Callaham, James DeArmon, Arlene Cooper, Jason Goodfriend, Debra Moch-Mooney, and George Solomos. 2001. Assessing NAS performance: Normalizing for the effects of weather. In 4th USA\/Europe Air Traffic Management R&D Symposium."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1327452.1327492"},{"key":"e_1_2_1_8_1","unstructured":"Federal Meteorological Handbook 2005. Federal Meteorological Handbook No. 1 (FMH-1) \u201cSurface Weather Observations and Reports.\u201d Retrieved from http:\/\/www.ofcm.gov\/fmh-1\/pdf\/FMH1.pdf.  Federal Meteorological Handbook 2005. Federal Meteorological Handbook No. 1 (FMH-1) \u201cSurface Weather Observations and Reports.\u201d Retrieved from http:\/\/www.ofcm.gov\/fmh-1\/pdf\/FMH1.pdf."},{"key":"e_1_2_1_9_1","volume-title":"Eguiluz","author":"Fleurquin Pablo","year":"2013","unstructured":"Pablo Fleurquin , Jos\u00e9 J. Ramasco , and Victor M . Eguiluz . 2013 b. Data-driven modeling of systemic delay propagation under severe meteorological conditions. ArXiv e-prints (2013). Pablo Fleurquin, Jos\u00e9 J. Ramasco, and Victor M. Eguiluz. 2013b. Data-driven modeling of systemic delay propagation under severe meteorological conditions. ArXiv e-prints (2013)."},{"key":"e_1_2_1_10_1","volume-title":"Eguiluz","author":"Fleurquin Pablo","year":"2013","unstructured":"Pablo Fleurquin , Jos\u00e9 J. Ramasco , and Victor M . Eguiluz . 2013 a. Systemic delay propagation in the US airport network. Scientific Reports 3, Article 1159 (2013). Pablo Fleurquin, Jos\u00e9 J. Ramasco, and Victor M. Eguiluz. 2013a. Systemic delay propagation in the US airport network. Scientific Reports 3, Article 1159 (2013)."},{"key":"e_1_2_1_11_1","unstructured":"FlightCaster 2009. How FlightCaster Squeezes Predictions from Flight Data. Retrieved from http:\/\/www.datawrangling.com\/how-flightcaster-squeezes-predictions-from-flight-data.  FlightCaster 2009. How FlightCaster Squeezes Predictions from Flight Data. Retrieved from http:\/\/www.datawrangling.com\/how-flightcaster-squeezes-predictions-from-flight-data."},{"key":"e_1_2_1_12_1","unstructured":"Alexander Klein Richard Jehlen and Diana Liang. 2007. Weather index with queuing component for national airspace system performance assessment. In FAA\/Eurocontrol ATM Sem.  Alexander Klein Richard Jehlen and Diana Liang. 2007. Weather index with queuing component for national airspace system performance assessment. In FAA\/Eurocontrol ATM Sem."},{"key":"e_1_2_1_13_1","volume-title":"Lee","author":"Klein Alexander","year":"2009","unstructured":"Alexander Klein , Sadegh Kavoussi , and Robert S . Lee . 2009 . Weather forecast accuracy: Study of impact on airport capacity and estimation of avoidable costs. In 8th USA\/Europe Air Traffic Management Research and Development Seminar (ATM 2009). Alexander Klein, Sadegh Kavoussi, and Robert S. Lee. 2009. Weather forecast accuracy: Study of impact on airport capacity and estimation of avoidable costs. In 8th USA\/Europe Air Traffic Management Research and Development Seminar (ATM2009)."},{"key":"e_1_2_1_14_1","first-page":"25","article-title":"Handling imbalanced datasets: A review","volume":"30","author":"Kotsiantis Sotiris","year":"2006","unstructured":"Sotiris Kotsiantis , Dimitris Kanellopoulos , Panayiotis Pintelas , and others. 2006 . Handling imbalanced datasets: A review . GESTS International Transactions on Computer Science and Engineering 30 , 1 (2006), 25 -- 36 . Sotiris Kotsiantis, Dimitris Kanellopoulos, Panayiotis Pintelas, and others. 2006. Handling imbalanced datasets: A review. GESTS International Transactions on Computer Science and Engineering 30, 1 (2006), 25--36.","journal-title":"GESTS International Transactions on Computer Science and Engineering"},{"key":"e_1_2_1_15_1","volume-title":"Integration and Operations (ATIO) Conference.","author":"Eric","unstructured":"Eric R. Mueller and Gano B. Chatterji. 2002. Analysis of aircraft arrival and departure delay characteristics. In AIAA Aircraft Technology , Integration and Operations (ATIO) Conference. Eric R. Mueller and Gano B. Chatterji. 2002. Analysis of aircraft arrival and departure delay characteristics. In AIAA Aircraft Technology, Integration and Operations (ATIO) Conference."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.trc.2011.05.017"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.trc.2014.04.007"},{"key":"e_1_2_1_18_1","volume-title":"8th USA\/Europe ATM R&D Seminar","author":"Sridhar Banavar","unstructured":"Banavar Sridhar , Yao Wang , Alexander Klein , and Richard Jehlen . 2009. Modeling flight delays and cancellations at the national, regional and airport levels in the United States . In 8th USA\/Europe ATM R&D Seminar , Napa, California ( USA) . Banavar Sridhar, Yao Wang, Alexander Klein, and Richard Jehlen. 2009. Modeling flight delays and cancellations at the national, regional and airport levels in the United States. In 8th USA\/Europe ATM R&D Seminar, Napa, California (USA)."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2014.7004435"},{"key":"e_1_2_1_20_1","volume-title":"Service-Oriented Distributed Knowledge Discovery","author":"Talia Domenico","unstructured":"Domenico Talia and Paolo Trunfio . 2012. Service-Oriented Distributed Knowledge Discovery . Chapman and Hall\/CRC. Domenico Talia and Paolo Trunfio. 2012. Service-Oriented Distributed Knowledge Discovery. Chapman and Hall\/CRC."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2010.08.011"},{"key":"e_1_2_1_23_1","volume-title":"Hadoop: The Definitive Guide","author":"White Tom","year":"2009","unstructured":"Tom White . 2009 . Hadoop: The Definitive Guide ( 1 st ed.). O\u2019Reilly Media, Inc. Tom White. 2009. Hadoop: The Definitive Guide (1st ed.). O\u2019Reilly Media, Inc.","edition":"1"},{"key":"e_1_2_1_24_1","volume-title":"Kathryn Blackmond Laskey, and Chun-Hung Chen","author":"Xu Ning","year":"2005","unstructured":"Ning Xu , George Donohue , Kathryn Blackmond Laskey, and Chun-Hung Chen . 2005 . Estimation of delay propagation in the national aviation system using Bayesian networks. In 6th USA\/Europe Air Traffic Management Research and Development Seminar . Ning Xu, George Donohue, Kathryn Blackmond Laskey, and Chun-Hung Chen. 2005. Estimation of delay propagation in the national aviation system using Bayesian networks. In 6th USA\/Europe Air Traffic Management Research and Development Seminar."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.3141\/2052-08"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2888402","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2888402","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:05:25Z","timestamp":1750273525000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2888402"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,7,15]]},"references-count":24,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2017,1,31]]}},"alternative-id":["10.1145\/2888402"],"URL":"https:\/\/doi.org\/10.1145\/2888402","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,7,15]]},"assertion":[{"value":"2014-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-07-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}