{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T21:37:29Z","timestamp":1740173849291,"version":"3.37.3"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,11,23]],"date-time":"2020-11-23T00:00:00Z","timestamp":1606089600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,11,23]],"date-time":"2020-11-23T00:00:00Z","timestamp":1606089600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100006234","name":"Sandia National Laboratories","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006234","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The amount of data produced by sensors, social and digital media, and Internet of Things (IoTs) are rapidly increasing each day. Decision makers often need to sift through a sea of Big Data to utilize information from a variety of sources in order to determine a course of action. This can be a very difficult and time-consuming task. For each data source encountered, the information can be redundant, conflicting, and\/or incomplete. For near-real-time application, there is insufficient time for a human to interpret all the information from different sources. In this project, we have developed a near-real-time, data-agnostic, software architecture that is capable of using several disparate sources to autonomously generate Actionable Intelligence with a human in the loop. We demonstrated our solution through a traffic prediction exemplar problem.<\/jats:p>","DOI":"10.1186\/s40537-020-00378-7","type":"journal-article","created":{"date-parts":[[2020,11,23]],"date-time":"2020-11-23T14:05:23Z","timestamp":1606140323000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Big data actionable intelligence architecture"],"prefix":"10.1186","volume":"7","author":[{"given":"Tian J.","family":"Ma","sequence":"first","affiliation":[]},{"given":"Rudy J.","family":"Garcia","sequence":"additional","affiliation":[]},{"given":"Forest","family":"Danford","sequence":"additional","affiliation":[]},{"given":"Laura","family":"Patrizi","sequence":"additional","affiliation":[]},{"given":"Jennifer","family":"Galasso","sequence":"additional","affiliation":[]},{"given":"Jason","family":"Loyd","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,11,23]]},"reference":[{"key":"378_CR1","unstructured":"Sandia Labs News Service. \u201cWrangling Big Data\u201d, Albuquerque Journal, November 4, 2019. https:\/\/www.abqjournal.com\/1386752\/wrangling-big-data-to-locate-actionable-info-a-lot-faster.html"},{"key":"378_CR2","unstructured":"Reinsel D, Gantz J, Rydning J. Data Age 2025 - The Digitization of the World From Edge to Core. Framingham, MA: International Data Corporation (IDC). 2018. https:\/\/www.seagate.com\/files\/www-content\/our-story\/trends\/files\/idc-seagate-dataage-whitepaper.pdf"},{"key":"378_CR3","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1002\/wics.1324","volume":"7","author":"P Ma","year":"2015","unstructured":"Ma P, Sun X. Leveraging for Big Data Regression. Wiley Interdisciplinary Reviews: Computational Statistics. 2015;7:70\u20136. https:\/\/doi.org\/10.1002\/wics.1324.","journal-title":"Wiley Interdisciplinary Reviews: Computational Statistics"},{"key":"378_CR4","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1186\/s13634-016-0355-x","volume":"2016","author":"J Qiu","year":"2016","unstructured":"Qiu J, Wu Q, Ding G, et al. A survey of machine learning for big data processing. EURASIP J Adv Signal Process. 2016;2016:67. https:\/\/doi.org\/10.1186\/s13634-016-0355-x.","journal-title":"EURASIP J Adv Signal Process"},{"key":"378_CR5","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1186\/s40537-017-0077-4","volume":"4","author":"J Majumdar","year":"2017","unstructured":"Majumdar J, Naraseeyappa S, Ankalaki S. Analysis of agriculture data using data mining techniques: application of big data. J Big Data. 2017;4:20. https:\/\/doi.org\/10.1186\/s40537-017-0077-4.","journal-title":"J Big Data"},{"key":"378_CR6","doi-asserted-by":"crossref","unstructured":"B. Chandramouli J, Goldstein, Duan S. Temporal Analytics on Big Data for Web Advertising. In: 2012 IEEE 28th International Conference on Data Engineering, Washington, DC, 2012, pp. 90\u2013101. https:\/\/ieeexplore.ieee.org\/document\/6228075","DOI":"10.1109\/ICDE.2012.55"},{"key":"378_CR7","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/j.comnet.2015.12.023","volume":"101","author":"MM Rathore","year":"2016","unstructured":"Rathore MM, Ahmad A, Paul A, Rho S. Urban planning and building smart cities based on the Internet of Things using Big Data analytics. Comput Netw. 2016;101:63\u201380.","journal-title":"Comput Netw"},{"key":"378_CR8","doi-asserted-by":"crossref","unstructured":"Zhou D, et al. Distributed Data Analytics Platform for Wide-Area Synchrophasor Measurement Systems. In: IEEE Transactions on Smart Grid, vol. 7, no. 5, pp. 2397\u20132405, Sept. 2016. https:\/\/ieeexplore.ieee.org\/iel7\/5165411\/5446437\/07420696.pdf","DOI":"10.1109\/TSG.2016.2528895"},{"key":"378_CR9","unstructured":"National Spatial Data Infrastructure (NSDI), \"Presidential Documents\", Federal Register. Vol. 59, No. 71 Wednesday, April 13, 1993. https:\/\/www.archives.gov\/files\/federal-register\/executive-orders\/pdf\/12906.pdf"},{"key":"378_CR10","unstructured":"Waze. https:\/\/www.waze.com\/"},{"key":"378_CR11","unstructured":"Twitter Data Source. https:\/\/twitter.com\/?lang=en"},{"key":"378_CR12","unstructured":"Travel Midwest Data Source. https:\/\/www.travelmidwest.com"},{"key":"378_CR13","unstructured":"City of Chicago Data Source. https:\/\/www.chicago.gov\/city\/en.html"},{"key":"378_CR14","unstructured":"GDELT Data Source. https:\/\/www.gdeltproject.org\/"},{"key":"378_CR15","unstructured":"Mapquest Data Source. https:\/\/www.mapquest.com\/"},{"key":"378_CR16","unstructured":"Digital Globe Data Source. https:\/\/www.digitalglobe.com\/"},{"key":"378_CR17","doi-asserted-by":"crossref","unstructured":"Necula E. Dynamic Traffic Flow Prediction Based on GPS Data. In: 2014 IEEE 26th International Conference on Tools with Artificial Intelligence, Limassol, 2014, pp. 922\u2013929. https:\/\/ieeexplore.ieee.org\/document\/6984576","DOI":"10.1109\/ICTAI.2014.140"},{"key":"378_CR18","doi-asserted-by":"crossref","unstructured":"Lv Y, Chen Y, Zhang X, Duan Y, Li NL. Social media based transportation research: the state of the work and the networking. In: IEEE\/CAA Journal of Automatica Sinica, vol. 4, no. 1, pp. 19\u201326 2017. https:\/\/ieeexplore.ieee.org\/document\/7815548","DOI":"10.1109\/JAS.2017.7510316"},{"key":"378_CR19","doi-asserted-by":"crossref","unstructured":"Barros J, Araujo M, Rossetti RJF. Short-term real-time traffic prediction methods: A survey. In: 2015 International Conference on Models and Technologies for Intelligent Transportation Systems (MT-ITS), Budapest, 2015, pp. 132\u2013139. https:\/\/ieeexplore.ieee.org\/abstract\/document\/7223248","DOI":"10.1109\/MTITS.2015.7223248"},{"key":"378_CR20","doi-asserted-by":"publisher","first-page":"652","DOI":"10.1109\/ACCESS.2014.2332453","volume":"2","author":"H Hu","year":"2014","unstructured":"Hu H, Wen Y, Chua T, Li X. Toward scalable systems for big data analytics: a technology tutorial. IEEE Access. 2014;2:652\u201387. https:\/\/doi.org\/10.1109\/ACCESS.2014.2332453.","journal-title":"IEEE Access"},{"key":"378_CR21","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1109\/BigData.Congress.2014.18","volume":"2014","author":"S Marchal","year":"2014","unstructured":"Marchal S, Jiang X, State R, Engel T. A Big Data Architecture for Large Scale Security Monitoring IEEE International Congress on Big Data. Anchorage, AK. 2014;2014:56\u201363. https:\/\/doi.org\/10.1109\/BigData.Congress.2014.18.","journal-title":"Anchorage, AK"},{"key":"378_CR22","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.bdr.2015.11.002","volume":"3","author":"Z Chen","year":"2016","unstructured":"Chen Z, Guobin X, Mahalingam V, Ge L, Nguyen J, Wei Y, Chao L. A cloud computing based network monitoring and threat detection system for critical infrastructures. Big Data Res. 2016;3:10\u201323. https:\/\/doi.org\/10.1016\/j.bdr.2015.11.002.","journal-title":"Big Data Res"},{"key":"378_CR23","doi-asserted-by":"publisher","unstructured":"Casas P, D'Alconzo A, Zseby T, Mellia M. Big-DAMA: Big Data Analytics for Network Traffic Monitoring and Analysis. In: Proceedings of the 2016 workshop on Fostering Latin-American Research in Data Communication Networks (LANCOMM \u201916). Association for Computing Machinery, New York, NY, USA, 1\u20133. 2016. DOI: https:\/\/doi.org\/10.1145\/2940116.2940117","DOI":"10.1145\/2940116.2940117"},{"key":"378_CR24","first-page":"1","volume":"6","author":"Z Julie","year":"2019","unstructured":"Julie Z, Bo T, Victor L. A five-layer architecture for big data processing and analytics. Int J Big Data Intelligence. 2019;6:1.","journal-title":"Int J Big Data Intelligence"},{"key":"378_CR25","doi-asserted-by":"publisher","unstructured":"Weiming L, Chen Z, Bin Y, Yitong L. A General Multi-Source Data Fusion Framework. In: Proceedings of the 2019 11th International Conference on Machine Learning and Computing (ICMLC \u201919). Association for Computing Machinery, New York, NY, USA, 285\u2013289. 2019. https:\/\/doi.org\/10.1145\/3318299.3318394.","DOI":"10.1145\/3318299.3318394."},{"key":"378_CR26","doi-asserted-by":"publisher","unstructured":"NIST Big Data Public Working Group (NBD-PWG), \u201cNIST Special Publication 1500\u20131: NIST Big Data Interoperability Framework: Volume 1, Definitions\u201d, National Institute of Standards and Technology, California, September 2015. https:\/\/doi.org\/10.6028\/NIST.SP.1500-1.","DOI":"10.6028\/NIST.SP.1500-1."},{"issue":"28","key":"378_CR27","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.inffus.2015.08.005","volume":"1","author":"G Bello-Orgaz","year":"2016","unstructured":"Bello-Orgaz G, Jung JJ, Camacho D. Social big data: Recent achievements and new challenges. Inform Fusion. 2016;1(28):45\u201359.","journal-title":"Inform Fusion."},{"key":"378_CR28","unstructured":"https:\/\/www.cloudera.com\/downloads\/hdp.html"},{"key":"378_CR29","unstructured":"https:\/\/hadoop.apache.org\/docs\/r1.2.1\/hdfs_design.html"},{"key":"378_CR30","unstructured":"Microsoft Azure Stack. https:\/\/azure.microsoft.com\/en-us\/overview\/azure-stack\/"},{"key":"378_CR31","unstructured":"Java Programming Language. https:\/\/www.java.com\/en\/"},{"key":"378_CR32","unstructured":"Python Programming Language: https:\/\/www.python.org\/"},{"key":"378_CR33","unstructured":"Apache Storm. https:\/\/storm.apache.org\/index.html"},{"key":"378_CR34","unstructured":"Apache Kafka. https:\/\/kafka.apache.org\/"},{"issue":"1","key":"378_CR35","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1186\/s40537-019-0215-2","volume":"6","author":"H Nasiri","year":"2019","unstructured":"Nasiri H, Nasehi S, Goudarzi M. Evaluation of distributed stream processing frameworks for IoT applications in Smart Cities. J Big Data. 2019;6(1):52. https:\/\/doi.org\/10.1186\/s40537-019-0215-2.","journal-title":"J Big Data."},{"key":"378_CR36","doi-asserted-by":"publisher","unstructured":"Aung T, Min HY, Maw AH. Performance Evaluation for Real-Time Messaging System in Big Data Pipeline Architecture. 2018 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), Zhengzhou, China, 2018, pp. 198\u20131986, https:\/\/doi.org\/10.1109\/CyberC.2018.00047.","DOI":"10.1109\/CyberC.2018.00047"},{"key":"378_CR37","unstructured":"Apache Lucene. https:\/\/lucene.apache.org\/solr\/"},{"key":"378_CR38","unstructured":"Joseph R, Santosh D, Ross G, Ali F. You Only Look Once: Unified, Real-Time Object Detection. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 779\u2013788. https:\/\/ieeexplore.ieee.org\/document\/7780460"},{"key":"378_CR39","doi-asserted-by":"publisher","unstructured":"Snidaro L et al. Context-Enhanced Information Fusion: Boosting Real-World Performance with Domain Knowledge. 2016. https:\/\/doi.org\/10.1007\/978-3-319-28971-7.pdf","DOI":"10.1007\/978-3-319-28971-7.pdf"},{"key":"378_CR40","unstructured":"Banana Dashboard. https:\/\/doc.lucidworks.com\/lucidworks-hdpsearch\/2.5\/Guide-Banana.html"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-020-00378-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s40537-020-00378-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-020-00378-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,15]],"date-time":"2021-04-15T02:01:18Z","timestamp":1618452078000},"score":1,"resource":{"primary":{"URL":"https:\/\/journalofbigdata.springeropen.com\/articles\/10.1186\/s40537-020-00378-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,23]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["378"],"URL":"https:\/\/doi.org\/10.1186\/s40537-020-00378-7","relation":{},"ISSN":["2196-1115"],"issn-type":[{"type":"electronic","value":"2196-1115"}],"subject":[],"published":{"date-parts":[[2020,11,23]]},"assertion":[{"value":"1 May 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 November 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 November 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competition interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"103"}}