{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T22:19:33Z","timestamp":1778624373406,"version":"3.51.4"},"reference-count":66,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,5,24]],"date-time":"2021-05-24T00:00:00Z","timestamp":1621814400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["UID\/00319\/2020"],"award-info":[{"award-number":["UID\/00319\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>The processing of information in real-time (through the processing of complex events) has become an essential task for the optimal functioning of manufacturing plants. Only in this way can artificial intelligence, data extraction, and even business intelligence techniques be applied, and the data produced daily be used in a beneficent way, enhancing automation processes and improving service delivery. Therefore, professionals and researchers need a wide range of tools to extract, transform, and load data in real-time efficiently. Additionally, the same tool supports or at least facilitates the visualization of this data intuitively and interactively. The review presented in this document aims to provide an up-to-date review of the various tools available to perform these tasks. Of the selected tools, a brief description of how they work, as well as the advantages and disadvantages of their use, will be presented. Furthermore, a critical analysis of overall operation and performance will be presented. Finally, a hybrid architecture that aims to synergize all tools and technologies is presented and discussed.<\/jats:p>","DOI":"10.3390\/app11114800","type":"journal-article","created":{"date-parts":[[2021,5,24]],"date-time":"2021-05-24T12:38:01Z","timestamp":1621859881000},"page":"4800","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Software Tools for Conducting Real-Time Information Processing and Visualization in Industry: An Up-to-Date Review"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2988-196X","authenticated-orcid":false,"given":"Regina","family":"Sousa","sequence":"first","affiliation":[{"name":"ALGORITMI Research Center, School of Engineering, Gualtar Campus, University of Minho, 4710-057 Braga, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3696-9927","authenticated-orcid":false,"given":"Rui","family":"Miranda","sequence":"additional","affiliation":[{"name":"ALGORITMI Research Center, School of Engineering, Gualtar Campus, University of Minho, 4710-057 Braga, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1168-5861","authenticated-orcid":false,"given":"Ailton","family":"Moreira","sequence":"additional","affiliation":[{"name":"ALGORITMI Research Center, School of Engineering, Gualtar Campus, University of Minho, 4710-057 Braga, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8320-5295","authenticated-orcid":false,"given":"Carlos","family":"Alves","sequence":"additional","affiliation":[{"name":"ALGORITMI Research Center, School of Engineering, Gualtar Campus, University of Minho, 4710-057 Braga, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5895-0880","authenticated-orcid":false,"given":"Nicolas","family":"Lori","sequence":"additional","affiliation":[{"name":"ALGORITMI Research Center, School of Engineering, Gualtar Campus, University of Minho, 4710-057 Braga, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4121-6169","authenticated-orcid":false,"given":"Jos\u00e9","family":"Machado","sequence":"additional","affiliation":[{"name":"ALGORITMI Research Center, School of Engineering, Gualtar Campus, University of Minho, 4710-057 Braga, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.mfglet.2018.09.002","article-title":"Industrial Artificial Intelligence for industry 4.0-based manufacturing systems","volume":"18","author":"Lee","year":"2018","journal-title":"Manuf. Lett."},{"key":"ref_2","first-page":"1","article-title":"Industry 4.0: A survey on technologies, applications and open research issues","volume":"6","author":"Lu","year":"2017","journal-title":"J. Ind. Inf. Integr."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"560","DOI":"10.1016\/j.ijinfomgt.2012.03.001","article-title":"Examining the effect of user satisfaction on system usage and individual performance with business intelligence systems: An empirical study of Taiwan\u2019s electronics industry","volume":"32","author":"Hou","year":"2012","journal-title":"Int. J. Inf. Manag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1089\/omi.2017.0194","article-title":"Birth of Industry 5.0: Making Sense of Big Data with Artificial Intelligence, \u201cThe Internet of Things\u201d and Next-Generation Technology Policy","volume":"22","author":"Hekim","year":"2018","journal-title":"OMICS J. Integr. Biol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1165","DOI":"10.2307\/41703503","article-title":"Business intelligence and analytics: From big data to big impact","volume":"36","author":"Chen","year":"2012","journal-title":"MIS Q."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wu, E., Diao, Y., and Rizvi, S. (2006, January 27\u201329). High-performance complex event processing over streams. Proceedings of the ACM SIGMOD International Conference on Management of Data, Chicago, IL, USA.","DOI":"10.1145\/1142473.1142520"},{"key":"ref_7","first-page":"195","article-title":"Survey of real-time processing technologies of iot data streams","volume":"24","author":"Yasumoto","year":"2016","journal-title":"J. Inf. Process."},{"key":"ref_8","unstructured":"DataBricks (2020, October 20). What is Complex Event Processing?. Available online: https:\/\/databricks.com\/glossary\/complex-event-processing\/."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.procs.2015.09.169","article-title":"Real-time Complex Event Processing and Analytics for Smart Grid","volume":"61","author":"Liu","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tawsif, K., Hossen, J., Raja, J.E., Jesmeen, M.Z.H., and Arif, E.M.H. (2018, January 26\u201328). A Review on Complex Event Processing Systems for Big Data. Proceedings of the 2018 Fourth International Conference on Information Retrieval and Knowledge Management (CAMP), Kota Kinabalu, Malaysia.","DOI":"10.1109\/INFRKM.2018.8464787"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.compind.2016.02.004","article-title":"Big Data and virtualization for manufacturing cyber-physical systems: A survey of the current status and future outlook","volume":"81","author":"Babiceanu","year":"2016","journal-title":"Comput. Ind."},{"key":"ref_12","unstructured":"Confluent (2020, October 20). What is Complex Event Processing? Guide to CEP. Available online: https:\/\/www.confluent.io\/learn\/complex-event-processing\/."},{"key":"ref_13","unstructured":"Martinez, G. (2016). Research Methods for Business Students, Pearson Education Limited. [7th ed.]."},{"key":"ref_14","unstructured":"Solace (2020, October 20). Solace Customers. Available online: https:\/\/solace.com\/company\/."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1038\/s41558-018-0180-3","article-title":"The role of reporting standards in producing robust literature reviews","volume":"8","author":"Haddaway","year":"2018","journal-title":"Nat. Clim. Chang."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Brand\u00e3o, A., Pereira, E., Esteves, M., Portela, F., Santos, M.F., Abelha, A., and Machado, J. (2016). A benchmarking analysis of open-source business intelligence tools in healthcare environments. Information, 7.","DOI":"10.3390\/info7040057"},{"key":"ref_17","first-page":"34","article-title":"The Relative Importance of Supplier Selection Criteria: A Review and Update","volume":"30","author":"Wilson","year":"1994","journal-title":"Int. J. Purch. Mater. Manag."},{"key":"ref_18","unstructured":"The Apache Software Foundation (2020, October 20). Welcome to Apache Flume. Available online: https:\/\/flume.apache.org\/."},{"key":"ref_19","unstructured":"Hoffman, S. (2013). Apache Flume: Distributed Log Collection for Hadoop, Packt Publishing Ltd."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Vohra, D. (2016). Apache flume. Practical Hadoop Ecosystem, Springer.","DOI":"10.1007\/978-1-4842-2199-0"},{"key":"ref_21","unstructured":"The Apache Software Foundation (2020, October 20). Flume 1.9.0 User Guide. Available online: https:\/\/flume.apache.org\/FlumeUserGuide.html."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Srinivasa, K., Siddesh, G., and Srinidhi, H. (2018). Apache Flume. Network Data Analytics, Springer.","DOI":"10.1007\/978-3-319-77800-6_6"},{"key":"ref_23","unstructured":"The Apache Software Foundation (2020, October 20). Sqoop. Available online: https:\/\/sqoop.apache.org\/."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Vohra, D. (2016). Using apache sqoop. Pro Docker, Springer.","DOI":"10.1007\/978-1-4842-1830-3"},{"key":"ref_25","unstructured":"Arvind (2020, October 20). Apache Sqoop Graduates from Incubator. Available online: https:\/\/blogs.apache.org\/sqoop\/entry\/apache_sqoop_graduates_from_incubator."},{"key":"ref_26","unstructured":"(2020, October 20). What is Solace PubSub+ Platform?. Available online: https:\/\/docs.solace.com\/Solace-PubSub-Platform.html."},{"key":"ref_27","unstructured":"(2020, October 20). PubSub+ Platform. Available online: https:\/\/solace.com\/pt\/products\/platform\/."},{"key":"ref_28","unstructured":"(2020, October 20). PubSub+ Event Portal. Available online: https:\/\/solace.com\/pt\/products\/portal\/."},{"key":"ref_29","unstructured":"(2020, October 20). Apache Kafka-Introduction. Available online: https:\/\/kafka.apache.org\/intro."},{"key":"ref_30","unstructured":"Garg, N. (2013). Apache Kafka, Packt Publishing."},{"key":"ref_31","unstructured":"Shapira, G., Palino, T., Sivaram, R., and Narkhede, N. (2017). Kafka: The Definitive Guide, O\u2019Reilly Media, Incorporated."},{"key":"ref_32","unstructured":"Confluent Inc (2020, October 20). Introduction to Kafka. Available online: https:\/\/docs.confluent.io\/platform\/current\/kafka\/introduction.html."},{"key":"ref_33","unstructured":"Carter, M. (2020, October 20). Apache Kafka Architecture: A Complete Guide. Available online: https:\/\/www.instaclustr.com\/apache-kafka-architecture\/."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chellappan, S., and Ganesan, D. (2018). Practical Apache Spark: Using the Scala API, Apress.","DOI":"10.1007\/978-1-4842-3652-9"},{"key":"ref_35","unstructured":"Frampton, M. (2015). Mastering Apache Spark, Packt Publishing."},{"key":"ref_36","unstructured":"Gour, R. (2020, October 20). Apache Spark Ecosystem\u2014Complete Spark Components Guide. Available online: https:\/\/data-flair.training\/blogs\/apache-spark-ecosystem-components\/."},{"key":"ref_37","unstructured":"Penchikala, P. (2020, October 20). Big Data Processing with Apache Spark\u2014Part 1: Introduction. Available online: https:\/\/www.infoq.com\/articles\/apache-spark-introduction\/."},{"key":"ref_38","unstructured":"The Apache Software Foundation (2020, October 20). MLlib|Apache Spark. Available online: https:\/\/spark.apache.org\/mllib\/."},{"key":"ref_39","unstructured":"The Apache Software Foundation (2020, October 20). GraphX\u2014Spark 3.0.2 Documentation. Available online: https:\/\/spark.apache.org\/docs\/latest\/graphx-programming-guide.html."},{"key":"ref_40","unstructured":"The Apache Software Foundation (2021, February 26). SparkR (R on Spark). Available online: https:\/\/spark.apache.org\/docs\/latest\/sparkr.html."},{"key":"ref_41","unstructured":"John, T., and Misram, P. (2017). Data Lake for Enterprises, Packt Publishing Ltd."},{"key":"ref_42","unstructured":"EDUCBA (2021, January 06). Introduction to Apache Flume. Available online: https:\/\/www.educba.com\/apache-flume\/."},{"key":"ref_43","unstructured":"Beyond Corner (2021, January 07). Features and Limitations of Sqoop. Available online: https:\/\/beyondcorner.com\/learn-apache-sqoop\/features-and-limitations-of-sqoop-and-whats-new-in-sqoop2\/."},{"key":"ref_44","unstructured":"Gartner Peer Insights (2021, February 09). Solace HIP-Enabling Technologies. Available online: https:\/\/www.gartner.com\/reviews\/market\/hip-enabling-technologies\/vendor\/solace\/reviews?reviewRating=3&sort=-helpfulness."},{"key":"ref_45","unstructured":"AWS Marketplace (2021, February 09). Solace PubSub+ Software Message Broker Standard Edition Reviews. Available online: https:\/\/aws.amazon.com\/marketplace\/reviews\/reviews-list\/B077GRGL8Q."},{"key":"ref_46","unstructured":"JavaTpoint (2021, February 07). Apache Kafka Advantages and Disadvantages. Available online: https:\/\/www.javatpoint.com\/apache-kafka-advantages-and-disadvantages."},{"key":"ref_47","unstructured":"DataFlair (2021, February 25). Advantages and Disadvantages of Kafka. Available online: https:\/\/data-flair.training\/blogs\/advantages-and-disadvantages-of-kafka\/."},{"key":"ref_48","unstructured":"Koutanov, E. (2021, January 07). Apache Kafka in a Nutshell. Available online: https:\/\/medium.com\/swlh\/apache-kafka-in-a-nutshell-5782b01d9ffb."},{"key":"ref_49","unstructured":"KnowledgeHut (2021, February 26). What are the Advantages & Disadvantages of Apache Spark?. Available online: https:\/\/www.knowledgehut.com\/blog\/big-data\/apache-spark-advantages-disadvantages."},{"key":"ref_50","unstructured":"Harg, A. (2021, February 26). Spark Features-Apache Spark Tutorial. Available online: https:\/\/intellipaat.com\/blog\/tutorial\/spark-tutorial\/spark-features\/."},{"key":"ref_51","unstructured":"DataFlair (2021, February 26). Features of Apache Spark. Available online: https:\/\/data-flair.training\/blogs\/apache-spark-features\/."},{"key":"ref_52","unstructured":"Joseph, R. (2021, February 26). What is Spark?|Tutorial by Chartio. Available online: https:\/\/chartio.com\/learn\/data-analytics\/what-is-spark\/."},{"key":"ref_53","unstructured":"Ferrari, A., and Russo, M. (2016). Introducing Microsoft Power BI, Microsoft Press."},{"key":"ref_54","unstructured":"Microsoft (2020, September 16). Microsoft Power BI. Available online: https:\/\/powerbi.microsoft.com\/pt-pt\/."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Rad, R. (2018). Pro Power BI Architecture, Springer.","DOI":"10.1007\/978-1-4842-4015-1"},{"key":"ref_56","unstructured":"Technologies, M. (2020, October 20). What Is Power BI Architecture? A Complete Tutorial. Available online: https:\/\/mindmajix.com\/power-bi-architecture."},{"key":"ref_57","unstructured":"Tableau (2020, September 16). Business Intelligence and Analytics Software. Available online: https:\/\/www.tableau.com\/."},{"key":"ref_58","unstructured":"DataFlair Team (2020, September 16). 10 Features of Tableau to Smoothen Your Data Visualization Tasks. Available online: https:\/\/data-flair.training\/blogs\/tableau-features\/."},{"key":"ref_59","unstructured":"Murray, D.G. (2013). Tableau Your Data!: Fast and Easy Visual Analysis with Tableau Software, John Wiley & Sons."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1080\/19322909.2013.825148","article-title":"Data visualization and rapid analytics: Applying tableau desktop to support library decision-making","volume":"7","author":"Murphy","year":"2013","journal-title":"J. Web Librariansh."},{"key":"ref_61","unstructured":"Chabot, C., Stolte, C., and Hanrahan, P. (2020, October 20). Tableau Software. Available online: https:\/\/www.tableau.com\/resource\/business-intelligence."},{"key":"ref_62","unstructured":"Price, E., and Lachev, T. (2020). Applied Microsoft Power BI: Bring Your Data to Life!, Prologika. [5th ed.]."},{"key":"ref_63","unstructured":"SaM Solutions (2021, January 07). Pros and Cons of Tableau Software for Data Visualization. Available online: https:\/\/www.sam-solutions.com\/blog\/tableau-software-review-pros-and-cons-of-a-bi-solution-for-data-visualization\/."},{"key":"ref_64","unstructured":"AbsentData (2021, January 07). Advantages and Disadvantages of Tableau. Available online: https:\/\/www.absentdata.com\/advantages-and-disadvantages-of-tableau\/."},{"key":"ref_65","unstructured":"JBoss Community Documentation (2020, November 19). Complex Event Processing. Available online: https:\/\/docs.jboss.org\/drools\/release\/6.2.0.CR3\/drools-docs\/html\/DroolsComplexEventProcessingChapter.html."},{"key":"ref_66","unstructured":"AIMultiple (2020, November 19). Complex Event Processing: How It Works, Use Cases & Tools. Available online: https:\/\/research.aimultiple.com\/cep\/."}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/11\/11\/4800\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:06:38Z","timestamp":1760162798000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/11\/11\/4800"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,24]]},"references-count":66,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["app11114800"],"URL":"https:\/\/doi.org\/10.3390\/app11114800","relation":{},"ISSN":["2076-3417"],"issn-type":[{"value":"2076-3417","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,24]]}}}