{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T22:21:46Z","timestamp":1767651706510,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2022,6,11]],"date-time":"2022-06-11T00:00:00Z","timestamp":1654905600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020 research and innovation program","award":["869379"],"award-info":[{"award-number":["869379"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Development and operations (DevOps), artificial intelligence (AI), big data and edge\u2013fog\u2013cloud are disruptive technologies that may produce a radical transformation of the industry. Nevertheless, there are still major challenges to efficiently applying them in order to optimise productivity. Some of them are addressed in this article, concretely, with respect to the adequate management of information technology (IT) infrastructures for automated analysis processes in critical fields such as the mining industry. In this area, this paper presents a tool called Pangea aimed at automatically generating suitable execution environments for deploying analytic pipelines. These pipelines are decomposed into various steps to execute each one in the most suitable environment (edge, fog, cloud or on-premise) minimising latency and optimising the use of both hardware and software resources. Pangea is focused in three distinct objectives: (1) generating the required infrastructure if it does not previously exist; (2) provisioning it with the necessary requirements to run the pipelines (i.e., configuring each host operative system and software, install dependencies and download the code to execute); and (3) deploying the pipelines. In order to facilitate the use of the architecture, a representational state transfer application programming interface (REST API) is defined to interact with it. Therefore, in turn, a web client is proposed. Finally, it is worth noting that in addition to the production mode, a local development environment can be generated for testing and benchmarking purposes.<\/jats:p>","DOI":"10.3390\/s22124425","type":"journal-article","created":{"date-parts":[[2022,6,13]],"date-time":"2022-06-13T02:01:44Z","timestamp":1655085704000},"page":"4425","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Pangea: An MLOps Tool for Automatically Generating Infrastructure and Deploying Analytic Pipelines in Edge, Fog and Cloud Layers"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4319-0727","authenticated-orcid":false,"given":"Ra\u00fal","family":"Mi\u00f1\u00f3n","sequence":"first","affiliation":[{"name":"Digital, TECNALIA, Basque Research and Technology Alliance (BRTA), Parque Tecnol\u00f3gico de \u00c1lava Albert Einstein 28, Vitoria-Gasteiz, 01510 \u00c1lava, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0900-1643","authenticated-orcid":false,"given":"Josu","family":"Diaz-de-Arcaya","sequence":"additional","affiliation":[{"name":"Digital, TECNALIA, Basque Research and Technology Alliance (BRTA), Parque Tecnol\u00f3gico de \u00c1lava Albert Einstein 28, Vitoria-Gasteiz, 01510 \u00c1lava, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3005-1100","authenticated-orcid":false,"given":"Ana I.","family":"Torre-Bastida","sequence":"additional","affiliation":[{"name":"Digital, TECNALIA, Basque Research and Technology Alliance (BRTA), Parque Tecnol\u00f3gico de \u00c1lava Albert Einstein 28, Vitoria-Gasteiz, 01510 \u00c1lava, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6256-2696","authenticated-orcid":false,"given":"Philipp","family":"Hartlieb","sequence":"additional","affiliation":[{"name":"Mining Engineering and Mineral Economics, Montanuniversitaet Leoben, Erzherzog-Johann-Stra\u00dfe 3, 8700 Leoben, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-021-00419-9","article-title":"A survey on data-efficient algorithms in big data era","volume":"8","author":"Adadi","year":"2021","journal-title":"J. Big Data"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5","DOI":"10.19107\/CYBERCON.2022.01","article-title":"AI and IoT Mapping and the Transition to an Interconnected Cyber Defence and Intelligence Capabilities","volume":"9","author":"Jones","year":"2022","journal-title":"Int. Conf. Cybersecur. Cybercrime"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"101489","DOI":"10.1016\/j.is.2019.101489","article-title":"An Alternative View on Data Processing Pipelines from the DOLAP 2019 Perspective","volume":"92","author":"Romero","year":"2020","journal-title":"J. Inf. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Alla, S., and Adari, S.K. (2021). What Is MLOps?. Beginning MLOps with MLFlow: Deploy Models in AWS SageMaker, Google Cloud, and Microsoft Azure, Apress.","DOI":"10.1007\/978-1-4842-6549-9"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Leite, L., Rocha, C., Kon, F., Milojicic, D., and Meirelles, P. (2019). A Survey of DevOps Concepts and Challenges. ACM Comput. Surv., 52.","DOI":"10.1145\/3359981"},{"key":"ref_6","unstructured":"(2022, May 31). Challenges with ML in Production. Available online: https:\/\/docs.cloudera.com\/machine-learning\/1.1\/product\/topics\/ml-challenges-in-prod.html."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"D\u00edaz-de Arcaya, J., Mi\u00f1\u00f3n, R., Torre-Bastida, A.I., Del Ser, J., and Almeida, A. (2020). PADL: A Modeling and Deployment Language for Advanced Analytical Services. Sensors, 20.","DOI":"10.3390\/s20236712"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1417","DOI":"10.1007\/s00603-019-01799-4","article-title":"Deep Mining: A Rock Engineering Challenge","volume":"52","author":"Wagner","year":"2019","journal-title":"Rock Mech. Rock Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.jrmge.2020.11.001","article-title":"Principles and methods of rock support for rockburst control","volume":"13","author":"Li","year":"2021","journal-title":"J. Rock Mech. Geotech. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Rajapakse, R. (2008). Rock Bolts, Dowels, and Cable Bolts. Geotechnical Engineering Calculations and Rules of Thumb, Elsevier\/Butterworth-Heinemann.","DOI":"10.1016\/B978-075068764-5.50025-8"},{"key":"ref_11","unstructured":"N\u00f6ger, M., Hartlieb, P., Moser, P., Griesser, T., Ladinig, T., and Dendl, D. (2021, January 6\u20138). The potential of a mine-wide digital rock mass condition monitoring system. Proceedings of the 5th International Future Mining Conference, Perth, Australia and Online."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Singh, A., Singh, U.K., and Kumar, D. (2018, January 15\u201317). IoT in mining for sensing, monitoring and prediction of underground mines roof support. Proceedings of the 2018 4th International Conference on Recent Advances in Information Technology (RAIT), Dhanbad, India.","DOI":"10.1109\/RAIT.2018.8389041"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Song, G., Li, W., Wang, B., and Ho, S.C.M. (2017). A Review of Rock Bolt Monitoring Using Smart Sensors. Sensors, 17.","DOI":"10.3390\/s17040776"},{"key":"ref_14","unstructured":"(2022, May 31). illuMINEation-Projcet. Available online: https:\/\/www.illumineation-h2020.eu\/."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Pivarski, J., Bennett, C., and Grossman, R.L. (2016, January 13\u201317). Deploying analytics with the portable format for analytics (PFA). Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939731"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.infsof.2018.12.004","article-title":"A systematic mapping study of infrastructure as code research","volume":"108","author":"Rahman","year":"2019","journal-title":"Inf. Softw. Technol."},{"key":"ref_17","unstructured":"(2022, May 31). Chef. Available online: https:\/\/www.chef.io."},{"key":"ref_18","unstructured":"Loope, J. (2011). Managing Infrastructure with Puppet: Configuration Management at Scale, O\u2019Reilly Media, Inc."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zadka, M. (2019). Salt Stack. DevOps in Python: Infrastructure as Python, Apress.","DOI":"10.1007\/978-1-4842-4433-3"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zadka, M. (2019). Ansible. DevOps in Python: Infrastructure as Python, Apress.","DOI":"10.1007\/978-1-4842-4433-3"},{"key":"ref_21","unstructured":"(2022, May 31). Chef vs. Puppet vs. Ansible vs. Saltstack: WhichWorks Best for You?. Available online: https:\/\/www.edureka.co\/blog\/chef-vs-puppet-vs-ansible-vs-saltstack."},{"key":"ref_22","unstructured":"(2022, May 31). Terraform. Available online: https:\/\/www.terraform.io."},{"key":"ref_23","unstructured":"(2022, May 31). AWS CloudFormation. Available online: https:\/\/aws.amazon.com\/es\/cloudformation."},{"key":"ref_24","unstructured":"(2022, May 31). Openstack Heat. Available online: https:\/\/docs.openstack.org\/heat."},{"key":"ref_25","unstructured":"(2022, May 31). Cloudera. Available online: https:\/\/www.cloudera.com."},{"key":"ref_26","unstructured":"(2022, May 31). 1010data. Available online: https:\/\/www.1010data.com."},{"key":"ref_27","unstructured":"(2022, May 31). Azure HD Insight. Available online: https:\/\/azure.microsoft.com\/es-es\/services\/hdinsight."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Verma, A., Pedrosa, L., Korupolu, M., Oppenheimer, D., Tune, E., and Wilkes, J. (2015, January 21\u201324). Large-scale cluster management at Google with Borg. Proceedings of the Tenth European Conference on Computer Systems, Bordeaux, France.","DOI":"10.1145\/2741948.2741964"},{"key":"ref_29","unstructured":"Foundation, C.N.C. (2022, May 31). Official Kubernetes Website. Available online: https:\/\/kubernetes.io."},{"key":"ref_30","unstructured":"Hykes, S. (2022, May 31). Docker Swarm Engine. Available online: https:\/\/docs.docker.com\/engine\/swarm."},{"key":"ref_31","unstructured":"(2022, May 31). KubeEdge. Available online: https:\/\/kubeedge.io."},{"key":"ref_32","unstructured":"(2022, May 31). Apache Airflow. Available online: https:\/\/airflow.apache.org."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"60","DOI":"10.32614\/RJ-2009-010","article-title":"PMML: An open standard for sharing models","volume":"1","author":"Guazzelli","year":"2009","journal-title":"R J."},{"key":"ref_34","unstructured":"(2022, May 31). ONNX. Available online: https:\/\/onnx.ai\/."},{"key":"ref_35","first-page":"39","article-title":"Accelerating the Machine Learning Lifecycle with MLflow","volume":"41","author":"Zaharia","year":"2018","journal-title":"IEEE Data Eng. Bull."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Liu, P., Bravo-Rocca, G., Guitart, J., Dholakia, A., Ellison, D., and Hodak, M. (2021, January 6\u201310). Scanflow: An End-to-End Agent-Based Autonomic ML Workflow Manager for Clusters. Proceedings of the 22nd International Middleware Conference: Demos and Posters, Middleware \u201821, Virtual Event.","DOI":"10.1145\/3491086.3492468"},{"key":"ref_37","unstructured":"Crankshaw, D., Wang, X., Zhou, G., Franklin, M.J., Gonzalez, J.E., and Stoica, I. (2017, January 27\u201329). Clipper: A {Low-Latency} Online Prediction Serving System. Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17), Boston, MA, USA."},{"key":"ref_38","unstructured":"(2022, May 31). ML.Net. Available online: https:\/\/dotnet.microsoft.com\/learn\/ml-dotnet\/."},{"key":"ref_39","first-page":"46","article-title":"From the Edge to the Cloud: Model Serving in ML. NET","volume":"41","author":"Lee","year":"2018","journal-title":"IEEE Data Eng. Bull."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhao, J., Tiplea, T., Mortier, R., Crowcroft, J., and Wang, L. (2018, January 20). Data analytics service composition and deployment on edge devices. Proceedings of the 2018 Workshop on Big Data Analytics and Machine Learning for Data Communication Networks, Budapest, Hungary.","DOI":"10.1145\/3229607.3229615"},{"key":"ref_41","unstructured":"(2022, May 31). PyCaret. Available online: https:\/\/pycaret.org."},{"key":"ref_42","unstructured":"(2022, May 31). Seldon. Available online: https:\/\/www.seldon.io."},{"key":"ref_43","unstructured":"Talagala, N., Sundararaman, S., Sridhar, V., Arteaga, D., Luo, Q., Subramanian, S., Ghanta, S., Khermosh, L., and Roselli, D. (2022, May 31). ECO: Harmonizing Edge and Cloud with ML\/DL Orchestration. Available online: https:\/\/www.usenix.org\/system\/files\/conference\/hotedge18\/hotedge18-papers-talagala.pdf."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Bhattacharjee, A., Barve, Y., Khare, S., Bao, S., Kang, Z., Gokhale, A., and Damiano, T. (2019, January 9\u201312). Stratum: A bigdata-as-a-service for lifecycle management of iot analytics applications. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.","DOI":"10.1109\/BigData47090.2019.9006518"},{"key":"ref_45","unstructured":"(2022, March 03). Pytorch, TorchServe. Available online: https:\/\/pytorch.org\/serve\/."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Baylor, D., Breck, E., Cheng, H.T., Fiedel, N., Foo, C.Y., Haque, Z., Haykal, S., Ispir, M., Jain, V., and Koc, L. (2017, January 13\u201317). Tfx: A tensorflow-based production-scale machine learning platform. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.","DOI":"10.1145\/3097983.3098021"},{"key":"ref_47","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019, January 8\u201314). Pytorch: An imperative style, high-performance deep learning library. Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, BC, Canada."},{"key":"ref_48","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2\u20134). {TensorFlow}: A System for {Large-Scale} Machine Learning. Proceedings of the 12th USENIX symposium on operating systems design and implementation (OSDI 16), Savannah, GA, USA."},{"key":"ref_49","unstructured":"(2022, May 31). Kubeflow. Available online: https:\/\/www.kubeflow.org."},{"key":"ref_50","unstructured":"(2022, May 31). Overview of Docker Compose. Available online: https:\/\/docs.docker.com\/compose\/."},{"key":"ref_51","unstructured":"(2022, May 31). Angular Json Editor package. Available online: https:\/\/www.npmjs.com\/package\/ang-jsoneditor."},{"key":"ref_52","unstructured":"(2022, May 31). Angular Material design Stepper component. Available online: https:\/\/material.angular.io\/components\/stepper\/overview."},{"key":"ref_53","unstructured":"(2022, May 31). Titus. Available online: https:\/\/pypi.org\/project\/titus2."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1145\/2934664","article-title":"Apache spark: A unified engine for big data processing","volume":"59","author":"Zaharia","year":"2016","journal-title":"Commun. ACM"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/12\/4425\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:28:04Z","timestamp":1760138884000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/12\/4425"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,11]]},"references-count":54,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["s22124425"],"URL":"https:\/\/doi.org\/10.3390\/s22124425","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,6,11]]}}}