{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T05:05:15Z","timestamp":1750309515309,"version":"3.41.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"Autumn","license":[{"start":{"date-parts":[[2024,9,1]],"date-time":"2024-09-01T00:00:00Z","timestamp":1725148800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGWEB Newsl."],"published-print":{"date-parts":[[2024,9]]},"abstract":"<jats:p>This article addresses the importance of HaaS (Hadoop-as-a-Service) in cloud technologies, with specific reference to its usefulness in big data mining for environmental computing applications. The term environmental computing refers to computational analysis within environmental science and management, encompassing a myriad of techniques, especially in data mining and machine learning. As is well-known, the classical MapReduce has been adapted within many applications for big data storage and information retrieval. Hadoop based tools such as Hive and Mahout are broadly accessible over the cloud and can be helpful in data warehousing and data mining over big data in various domains. In this article, we explore HaaS technologies, mainly based on Apache's Hive and Mahout for applications in environmental computing, considering publicly available data on the Web. We dwell upon interesting applications such as automated text classification for energy management, recommender systems for ecofriendly products, and decision support in urban planning. We briefly explain the classical paradigms of MapReduce, Hadoop and Hive, further delve into data mining and machine learning over the MapReduce framework, and explore techniques such as Na\u00efve Bayes and Random Forests using Apache Mahout with respect to the targeted applications. Hence, the paradigm of Hadoop-as-a-Service, popularly referred to as HaaS, is emphasized here as per its benefits in a domain-specific context. The studies in environmental computing, as presented in this article, can be useful in other domains as well, considering similar applications. This article can thus be interesting to professionals in web technologies, cloud computing, environmental management, as well as AI and data science in general.<\/jats:p>","DOI":"10.1145\/3704991.3704995","type":"journal-article","created":{"date-parts":[[2024,12,21]],"date-time":"2024-12-21T19:50:16Z","timestamp":1734810616000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["HaaS in Environmental Computing: Hadoop-as-a-Service for Big Data Mining in Environmental Computing Applications"],"prefix":"10.1145","volume":"2024","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3170-2510","authenticated-orcid":false,"given":"Aparna S.","family":"Varde","sequence":"first","affiliation":[{"name":"School of Computing and Clean Energy &amp; Sustainability Analytics Center, Montclair State University, Montclair, NJ, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,12,21]]},"reference":[{"volume-title":"Data Management in the Cloud: Limitations and Opportunities","author":"ABADI D. J.","key":"e_1_2_1_1_1","unstructured":"ABADI, D. J. 2009. Data Management in the Cloud: Limitations and Opportunities. IEEE Data Engineering Bulletin."},{"key":"e_1_2_1_2_1","unstructured":"AFSAR M. M. CRUMP T. AND FAR B. H. 2021. Reinforcement learning based recommender systems: A survey. CoRR abs\/2101.06286."},{"volume-title":"The Future Internet: Future Internet Assembly 2012: From Promises to Reality 9","author":"ANTHOPOULOS L. G.","key":"e_1_2_1_3_1","unstructured":"ANTHOPOULOS, L. G. AND VAKALI, A. 2012. Urban planning and smart cities: Interrelations and reciprocities. In The Future Internet: Future Internet Assembly 2012: From Promises to Reality 9. Springer Berlin Heidelberg, 178.189."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1005595727426"},{"key":"e_1_2_1_5_1","unstructured":"AWS. 2021. Amazon web services. https:\/\/aws.amazon.com\/."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1155\/2019\/8235458"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-012-0269-7"},{"key":"e_1_2_1_8_1","first-page":"118","article-title":"A Hive and SQL Case Study in Cloud Data Analytics. In IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference","volume":"112","author":"CHANDRA S.","year":"2019","unstructured":"CHANDRA, S., VARDE, A. S., AND WANG, J. 2019. A Hive and SQL Case Study in Cloud Data Analytics. In IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference, UEMCON. IEEE, 112.118.","journal-title":"UEMCON. IEEE"},{"key":"e_1_2_1_9_1","series-title":"Lecture Notes in Computer Science","volume-title":"Database Systems for Advanced Applications DASFAA","author":"DE MELO G.","unstructured":"DE MELO, G. AND VARDE, A. S. 2015. Scalable Learning Technologies for Big Data Mining. In Database Systems for Advanced Applications DASFAA. Lecture Notes in Computer Science, vol. 9050. Springer, xvii. xviii."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the 6th Conference on Symposium on Opearting Systems Design & Implementation -","volume":"6","author":"DEAN J.","year":"2004","unstructured":"DEAN, J. AND GHEMAWAT, S. 2004. MapReduce: Simplified data processing on large clusters. In Proceedings of the 6th Conference on Symposium on Opearting Systems Design & Implementation - Volume 6. OSDI'04. 10.10."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1629175.1629198"},{"key":"e_1_2_1_12_1","volume-title":"ACM SIGWEB","author":"DU X.","year":"2019","unstructured":"DU, X., KOWALSKI, M., VARDE, A. S., DE MELO, G., AND TAYLOR, R. W. 2019. Public opinion matters: mining social media text for environmental management. ACM SIGWEB 2019, Autumn, 5:1.5:15."},{"key":"e_1_2_1_13_1","first-page":"25","article-title":"Urban legislation assessment by data analytics with smart city characteristics. In 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON)","volume":"20","author":"DU X.","year":"2017","unstructured":"DU, X., LIPORACE, D., AND VARDE, A. S. 2017. Urban legislation assessment by data analytics with smart city characteristics. In 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON). IEEE, 20.25.","journal-title":"IEEE"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367511"},{"key":"e_1_2_1_15_1","first-page":"63","article-title":"Sentiment Analysis of Twitter Data with Hybrid Learning for Recommender Applications. In IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference","volume":"57","author":"GANDHE K.","year":"2018","unstructured":"GANDHE, K., VARDE, A. S., AND DU, X. 2018. Sentiment Analysis of Twitter Data with Hybrid Learning for Recommender Applications. In IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference, UEMCON. IEEE, 57.63.","journal-title":"UEMCON. IEEE"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jag.2022.102869"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2020408.2020464"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2076623.2076636"},{"key":"e_1_2_1_19_1","unstructured":"HADOOP. 2021. 10 best cloud service providers. https:\/\/www.hdfstutorial.com\/blog\/hadoop-cloud-serviceproviders- 2\/."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2013.95"},{"key":"e_1_2_1_21_1","unstructured":"IBM. 2024. What is edge ai? https:\/\/www.ibm.com\/topics\/edge-ai."},{"key":"e_1_2_1_22_1","first-page":"4881","article-title":"Transfer learning for decision support in covid-19 detection from a few images in big data. In 2020 IEEE International Conference on Big Data (Big Data)","volume":"4873","author":"KARTHIKEYAN D.","year":"2020","unstructured":"KARTHIKEYAN, D., VARDE, A. S., AND WANG, W. 2020. Transfer learning for decision support in covid-19 detection from a few images in big data. In 2020 IEEE International Conference on Big Data (Big Data). IEEE, 4873.4881.","journal-title":"IEEE"},{"key":"e_1_2_1_23_1","unstructured":"KIROS R. SALAKHUTDINOV R. AND ZEMEL R. S. 2014. Multimodal neural language models. In Interna- tional Conference on Machine Learning (ICML). 595.603."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmsy.2022.09.010"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.buildenv.2019.106603"},{"key":"e_1_2_1_26_1","volume-title":"MLbase: A Distributed Machine-learning System. In Conference on Innovative Data Systems Research (CIDR).","author":"KRASKA T.","year":"2013","unstructured":"KRASKA, T., TALWALKAR, A., DUCHI, J. C., GRIFFITH, R., FRANKLIN, M. J., AND JORDAN, M. I. 2013. MLbase: A Distributed Machine-learning System. In Conference on Innovative Data Systems Research (CIDR)."},{"key":"e_1_2_1_27_1","volume-title":"International Conference on Machine Learning (ICML). 1188","author":"LE Q. V.","year":"2014","unstructured":"LE, Q. V. AND MIKOLOV, T. 2014. Distributed representations of sentences and documents. In International Conference on Machine Learning (ICML). 1188.1196."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2213836.2213958"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gloei.2020.07.008"},{"key":"e_1_2_1_30_1","first-page":"282","article-title":"Smart governance: A key factor for smart cities implementation","volume":"277","author":"LOPES N. V.","year":"2017","unstructured":"LOPES, N. V. 2017. Smart governance: A key factor for smart cities implementation. In IEEE ICSGSC. IEEE, 277.282.","journal-title":"IEEE ICSGSC. IEEE"},{"key":"e_1_2_1_31_1","first-page":"4645","article-title":"Item-Based Collaborative Filtering and Association Rules for a Baseline Recommender in E-Commerce. In IEEE International Conference on Big Data","volume":"4636","author":"LOURENCO J.","year":"2020","unstructured":"LOURENCO, J. AND VARDE, A. S. 2020. Item-Based Collaborative Filtering and Association Rules for a Baseline Recommender in E-Commerce. In IEEE International Conference on Big Data. IEEE, 4636.4645.","journal-title":"IEEE"},{"key":"e_1_2_1_32_1","unstructured":"MCLVOR K. 2016. The DevOps Pipeline. Tech. rep. QA Limited Berkshire England. Feb."},{"volume-title":"Mahout in Action","author":"OWEN S.","key":"e_1_2_1_33_1","unstructured":"OWEN, S., ANIL, R., DUNNING, T., AND FRIEDMAN, E. 2011. Mahout in Action. Manning Publications."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1871902.1871912"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2627692.2627703"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3229329.3229334"},{"key":"e_1_2_1_37_1","first-page":"16","article-title":"Comparing SQL and MapReduce to compute Naive Bayes in a single table scan. In International ACM CIKM Workshop on Cloud Data Management","volume":"9","author":"PITCHAIMALAI S. K.","year":"2010","unstructured":"PITCHAIMALAI, S. K., ORDONEZ, C., AND GARCIA-ALVARADO, C. 2010. Comparing SQL and MapReduce to compute Naive Bayes in a single table scan. In International ACM CIKM Workshop on Cloud Data Management, CloudDB. ACM, 9.16.","journal-title":"CloudDB. ACM"},{"volume-title":"Smart governance through opinion mining of public reactions on ordinances","author":"PURI M.","key":"e_1_2_1_38_1","unstructured":"PURI, M., VARDE, A., DU, X., AND DE MELO, G. 2018. Smart governance through opinion mining of public reactions on ordinances. In IEEE ICTAI. 838.845."},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"RATHORE M. M. AHMAD A. PAUL A. AND RHO S. 2016. Urban planning and building smart cities based on the internet of things using big data analytics. Computer networks 101 63.80.","DOI":"10.1016\/j.comnet.2015.12.023"},{"key":"e_1_2_1_40_1","volume-title":"PARMA: A Parallel Randomized Algorithm for Approximate Association Rules Mining in MapReduce. In ACM International Conference on Information and Knowledge Management (CIKM). 85","author":"RIONDATO M.","year":"2012","unstructured":"RIONDATO, M., DEBRABANT, J. A., FONSECA, R., AND UPFAL, E. 2012. PARMA: A Parallel Randomized Algorithm for Approximate Association Rules Mining in MapReduce. In ACM International Conference on Information and Knowledge Management (CIKM). 85.94."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3631358.3631363"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10901-020-09811-y"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1629175.1629197"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2011.166"},{"key":"e_1_2_1_45_1","doi-asserted-by":"crossref","unstructured":"TETKO I. V. ENGKVIST O. KOCH U. REYMOND J.-L. AND CHEN H. 2016. Bigchem: challenges and opportunities for big data analysis in chemistry. Molecular informatics 35 11-12 615.621.","DOI":"10.1002\/minf.201600073"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2010.5447738"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1080\/10630732.2019.1651178"},{"key":"e_1_2_1_48_1","first-page":"244","article-title":"Learning the relative importance of features in image data. In 2007 IEEE 23rd international conference on data engineering workshop","volume":"237","author":"VARDE A.","year":"2007","unstructured":"VARDE, A., RUNDENSTEINER, E., JAVIDI, G., SHEYBANI, E., AND LIANG, J. 2007. Learning the relative importance of features in image data. In 2007 IEEE 23rd international conference on data engineering workshop. IEEE, 237.244.","journal-title":"IEEE"},{"key":"e_1_2_1_49_1","volume-title":"AAAI 2023 conference, Bridge Program, arXiv:2303","author":"VARDE A. S.","year":"2023","unstructured":"VARDE, A. S. AND LIANG, J. 2023. Machine learning approaches in agile manufacturing with recycled materials for sustainability. AAAI 2023 conference, Bridge Program, arXiv:2303.08291."},{"key":"e_1_2_1_50_1","volume-title":"Hadoop: The Definitive Guide","author":"WHITE T.","year":"2012","unstructured":"WHITE, T. 2012. Hadoop: The Definitive Guide. O'Reilly Media, Inc."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ccr.2024.215701"},{"volume-title":"Eco-friendly office supplies, pens and markers. Open Collections","author":"YE H.","key":"e_1_2_1_52_1","unstructured":"YE, H., CHAN, J., BHATTI, R., ET AL. 2014. Eco-friendly office supplies, pens and markers. Open Collections, University of British Columbia."},{"key":"e_1_2_1_53_1","unstructured":"YEUNG T. 2022. What's the difference between edge computing and cloud computing? nvidia. https:\/\/blogs.nvidia.com\/blog\/difference-between-cloud-and-edge-computing\/."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-05469-3"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40747-020-00212-w"}],"container-title":["ACM SIGWEB Newsletter"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3704991.3704995","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3704991.3704995","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:18:01Z","timestamp":1750295881000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3704991.3704995"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9]]},"references-count":55,"journal-issue":{"issue":"Autumn","published-print":{"date-parts":[[2024,9]]}},"alternative-id":["10.1145\/3704991.3704995"],"URL":"https:\/\/doi.org\/10.1145\/3704991.3704995","relation":{},"ISSN":["1931-1745","1931-1435"],"issn-type":[{"type":"print","value":"1931-1745"},{"type":"electronic","value":"1931-1435"}],"subject":[],"published":{"date-parts":[[2024,9]]},"assertion":[{"value":"2024-12-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}