{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:50:04Z","timestamp":1760241004899,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2019,11,7]],"date-time":"2019-11-07T00:00:00Z","timestamp":1573084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>With the explosive growth of the scale of complex networks, the existing community detection algorithms are unable to meet the needs of rapid analysis of the community structure in complex networks. A new algorithm for detecting communities in complex networks based on the Hadoop platform (called Community Detection on Hadoop (CDOH)) is proposed in this paper. Based on the basic idea of modularity increment, our algorithm implements parallel merging and accomplishes a fast and accurate detection of the community structure in complex networks. Our extensive experimental results on three real datasets of complex networks demonstrate that the CDOH algorithm can improve the efficiency of the current memory-based community detection algorithms significantly without affecting the accuracy of the community detection.<\/jats:p>","DOI":"10.3390\/sym11111382","type":"journal-article","created":{"date-parts":[[2019,11,7]],"date-time":"2019-11-07T11:17:25Z","timestamp":1573125445000},"page":"1382","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Algorithm for Detecting Communities in Complex Networks Based on Hadoop"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3418-8104","authenticated-orcid":false,"given":"Mo","family":"Hai","sequence":"first","affiliation":[{"name":"School of Information, Central University of Finance and Economics, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6206-3662","authenticated-orcid":false,"given":"Haifeng","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information, Central University of Finance and Economics, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhekun","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Information, Central University of Finance and Economics, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaomei","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Information, Central University of Finance and Economics, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1038\/30918","article-title":"Collective dynamics of \u2018small-world\u2019 networks","volume":"393","author":"Watts","year":"1998","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1145\/316194.316229","article-title":"On power-law relationships of the Internet topology","volume":"29","author":"Faloutsos","year":"1999","journal-title":"ACM SIGCOMM Comput. Commun. Rev."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"026104","DOI":"10.1103\/PhysRevE.68.026104","article-title":"Clustering properties of a generalized critical Euclidean network","volume":"68","author":"Sen","year":"2003","journal-title":"Phys. Rev. E Stat. Nonlinear Soft Matter Phys."},{"key":"ref_4","first-page":"95","article-title":"Topological properties analysis of Beijing public transport network based on complex network theory","volume":"61","author":"Zheng","year":"2012","journal-title":"J. Phys."},{"key":"ref_5","first-page":"98","article-title":"Cooperative Innovation of Social Governance under the Paradigm of Complex Network Structure","volume":"4","author":"Fan","year":"2014","journal-title":"Soc. Sci. China"},{"key":"ref_6","first-page":"17","article-title":"Finding and evaluating community structure in networks","volume":"69","author":"Newman","year":"2003","journal-title":"Phys. Rev. E"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1007\/s10115-013-0693-z","article-title":"Defining and evaluating network communities based on ground-truth","volume":"42","author":"Yang","year":"2015","journal-title":"Knowl. Inf. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4266","DOI":"10.1109\/TII.2019.2908056","article-title":"An Edge Intelligence Empowered Recommender System Enabling Cultural Heritage Applications","volume":"15","author":"Xin","year":"2019","journal-title":"IEEE Trans. Ind. Inf."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"066133","DOI":"10.1103\/PhysRevE.69.066133","article-title":"Fast algorithm for detecting community structure in networks","volume":"69","author":"Newman","year":"2003","journal-title":"Phys. Rev. E"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"066111","DOI":"10.1103\/PhysRevE.70.066111","article-title":"Finding community structure in very large networks","volume":"70","author":"Clauset","year":"2004","journal-title":"Phys. Rev. E"},{"key":"ref_11","first-page":"2255","article-title":"Edge Community Mining Based on Local Information in Social Networks","volume":"40","author":"Pan","year":"2012","journal-title":"J. Electron."},{"key":"ref_12","unstructured":"Xiong, Z. (2012). Community Discovery Technology and Its Application in Online Social Networks, Central South University."},{"key":"ref_13","unstructured":"Huang, W. (2013). Research on Web Community Discovery Algorithms, Beijing University of Posts and Telecommunications."},{"key":"ref_14","first-page":"723","article-title":"Research on network community discovery algorithm based on greedy optimization technology","volume":"42","author":"Leng","year":"2014","journal-title":"J. Electron."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.physa.2014.10.095","article-title":"Overlapping community identification approach in online social networks","volume":"421","author":"Zhang","year":"2015","journal-title":"Physica A Stat. Mech. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Blondel, V.D., Guillaume, J.L., Lambiotte, R., and Lefebvre, E. (2008). Fast unfolding of community hierarchies in large networks. Comput. Res. Repos.","DOI":"10.1088\/1742-5468\/2008\/10\/P10008"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Parsa, M.G., Mozayani, N., and Esmaeili, A. (2014, January 9\u201311). An EDA-based community detection in complex networks. Proceedings of the International Symposium on Telecommunications, Tehran, Iran.","DOI":"10.1109\/ISTEL.2014.7000750"},{"key":"ref_18","unstructured":"Oliveira, J.E.M.D., and Quiles, M.G. (July, January 30). Community Detection in Complex Networks Using Coupled Kuramoto Oscillators. Proceedings of the International Conference on Computational Science and ITS Applications, Guimaraes, Portugal."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"307","DOI":"10.3390\/sym11030307","article-title":"Finding College Student Social Networks by Mining the Records of Student ID Transactions","volume":"11","author":"Tao","year":"2019","journal-title":"Symmetry"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"299","DOI":"10.3390\/sym11030299","article-title":"Evolution of Conformity Dynamics in Complex Social Networks","volume":"11","author":"Yuhui","year":"2019","journal-title":"Symmetry"},{"key":"ref_21","unstructured":"Giuseppe, A., Domenico, C., Antonio, M., and Antonio, P. (2018, January 26\u201329). Mobile Encrypted Traffic classification Using Deep Learning. Proceedings of the 2018 Network Traffic Measurement and Analysis Conference (TMA), Vienna, Austria."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1109\/TNSM.2019.2899085","article-title":"Mobile encrypted traffic classification using deep learning: Experimental evaluation, lessons learned, and challenges","volume":"16","author":"Giuseppe","year":"2019","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_23","unstructured":"Ruoyu, W., Zhen, L., Yongming, C., Deyu, T., Jin, Y., and Zhao, Y. (2018, January 5\u20137). Benchmark Data for Mobile App Traffic Research. Proceedings of the 15th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, New York, NY, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"026132","DOI":"10.1103\/PhysRevE.72.026132","article-title":"Finding local community structure in networks","volume":"72","author":"Clauset","year":"2005","journal-title":"Phys. Rev. E Stat. Nonlinear Soft Matter Phys."},{"key":"ref_25","unstructured":"Li, J. (2014). Research on Overlapping Community Discovery Algorithm Based on Hadoop Platform, Jilin University."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Riedy, J., Bader, D.A., and Meyerhenke, H. (2012, January 21\u201325). Scalable Multi-threaded Community Detection in Social Networks. Proceedings of the IEEE International Parallel and Distributed Processing Symposium Workshops & Phd Forum, Shanghai, China.","DOI":"10.1109\/IPDPSW.2012.203"},{"key":"ref_27","unstructured":"Moon, S., Lee, J.G., and Kang, M. (2014, January 15\u201317). Scalable community detection from networks by computing edge betweenness on MapReduce. Proceedings of the 2014 International Conference on Big Data and Smart Computing (BIGCOMP), Bangkok, Thailand."},{"key":"ref_28","first-page":"1402","article-title":"A Parallelization of Louvain algorithm","volume":"44","author":"Wu","year":"2016","journal-title":"Comput. Digit. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"P10008","DOI":"10.1088\/1742-5468\/2008\/10\/P10008","article-title":"Fast unfolding of communities in large networks","volume":"10","author":"Blondel","year":"2008","journal-title":"J. Stat. Mech. Theory Exp."},{"key":"ref_30","unstructured":"Lai, B. (2017). Research on Parallelization of Community Discovery Algorithm Based on Hadoop, Jiangxi University of Science and Technology."},{"key":"ref_31","unstructured":"Alessio, C., Tiziano, D.M., Daniele, D.S., Grossi, R., Marion, A., and Versari, L. (2018). D2k: Scalable Community Detection in Massive Networks via Small-Diameter k-Plexes, ACM. KDD 2018."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1016\/j.engappai.2019.08.003","article-title":"Community detection based on Game Theory","volume":"85","author":"Vincenzo","year":"2019","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_33","unstructured":"Mcdaid, A.F., Greene, D., and Hurley, N. (2011). Normalized Mutual Information to evaluate overlapping community finding algorithms. CoRR."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/11\/1382\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:32:43Z","timestamp":1760189563000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/11\/1382"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,7]]},"references-count":33,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["sym11111382"],"URL":"https:\/\/doi.org\/10.3390\/sym11111382","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2019,11,7]]}}}