{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T06:27:46Z","timestamp":1759991266118,"version":"3.37.3"},"reference-count":20,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2015,6,1]],"date-time":"2015-06-01T00:00:00Z","timestamp":1433116800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"],"award-info":[{"award-number":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"],"award-info":[{"award-number":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"],"award-info":[{"award-number":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"],"award-info":[{"award-number":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002338","name":"Ministry of Education of the People\u2019s Republic of China","doi-asserted-by":"publisher","award":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"],"award-info":[{"award-number":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"]}],"id":[{"id":"10.13039\/501100002338","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004032","name":"Jilin University","doi-asserted-by":"publisher","award":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"],"award-info":[{"award-number":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"]}],"id":[{"id":"10.13039\/501100004032","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"crossref","award":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"],"award-info":[{"award-number":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Shandong Province higher educational science and technology program","award":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"],"award-info":[{"award-number":["61403328","61403329","61302065","61172049","93K172014K13","ZR2013FM011","J14LN24"]}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["International Journal of Distributed Sensor Networks"],"published-print":{"date-parts":[[2015,6,1]]},"abstract":"<jats:p> Density-based clustering for big data is critical for many modern applications ranging from Internet data processing to massive-scale moving object management. This paper proposes Cludoop algorithm, an efficient distributed density-based clustering for big data using Hadoop. First, we propose a serial clustering algorithm CluC by leveraging cell partition optimization and c-cluster to fast find clusters. CluC completes classification of the points using the relationships of connected cells around points instead of expensive completed neighbor query, which significantly reduce the number of distance calculations. Second, we propose the Cludoop, which can efficiently cluster very-large-scale data in parallel using already existing data partition on Map\/Reduce platform. It employs the proposed serial clustering CluC as a plugged-in clustering on parallel mapper, along with a cell description instead of completed cell in transmission to reduce both network and I\/O costs. Guided by proposed cell-based principles, we also design a Merging-Refinement-Merging 3-step framework to merge c-clusters on the overlay of assigned preclustering result on reducer. Finally, our comprehensive experimental evaluation on 10 network-connected commercial PCs, using both huge-volume real and synthetic data, demonstrates (1) the effectiveness of our algorithm in finding correct clusters with arbitrary shape and (2) the fact that our proposed algorithm exhibits better scalability and efficiency than state-of-the-art method. <\/jats:p>","DOI":"10.1155\/2015\/579391","type":"journal-article","created":{"date-parts":[[2015,6,2]],"date-time":"2015-06-02T14:05:46Z","timestamp":1433253946000},"page":"579391","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":17,"title":["Cludoop: An Efficient Distributed Density-Based Clustering for Big Data Using Hadoop"],"prefix":"10.1177","volume":"11","author":[{"given":"Yanwei","family":"Yu","sequence":"first","affiliation":[{"name":"School of Computer and Control Engineering, Yantai University, Yantai, Shandong 264005, China"}]},{"given":"Jindong","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Computer and Control Engineering, Yantai University, Yantai, Shandong 264005, China"}]},{"given":"Xiaodong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4285-0428","authenticated-orcid":false,"given":"Qin","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China"}]},{"given":"Yonggang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China"}]}],"member":"179","published-online":{"date-parts":[[2015,6,1]]},"reference":[{"volume-title":"Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining(SIGKDD \u203296)","author":"Ester M.","first-page":"226","key":"B1-2015-579391"},{"volume-title":"Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD \u203299)","author":"Ankerst M.","key":"B2-2015-579391"},{"volume-title":"Proceedings of the 4th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD \u203298)","author":"Hinneburg A.","first-page":"58","key":"B3-2015-579391"},{"doi-asserted-by":"publisher","key":"B5-2015-579391","DOI":"10.1023\/a:1009745219419"},{"volume-title":"Proceedings of the International Conference on Very Large Data Bases (VLDB \u203212)","author":"Shim K.","first-page":"2016","key":"B4-2015-579391"},{"doi-asserted-by":"publisher","key":"B6-2015-579391","DOI":"10.1023\/a:1009884809343"},{"volume-title":"Proceedings of the International Conference on Extending Database Technology (EDBT \u203204)","author":"Januzaj E.","first-page":"88","key":"B7-2015-579391"},{"volume-title":"Proceedings of the 8th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD '04)","author":"Januzaj E.","first-page":"88","key":"B8-2015-579391"},{"doi-asserted-by":"publisher","key":"B9-2015-579391","DOI":"10.1007\/978-3-540-27866-5_47"},{"doi-asserted-by":"publisher","key":"B10-2015-579391","DOI":"10.1007\/11731139_22"},{"doi-asserted-by":"publisher","key":"B11-2015-579391","DOI":"10.1007\/978-3-642-03722-1_3"},{"doi-asserted-by":"publisher","key":"B12-2015-579391","DOI":"10.1145\/1645953.1646038"},{"volume-title":"Proceedings of the International Conference on Computational Science (ICCS '13)","author":"Andrade G.","first-page":"369","key":"B13-2015-579391"},{"doi-asserted-by":"publisher","key":"B14-2015-579391","DOI":"10.1145\/2020408.2020515"},{"doi-asserted-by":"publisher","key":"B15-2015-579391","DOI":"10.1109\/icpads.2011.83"},{"doi-asserted-by":"publisher","key":"B16-2015-579391","DOI":"10.1109\/cloud.2012.42"},{"doi-asserted-by":"publisher","key":"B17-2015-579391","DOI":"10.1007\/s11704-013-3158-3"},{"doi-asserted-by":"publisher","key":"B18-2015-579391","DOI":"10.1145\/2020408.2020516"},{"issue":"2","key":"B19-2015-579391","first-page":"32","volume":"33","author":"Yu Z.","year":"2010","journal-title":"IEEE Data Engineering Bulletin"},{"doi-asserted-by":"publisher","key":"B20-2015-579391","DOI":"10.1109\/tkde.2011.200"}],"container-title":["International Journal of Distributed Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1155\/2015\/579391","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/full-xml\/10.1155\/2015\/579391","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/journals.sagepub.com\/doi\/pdf\/10.1155\/2015\/579391","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,6]],"date-time":"2021-05-06T01:27:10Z","timestamp":1620264430000},"score":1,"resource":{"primary":{"URL":"http:\/\/journals.sagepub.com\/doi\/10.1155\/2015\/579391"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,6,1]]},"references-count":20,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2015,6,1]]}},"alternative-id":["10.1155\/2015\/579391"],"URL":"https:\/\/doi.org\/10.1155\/2015\/579391","relation":{},"ISSN":["1550-1477","1550-1477"],"issn-type":[{"type":"print","value":"1550-1477"},{"type":"electronic","value":"1550-1477"}],"subject":[],"published":{"date-parts":[[2015,6,1]]}}}