{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T04:20:01Z","timestamp":1741753201404,"version":"3.38.0"},"reference-count":17,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2024,11,1]],"date-time":"2024-11-01T00:00:00Z","timestamp":1730419200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Intelligent Decision Technologies"],"published-print":{"date-parts":[[2024,11]]},"abstract":"<jats:p> In order to solve the problem of low computing efficiency in big data analysis and model construction, this paper intended to deeply explore the big data analysis programming model, DAG (Directed Acyclic Graph) and other contents, and on this basis, it adopted a distributed matrix computing system Octopus for big data analysis. Octopus is a universal matrix programming framework that provides a programming model based on matrix operations, which can conveniently analyze and process large-scale data. By using Octopus, users can extract functions and data from multiple platforms and operate through a unified matrix operation interface. The distributed matrix representation and storage layer can design data storage formats for distributed file systems. Each computing platform in OctMatrix provides its own matrix library, and it provides a matrix library written in R language for the above users. SymboMatrix provides a matrix interface to OctMatrix that is consistent with OctMatrix. However, SymboMatrix also retains the flow diagram for matrix operations in the process, and it also supports logical and physical optimization of the flow diagram on a DAG. For the DAG computational flow graph generated by SymbolMatrix, this paper divided it into two parts: logical optimization and physical optimization. This paper adopted a distributed file system based on line matrix, and obtained the corresponding platform matrix by reading the documents based on line matrix. In the evaluation of system performance, it was found that the distributed matrix computing system had a high computing efficiency, and the average CPU (central processing unit) usage reached 70%. This system can make full use of computing resources and realize efficient parallel computing. <\/jats:p>","DOI":"10.3233\/idt-230309","type":"journal-article","created":{"date-parts":[[2024,4,26]],"date-time":"2024-04-26T17:57:07Z","timestamp":1714154227000},"page":"2915-2931","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Distributed matrix computing system for big data"],"prefix":"10.1177","volume":"18","author":[{"given":"Guangtao","family":"Zhang","sequence":"first","affiliation":[{"name":"Information Engineering College, Yangzhou Polytechnic College, Yangzhou, Jiangsu, China"},{"name":"Jiangsu Safety and Environment Technology and Equipment for Planting and Breeding Industry Engineering, Yangzhou, Jiangsu, China"}]}],"member":"179","published-online":{"date-parts":[[2024,11,1]]},"reference":[{"issue":"4","key":"bibr1-IDT-230309","first-page":"45","volume":"3","author":"Mallik A","year":"2022","journal-title":"Distributed Processing System"},{"issue":"5","key":"bibr2-IDT-230309","first-page":"655","volume":"47","author":"Zhao JY","year":"2021","journal-title":"Radio Communication Technology"},{"key":"bibr3-IDT-230309","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2019.2963864"},{"key":"bibr4-IDT-230309","doi-asserted-by":"publisher","DOI":"10.3901\/JME.2020.09.073"},{"key":"bibr5-IDT-230309","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2021.3095909"},{"issue":"4","key":"bibr6-IDT-230309","first-page":"1","volume":"52","author":"Tal BN","year":"2019","journal-title":"Computing Surveys (CSUR)"},{"key":"bibr7-IDT-230309","doi-asserted-by":"publisher","DOI":"10.26438\/ijcse\/v7i7.247251"},{"key":"bibr8-IDT-230309","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2019.03.014"},{"key":"bibr9-IDT-230309","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2020.10.011"},{"key":"bibr10-IDT-230309","doi-asserted-by":"publisher","DOI":"10.4018\/IJDST.2018070102"},{"issue":"3","key":"bibr11-IDT-230309","first-page":"1","volume":"1","author":"Pascual EJ","year":"2020","journal-title":"Distributed Processing System"},{"issue":"16","key":"bibr12-IDT-230309","first-page":"25","volume":"46","author":"Shang LQ","year":"2018","journal-title":"Power System Protection and Control"},{"issue":"4","key":"bibr13-IDT-230309","first-page":"58","volume":"35","author":"Wang YF","year":"2018","journal-title":"Computer Simulation"},{"issue":"4","key":"bibr14-IDT-230309","first-page":"1","volume":"27","author":"Zhao GR","year":"2020","journal-title":"Electro-Optical and Control"},{"issue":"1","key":"bibr15-IDT-230309","first-page":"22","volume":"38","author":"Bao C","year":"2021","journal-title":"Microelectronics and Computers"},{"issue":"1","key":"bibr16-IDT-230309","first-page":"61","volume":"53","author":"Tong Q","year":"2021","journal-title":"Journal of Zhengzhou University (Science Edition)"},{"key":"bibr17-IDT-230309","doi-asserted-by":"publisher","DOI":"10.1017\/apr.2022.8"}],"container-title":["Intelligent Decision Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/IDT-230309","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/IDT-230309","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/IDT-230309","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,11]],"date-time":"2025-03-11T06:05:37Z","timestamp":1741673137000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/IDT-230309"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11]]},"references-count":17,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,11]]}},"alternative-id":["10.3233\/IDT-230309"],"URL":"https:\/\/doi.org\/10.3233\/idt-230309","relation":{},"ISSN":["1872-4981","1875-8843"],"issn-type":[{"type":"print","value":"1872-4981"},{"type":"electronic","value":"1875-8843"}],"subject":[],"published":{"date-parts":[[2024,11]]}}}