{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T08:36:58Z","timestamp":1783154218420,"version":"3.54.6"},"reference-count":35,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,12,31]],"date-time":"2022-12-31T00:00:00Z","timestamp":1672444800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Key Project of Guangdong Provincial Basic and Applied Basic Research Fund Regional Joint Fund","award":["2020B1515120095"],"award-info":[{"award-number":["2020B1515120095"]}]},{"name":"Guangdong Provincial Enterprise Key Laboratory Project","award":["2020B121202001"],"award-info":[{"award-number":["2020B121202001"]}]},{"name":"Key projects of social science and technology development in Dongguan","award":["2020507156156"],"award-info":[{"award-number":["2020507156156"]}]},{"name":"Special fund for Dongguan's Rural Revitalization Strategy in 2021","award":["20211800400102"],"award-info":[{"award-number":["20211800400102"]}]},{"name":"Dongguan special commissioner project","award":["20211800500182"],"award-info":[{"award-number":["20211800500182"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Manage. Inf. Syst."],"published-print":{"date-parts":[[2022,12,31]]},"abstract":"<jats:p>The aim of smart manufacturing is to reduce manpower requirements of the production line by applying technology of huge amounts of data to the manufacturing industry. Smart manufacturing is also called<jats:italic>Industry 4.0<\/jats:italic>, and the platform for processing huge amounts of data has an indispensable role. The massive data processing platform is like the brain of the entire factory, receiving all data from production line sensors via edge computing, processing, and analyzing, and finally making feedback decisions. With the innovation of production technology, the data that the platform needs to process has become diverse and complex, and the amount has become increasingly large. As well, many precision manufacturing industries have begun to enter the field of Industry 4.0. In addition to the accuracy and availability of data processing, there is emphasis on the real-time nature of data processing. After the sensor receives the data, the platform must provide feedback within a short period of time. This article proposes a massive data processing platform based on the Lambda architecture, which has the coexistence of stream processing and batch processing to meet real-time feedback needs of high-precision manufacturing. To verify the effectiveness of the optimization, it is based on real data from the manufacturing industry. To generate a large amount of test data to confirm the optimization of the storage of pictures. The results show that it optimizes the storage and optimization of the image data generated by the Automated Optical Inspection technology used in manufacturing today and optimizes the query for data storage. It also reduces the consumption of a large amount of memory as expected, and the query for Hive reduced the time spent.<\/jats:p>","DOI":"10.1145\/3508395","type":"journal-article","created":{"date-parts":[[2022,4,13]],"date-time":"2022-04-13T11:52:20Z","timestamp":1649850740000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Application Massive Data Processing Platform for Smart Manufacturing Based on Optimization of Data Storage"],"prefix":"10.1145","volume":"13","author":[{"given":"Bin","family":"Ren","sequence":"first","affiliation":[{"name":"Dongguan University of Technology, Dongguan City, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuquiang","family":"Chen","sequence":"additional","affiliation":[{"name":"Dongguan Polytechnic, Dongguan City, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fujie","family":"Wang","sequence":"additional","affiliation":[{"name":"Dongguan University of Technology, Dongguan City, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,2,14]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2017.2772241"},{"issue":"1","key":"e_1_3_1_3_2","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/JAS.2019.1911795","article-title":"Big data analytics in telecommunications: literature review and architecture recommendations","volume":"7","author":"Zahid Hira","year":"2020","unstructured":"Hira Zahid, Tariq Mahmood, Ahsan Morshed, and Timos Sellis. 2020. Big data analytics in telecommunications: literature review and architecture recommendations. IEEE\/CAA Journal of Automatica Sinica 7, 1 (2020), 18\u201338.","journal-title":"IEEE\/CAA Journal of Automatica Sinica"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/SEC50012.2020.00019"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/STC-CSIT.2018.8526592"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICEIEC.2019.8784580"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSMP.2018.8478589"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.20965\/ijat.2017.p0004"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40684-016-0015-5"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.2298\/CSIS171015021J"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2016.03.127"},{"issue":"6","key":"e_1_3_1_12_2","first-page":"785","article-title":"Efficient way for handling small files using extended HDFS","volume":"3","author":"Jayakar Kashmira P.","year":"2014","unstructured":"Kashmira P. Jayakar and Y. B. Gurav. 2014. Efficient way for handling small files using extended HDFS. International Journal of Computer Science and Mobile Computing 3, 6 (2014), 785\u2013789.","journal-title":"International Journal of Computer Science and Mobile Computing"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/JCSSE.2014.6841867"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.4156\/jdcta.vol6.issue20.32"},{"issue":"7","key":"e_1_3_1_15_2","first-page":"278","article-title":"An innovative strategy for improved processing of small files in Hadoop","volume":"3","author":"Phakade Priyanka G.","year":"2014","unstructured":"Priyanka G. Phakade and Suhas Raut. 2014. An innovative strategy for improved processing of small files in Hadoop. International Journal of Application of Innovation in Engineering and Management 3, 7 (2014), 278\u2013280.","journal-title":"International Journal of Application of Innovation in Engineering and Management"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3075464"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2019.12.005"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2021.3100298"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2017.2651823"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2019.2961237"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-015-5499-z"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2010.12.009"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/2384616.2384634"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSST.2010.5496972"},{"key":"e_1_3_1_25_2","volume-title":"HBase: The Definitive Guide: Random Access to Your Planet-Size Data","author":"George Lars","year":"2011","unstructured":"Lars George. 2011. HBase: The Definitive Guide: Random Access to Your Planet-Size Data. O'Reilly Media."},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/1327452.1327492"},{"key":"e_1_3_1_27_2","unstructured":"Hive. 2021. Apache Hive. Retrieved April 19 2022 from https:\/\/hive.apache.org."},{"key":"e_1_3_1_28_2","unstructured":"Apache Nifi. 2021. Home Page. Retrieved April 19 2022 from https:\/\/nifi.apache.org."},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3073404"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISWCS49558.2021.9562173"},{"key":"e_1_3_1_31_2","volume-title":"Proceedings of the IEEE International Conference on Smart Internet of Things (SmartIoT\u201921)","author":"Kalogeras Georgios","unstructured":"Georgios Kalogeras, Christos Anagnostopoulos, Christos Alexakos, Athanasios Kalogeras, and Georgios Mylonas. 2021. Cyber Physical Systems for Smarter Society: a use case in the manufacturing sector. In Proceedings of the IEEE International Conference on Smart Internet of Things (SmartIoT\u201921)."},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/DSD53832.2021.00055"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/INDIN45523.2021.9557380"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/INDIN45523.2021.9557410"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/INDIN45523.2021.9557370"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-09237-4"}],"container-title":["ACM Transactions on Management Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3508395","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3508395","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:36Z","timestamp":1750182576000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3508395"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,31]]},"references-count":35,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12,31]]}},"alternative-id":["10.1145\/3508395"],"URL":"https:\/\/doi.org\/10.1145\/3508395","relation":{},"ISSN":["2158-656X","2158-6578"],"issn-type":[{"value":"2158-656X","type":"print"},{"value":"2158-6578","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,31]]},"assertion":[{"value":"2021-08-18","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-27","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-02-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}