{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T02:09:55Z","timestamp":1762999795122,"version":"3.41.0"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"9","license":[{"start":{"date-parts":[[2023,6,15]],"date-time":"2023-06-15T00:00:00Z","timestamp":1686787200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Samsung Electronics Co., Ltd."},{"name":"The Institute of Engineering Research and ICT at Seoul National University"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2023,11,30]]},"abstract":"<jats:p>How can we accurately identify new memory workloads while classifying known memory workloads? Verifying DRAM (Dynamic Random Access Memory) using various workloads is an important task to guarantee the quality of DRAM. A crucial component in the process is open-set recognition which aims to detect new workloads not seen in the training phase. Despite its importance, however, existing open-set recognition methods are unsatisfactory in terms of accuracy since they fail to exploit the characteristics of workload sequences.<\/jats:p>\n          <jats:p>\n            In this article, we propose\n            <jats:sc>Acorn<\/jats:sc>\n            , an accurate open-set recognition method capturing the characteristics of workload sequences.\n            <jats:sc>Acorn<\/jats:sc>\n            extracts two types of feature vectors to capture sequential patterns and spatial locality patterns in memory access.\n            <jats:sc>Acorn<\/jats:sc>\n            then uses the feature vectors to accurately classify a subsequence into one of the known classes or identify it as the unknown class. Experiments show that\n            <jats:sc>Acorn<\/jats:sc>\n            achieves state-of-the-art accuracy, giving up to 37% points higher unknown class detection accuracy while achieving comparable known class classification accuracy than existing methods.\n          <\/jats:p>","DOI":"10.1145\/3597027","type":"journal-article","created":{"date-parts":[[2023,5,15]],"date-time":"2023-05-15T12:03:09Z","timestamp":1684152189000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Accurate Open-Set Recognition for Memory Workload"],"prefix":"10.1145","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8328-3920","authenticated-orcid":false,"given":"Jun-Gi","family":"Jang","sequence":"first","affiliation":[{"name":"Seoul National University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-7544-9425","authenticated-orcid":false,"given":"Sooyeon","family":"Shim","sequence":"additional","affiliation":[{"name":"Seoul National University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-2770-3574","authenticated-orcid":false,"given":"Vladimir","family":"Egay","sequence":"additional","affiliation":[{"name":"Seoul National University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-5004-922X","authenticated-orcid":false,"given":"Jeeyong","family":"Lee","sequence":"additional","affiliation":[{"name":"Samsung Electronics"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-0389-6939","authenticated-orcid":false,"given":"Jongmin","family":"Park","sequence":"additional","affiliation":[{"name":"Samsung Electronics"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-4514-3271","authenticated-orcid":false,"given":"Suhyun","family":"Chae","sequence":"additional","affiliation":[{"name":"Samsung Electronics"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8774-6950","authenticated-orcid":false,"given":"U","family":"Kang","sequence":"additional","affiliation":[{"name":"Seoul National University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,6,15]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"2013. SDRAM STANDARD. (2013). Retrieved from https:\/\/www.jedec.org\/sites\/default\/files\/docs\/JESD79-4.pdf."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics9111777"},{"key":"e_1_3_2_4_2","first-page":"1563","volume-title":"CVPR","author":"Bendale Abhijit","year":"2016","unstructured":"Abhijit Bendale and Terrance E. Boult. 2016. Towards open set deep networks. In CVPR. IEEE Computer Society, 1563\u20131572."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2019.2927224"},{"key":"e_1_3_2_6_2","first-page":"154","volume-title":"SDM","author":"Hassen Mehadi","year":"2020","unstructured":"Mehadi Hassen and Philip K. Chan. 2020. Learning a neural-network-based representation for open set recognition. In SDM. SIAM, 154\u2013162."},{"key":"e_1_3_2_7_2","volume-title":"5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings","author":"Hendrycks Dan","year":"2017","unstructured":"Dan Hendrycks and Kevin Gimpel. 2017. A baseline for detecting misclassified and out-of-distribution examples in neural networks. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net."},{"key":"e_1_3_2_8_2","first-page":"1083","volume-title":"CIKM","author":"Jang Jun-Gi","year":"2018","unstructured":"Jun-Gi Jang, Dongjin Choi, Jinhong Jung, and U. Kang. 2018. Zoom-SVD: Fast and memory efficient method for extracting key patterns in an arbitrary time range. In CIKM. ACM, 1083\u20131092."},{"key":"e_1_3_2_9_2","first-page":"1850","volume-title":"ICDE","author":"Jang Jun-Gi","year":"2020","unstructured":"Jun-Gi Jang and U. Kang. 2020. D-tucker: Fast and memory-efficient tucker decomposition for dense tensors. In ICDE. IEEE, 1850\u20131853."},{"key":"e_1_3_2_10_2","volume-title":"Principal Component Analysis","author":"Jolliffe Ian","year":"2002","unstructured":"Ian Jolliffe. 2002. Principal Component Analysis. Wiley Online Library."},{"key":"e_1_3_2_11_2","first-page":"1362","volume-title":"KDD","author":"Lee Dongha","year":"2020","unstructured":"Dongha Lee, Sehun Yu, and Hwanjo Yu. 2020. Multi-class data description for out-of-distribution detection. In KDD. ACM, 1362\u20131370."},{"key":"e_1_3_2_12_2","first-page":"7167","volume-title":"NeurIPS 2018","author":"Lee Kimin","year":"2018","unstructured":"Kimin Lee, Kibok Lee, Honglak Lee, and Jinwoo Shin. 2018. A simple unified framework for detecting out-of-distribution samples and adversarial attacks. In NeurIPS 2018. 7167\u20137177."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2018.12.010"},{"key":"e_1_3_2_14_2","volume-title":"ICLR","author":"Liang Shiyu","year":"2018","unstructured":"Shiyu Liang, Yixuan Li, and R. Srikant. 2018. Enhancing the reliability of out-of-distribution image detection in neural networks. In ICLR. OpenReview.net."},{"key":"e_1_3_2_15_2","volume-title":"NeurIPS","author":"Liu Weitang","year":"2020","unstructured":"Weitang Liu, Xiaoyun Wang, John D. Owens, and Yixuan Li. 2020. Energy-based Out-of-distribution detection. In NeurIPS."},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2017.2647904"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1002\/eng2.12374"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39985-8_37"},{"key":"e_1_3_2_19_2","first-page":"2307","volume-title":"CVPR","author":"Oza Poojan","year":"2019","unstructured":"Poojan Oza and Vishal M. Patel. 2019. C2AE: Class conditioned auto-encoder for open-set recognition. In CVPR. Computer Vision Foundation, IEEE, 2307\u20132316."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.256"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0282595"},{"key":"e_1_3_2_22_2","first-page":"2911","volume-title":"EMNLP","author":"Shu Lei","year":"2017","unstructured":"Lei Shu, Hu Xu, and Bing Liu. 2017. DOC: Deep open classification of text documents. In EMNLP. Association for Computational Linguistics, 2911\u20132916."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2004.04.015"},{"key":"e_1_3_2_24_2","first-page":"13477","volume-title":"CVPR","author":"Sun Xin","year":"2020","unstructured":"Xin Sun, Zhenning Yang, Chi Zhang, Keck Voon Ling, and Guohao Peng. 2020. Conditional gaussian distribution learning for open set recognition. In CVPR. IEEE, 13477\u201313486."},{"key":"e_1_3_2_25_2","unstructured":"Yiyou Sun Chuan Guo and Yixuan Li. 2021. React: Out-of-distribution detection with rectified activations. Advances in Neural Information Processing Systems 34 (2021) 144\u2013157."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2005.11.007"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/0-306-47815-3_5"},{"key":"e_1_3_2_28_2","first-page":"2701","volume-title":"NeurIPS","author":"Yoo Jaemin","year":"2019","unstructured":"Jaemin Yoo, Minyong Cho, Taebum Kim, and U Kang. 2019. Knowledge extraction with no observable data. In NeurIPS. 2701\u20132710."},{"key":"e_1_3_2_29_2","first-page":"4178","volume-title":"IJCAI","author":"Yoo Jaemin","year":"2019","unstructured":"Jaemin Yoo, Hyunsik Jeon, and U. Kang. 2019. Belief propagation network for hard inductive semi-supervised learning. In IJCAI, Sarit Kraus (Ed.). ijcai.org, 4178\u20134184."},{"key":"e_1_3_2_30_2","first-page":"4016","volume-title":"CVPR","author":"Yoshihashi Ryota","year":"2019","unstructured":"Ryota Yoshihashi, Wen Shao, Rei Kawakami, Shaodi You, Makoto Iida, and Takeshi Naemura. 2019. Classification-reconstruction learning for open-set recognition. In CVPR. Computer Vision Foundation, IEEE, 4016\u20134025."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2018.07.052"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3528416.3530236"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3597027","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3597027","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:05Z","timestamp":1750182545000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3597027"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,15]]},"references-count":31,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2023,11,30]]}},"alternative-id":["10.1145\/3597027"],"URL":"https:\/\/doi.org\/10.1145\/3597027","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"type":"print","value":"1556-4681"},{"type":"electronic","value":"1556-472X"}],"subject":[],"published":{"date-parts":[[2023,6,15]]},"assertion":[{"value":"2022-04-02","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-06","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}