{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,20]],"date-time":"2026-10-20T16:26:03Z","timestamp":1792513563592,"version":"4.5.0"},"reference-count":96,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T00:00:00Z","timestamp":1787616000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T00:00:00Z","timestamp":1787616000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach. Intell. Res."],"published-print":{"date-parts":[[2026,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Recent advances in diffusion large language models (dLLMs) have introduced a promising alternative to autoregressive (AR) LLMs for natural language generation tasks, leveraging full attention and denoising-based decoding strategies. However, the deployment of these models on edge devices remains challenging due to their massive parameter scale and high resource demands. While post-training quantization (PTQ) has emerged as a widely adopted technique for compressing AR LLMs, its applicability to dLLMs remains largely unexplored. In this work, we present the first systematic study on quantizing diffusion-based language models. We begin by identifying the presence of activation outliers, characterized by abnormally large activation values that dominate the dynamic range. These outliers pose a key challenge to low-bit quantization, as they make it difficult to preserve precision for the majority of values. More importantly, we implement state-of-the-art PTQ methods and conduct a comprehensive evaluation across multiple task types and model variants. Our analysis is structured along four key dimensions: bit-width, quantization method, task category, and model type. Through this multi-perspective evaluation, we offer that practical insights into the quantization behavior of dLLMs under different configurations. We hope that our findings provide a foundation for future research in efficient dLLM deployment. Our code is publicly available at\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/MessiX77\/QDLM\" ext-link-type=\"uri\">https:\/\/github.com\/MessiX77\/QDLM<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1007\/s11633-025-1624-x","type":"journal-article","created":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T07:50:57Z","timestamp":1787644257000},"page":"1145-1161","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Quantization Meets dLLMs: A Systematic Study of Post-training Quantization for Diffusion LLMs"],"prefix":"10.1007","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-1084-7115","authenticated-orcid":false,"given":"Haokun","family":"Lin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haobo","family":"Xu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2859-3285","authenticated-orcid":false,"given":"Yichen","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziyu","family":"Guo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Renrui","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhichao","family":"Lu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying","family":"Wei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qingfu","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4029-9935","authenticated-orcid":false,"given":"Zhenan","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,8,25]]},"reference":[{"key":"1624_CR1","volume-title":"Proceedings of the 34th International Conference on Neural Information Processing Systems","author":"T B Brown","year":"2020","unstructured":"T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, D. Amodei. Language models are few-shot learners. In Proceedings of the 34th International Conference on Neural Information Processing Systems, Vancouver, Canada, Article number 159, 2020."},{"key":"1624_CR2","unstructured":"J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat, R. Avila, I. Babuschkin, S. Balaji, V. Balcom, P. Baltescu, H. Bao, M. Bavarian, J. Belgum, I. Bello, J. Berdine, G. Bernadett-Shapiro, C. Berner, L. Bogdonoff, O. Boiko, M. Boyd, Anna-L. Brakman, G. Brockman, T. Brooks, M. Brundage, K. Button, T. Cai, R. Campbell, A. Cann, B. Carey, C. Carlson, R. Carmichael, B. Chan, C. Chang, F. Chantzis, D. Chen, S. Chen, R. Chen, J. Chen, M. Chen, B. Chess, C. Cho, C. Chu, H. W. Chung, D. Cummings, J. Currier, Y. Dai, C. Decareaux, T. Degry, N. Deutsch, D. Deville, A. Dhar, D. Dohan, S. Dowling, S. Dunning, A. Ecoffet, A. Eleti, T. Eloundou, D. Farhi, L. Fedus, N. Felix, S. P. Fishman, J. Forte, I. Fulford, L. Gao, E. Georges, C. Gibson, V. Goel, T. Gogineni, G. Goh, R. Gontijo-Lopes, J. Gordon, M. Grafstein, S. Gray, R. Greene, J. Gross, S. S. Gu, Y. Guo, C. Hallacy, J. Han, J. Harris, Y. He, M. Heaton, J. Heidecke, C. Hesse, A. Hickey, W. Hickey, P. Hoeschele, B. Houghton, K. Hsu, S. Hu, X. Hu, J. Huizinga, S. Jain, S. J., J. Jang, A. Jiang, R. Jiang, H. Jin, D. Jin, S. Jomoto, B. Jonn, H. Jun, T. Kaftan, \u0141. Kaiser, A. Kamali, I. Kanitscheider, N. S. Keskar, T. Khan, L. Kilpatrick, J. W. Kim, C. Kim, Y. Kim, J. H. Kirchner, J. Kiros, M. Knight, D. Kokotajlo, \u0141. Kondraciuk, A. Kondrich, A. Konstantinidis, K. Kosic, G. Krueger, V. Kuo, M. Lampe, I. Lan, T. Lee, J. Leike, J. Leung, D. Levy, C. M. Li, R. Lim, M. Lin, S. Lin, M. Litwin, T. Lopez, R. Lowe, P. Lue, A. Makanju, K. Malfacini, S. Manning, T. Markov, Y. Markovski, B. Martin, K. Mayer, A. Mayne, B. McGrew, S. M. McKinney, C. McLeavey, P. McMillan, J. McNeil, D. Medina, A. Mehta, J. Menick, L. Metz, A. Mishchenko, P. Mishkin, V. Monaco, E. Morikawa, D. Mossing, T. Mu, M. Murati, O. Murk, D. M\u00e9ly, A. Nair, R. Nakano, R. Nayak, A. Neelakantan, R. Ngo, H. Noh, L. Ouyang, C. O\u2019Keefe, J. Pachocki, A. Paino, J. Palermo, A. Pantuliano, G. Parascandolo, J. Parish, E. Parparita, A. Passos, M. Pavlov, A. Peng, A. Perelman, F. de Avila Belbute Peres, M. Petrov, H. P. de Oliveira Pinto, M. Pokorny, M. Pokrass, V. H. Pong, T. Powell, A. Power, B. Power, E. Proehl, R. Puri, A. Radford, J. Rae, A. Ramesh, C. Raymond, F. Real, K. Rimbach, C. Ross, B. Rotsted, H. Roussez, N. Ryder, M. Saltarelli, T. Sanders, S. Santurkar, G. Sastry, H. Schmidt, D. Schnurr, J. Schulman, D. Selsam, K. Sheppard, T. Sherbakov, J. Shieh, S. Shoker, P. Shyam, S. Sidor, E. Sigler, M. Simens, J. Sitkin, K. Slama, I. Sohl, B. Sokolowsky, Y. Song, N. Staudacher, F. P. Such, N. Summers, I. Sutskever, J. Tang, N. Tezak, M. B. Thompson, P. Tillet, A. Tootoonchian, E. Tseng, P. Tuggle, N. Turley, J. Tworek, J. F. C. Uribe, A. Vallone, A. Vijayvergiya, C. Voss, C. Wainwright, J. J. Wang, A. Wang, B. Wang, J. Ward, J. Wei, CJ Weinmann, A. Welihinda, P. Welinder, J. Weng, L. Weng, M. Wiethoff, D. Willner, C. Winter, S. Wolrich, H. Wong, L. Workman, S. Wu, J. Wu, M. Wu, K. Xiao, T. Xu, S. Yoo, K. Yu, Q. Yuan, W. Zaremba, R. Zellers, C. Zhang, M. Zhang, S. Zhao, T. Zheng, J. Zhuang, W. Zhuk, B. Zoph. GPT-4 technical report, [Online], Available: https:\/\/arxiv.org\/abs\/2303.08774, 2023."},{"key":"1624_CR3","unstructured":"H. Touvron, T. Lavril, G. Izacard, X. Martinet, M. A. Lachaux, T. Lacroix, B. Rozi\u00e1re, N. Goyal, E. Hambro, F. Azhar, A. Rodriguez, A. Joulin, E. Grave, G. Lample. LLaMA: Open and efficient foundation language models, [Online], Available: https:\/\/arxiv.org\/abs\/2302.13971, 2023."},{"key":"1624_CR4","unstructured":"H. Touvron, L. Martin, K. Stone, P. Albert, A. Almahairi, Y. Babaei, N. Bashlykov, S. Batra, P. Bhargava, S. Bhosale, D. Bikel, L. Blecher, C. C. Ferrer, M. Chen, G. Cucurull, D. Esiobu, J. Fernandes, J. Fu, W. Fu, B. Fuller, C. Gao, V. Goswami, N. Goyal, A. Hartshorn, S. Hosseini, R. Hou, H. Inan, M. Kardas, V. Kerkez, M. Khabsa, I. Kloumann, A. Korenev, Punit S. Koura, M. A. Lachaux, T. Lavril, J. Lee, D. Liskovich, Y. Lu, Y. Mao, X. Martinet, T. Mihaylov, P. Mishra, I. Molybog, Y. Nie, A. Poulton, J. Reizenstein, R. Rungta, K. Saladi, A. Schelten, R. Silva, E. M. Smith, R. Subramanian, X. E. Tan, B. Tang, R. Taylor, A. Williams, J. X. Kuan, P. Xu, Z. Yan, I. Zarov, Y. Zhang, A. Fan, M. Kambadur, S. Narang, A. Rodriguez, R. Stojnic, S. Edunov, T. Scialom. Llama 2: Open foundation and fine-tuned chat models, [Online], Available: https:\/\/arxiv.org\/abs\/2307.09288, 2023."},{"key":"1624_CR5","unstructured":"A. Grattafiori, A. Dubey, A. Jauhri, A. Pandey, A. Kadian, A. Al-Dahle, A. Letman, A. Mathur, A. Schelten, A. Yang, A. Fan, A. Goyal, A. Hartshorn, A. Yang, A. Mitra, A. Sravankumar, A. Korenev, A. Hinsvark, A. Rao, A. Zhang, A. Rodriguez, A. Gregerson, A. Spataru, B. Roziere, B. Biron, B. Tang, B. Chern, C. Caucheteux, C. Nayak, C. Bi, C. Marra, C. McConnell, C. Keller, C. Touret, C. Wu, C. Wong, C. C. Ferrer, C. Nikolaidis, D. Allonsius, D. Song, D. Pintz, D. Livshits, D. Wyatt, D. Esiobu, D. Choudhary, D. Mahajan, D. Garcia-Olano, D. Perino, D. Hupkes, E. Lakomkin, E. AlBadawy, E. Lobanova, E. Dinan, E. M. Smith, F. Radenovic, F. Guzm\u00e1n, F. Zhang, G. Synnaeve, G. Lee, G. L. Anderson, G. Thattai, G. Nail, G. Mialon, G. Pang, G. Cucurell, H. Nguyen, H. Korevaar, Hu Xu, H. Touvron, I. Zarov, I. A. Ibarra, I. Kloumann, I. Misra, I. Evtimov, J. Zhang, J. Copet, J. Lee, J. Geffert, J. Vranes, J. Park, J. Mahadeokar, J. Shah, J. van der Linde, J. Billock, J. Hong, J. Lee, J. Fu, J. Chi, J. Huang, J. Liu, J. Wang, J. Yu, J. Bitton, J. Spisak, J. Park, J. Rocca, J. Johnstun, J. Saxe, J. Jia, K. V. Alwala, K. Prasad, K. Upasani, K. Plawiak, K. Li, K. Heafield, K. Stone, K. El-Arini, K. Iyer, K. Malik, K. Chiu, K. Bhalla, K. Lakhotia, L. Rantala-Yeary, L. van der Maaten, L. Chen, L. Tan, L. Jenkins, L. Martin, L. Madaan, L. Malo, L. Blecher, L. Landzaat, L. de Oliveira, M. Muzzi, M. Pasupuleti, M. Singh, M. Paluri, M. Kardas, M. Tsimpoukelli, M. Oldham, M. Rita, M. Pavlova, M. Kambadur, M. Lewis, M. Si, M. K. Singh, M. Hassan, N. Goyal, N. Torabi, N. Bashlykov, N. Bogoychev, N. Chatterji, N. Zhang, O. Duchenne, O. \u010celebi, P. Alrassy, P. Zhang, P. Li, P. Vasic, P. Weng, P. Bhargava, P. Dubal, P. Krishnan, P. S. Koura, P. Xu, Q. He, Q. Dong, R. Srinivasan, R. Ganapathy, R. Calderer, R. S. Cabral, R. Stojnic, R. Raileanu, R. Maheswari, R. Girdhar, R. Patel, R. Sauvestre, R. Polidoro, R. Sumbaly, R. Taylor, R. Silva, R. Hou, R. Wang, S. Hosseini, S. Chennabasappa, S. Singh, S. Bell, S. S. Kim, S. Edunov, S. Nie, S. Narang, S. Raparthy, S. Shen, S. Wan, S. Bhosale, S. Zhang, S. Vandenhende, S. Batra, S. Whitman, S. Sootla, S. Collot, S. Gururangan, S. Borodinsky, T. Herman, T. Fowler, T. Sheasha, T. Georgiou, T. Scialom, T. Speckbacher, T. Mihaylov, T. Xiao, U. Karn, V. Goswami, V. Gupta, V. Ramanathan, V. Kerkez, V. Gonguet, V. Do, V. Vogeti, V. Albiero, V. Petrovic, W. Chu, W. Xiong, W. Fu, W. Meers, X. Martinet, X. Wang, X. Wang, X. E. Tan, X. Xia, X. Xie, X. Jia, X. Wang, Y. Goldschlag, Y. Gaur, Y. Babaei, Y. Wen, Y. Song, Y. Zhang, Y. Li, Y. Mao, Z. D. Coudert, Z. Yan, Z. Chen, Z. Papakipos, A. Singh, A. Srivastava, A. Jain, A. Kelsey, A. Shajnfeld, A. Gangidi, A. Victoria, A. Goldstand, A. Menon, A. Sharma, A. Boesenberg, A. Baevski, A. Feinstein, A. Kallet, A. Sangani, A. Teo, A. Yunus, A. Lupu, A. Alvarado, A. Caples, A. Gu, A. Ho, A. Poulton, A. Ryan, A. Ramchandani, A. Dong, A. Franco, A. Goyal, A. Saraf, A. Chowdhury, A. Gabriel, A. Bharambe, A. Eisenman, A. Yazdan, B. James, B. Maurer, B. Leonhardi, B. Huang, B. Loyd, B. De Paola, B. Paranjape, B. Liu, Bo Wu, B. Ni, B. Hancock, B. Wasti, B. Spence, B. Stojkovic, B. Gamido, B. Montalvo, C. Parker, C. Burton, C. Mejia, C. Liu, C. Wang, C. Kim, C. Zhou, C. Hu, C. H. Chu, C. Cai, C. Tindal, C. Feichtenhofer, C. Gao, D. Civin, D. Beaty, D. Kreymer, D. Li, D. Adkins, D. Xu, D. Testuggine, D. David, D. Parikh, D. Liskovich, D. Foss, D. Wang, D. Le, D. Holland, E. Dowling, E. Jamil, E. Montgomery, E. Presani, E. Hahn, E. Wood, E. T. Le, E. Brinkman, E. Arcaute, E. Dunbar, E. Smothers, F. Sun, F. Kreuk, F. Tian, F. Kokkinos, F. Ozgenel, F. Caggioni, F. Kanayet, F. Seide, G. M. Florez, G. Schwarz, G. Badeer, G. Swee, G. Halpern, G. Herman, G. Sizov, G. Zhang, G. Lakshminarayanan, H. Inan, H. Shojanazeri, H. Zou, H. Wang, H. Zha, H. Habeeb, H. Rudolph, H. Suk, H. Aspegren, H. Goldman, H. Zhan, I. Damlaj, I. Molybog, I. Tufanov, I. Leontiadis, I. E. Veliche, I. Gat, J. Weissman, J. Geboski, J. Kohli, J. Lam, J. Asher, J. B. Gaya, J. Marcus, J. Tang, J. Chan, J. Zhen, J. Reizenstein, J. Teboul, J. Zhong, J. Jin, J. Yang, J. Cummings, J. Carvill, J. Shepard, J. McPhie, J. Torres, J. Ginsburg, J. Wang, K. Wu, K. H. U, K. Saxena, K. Khandelwal, K. Zand, K. Matosich, K. Veeraraghavan, K. Michelena, K. Li, K. Jagadeesh, K. Huang, K. Chawla, K. Huang, L. Chen, L. Garg, L. A, L. Silva, L. Bell, L. Zhang, L. Guo, L. Yu, L. Moshkovich, L. Wehrstedt, M. Khabsa, M. Avalani, M. Bhatt, M. Mankus, M. Hasson, M. Lennie, M. Reso, M. Groshev, M. Naumov, M. Lathi, M. Keneally, M. Liu, M. L. Seltzer, M. Valko, M. Restrepo, M. Patel, M. Vyatskov, M. Samvelyan, M. Clark, M. Macey, M. Wang, M. J. Hermoso, M. Metanat, M. Rastegari, M. Bansal, N. Santhanam, N. Parks, N. White, N. Bawa, N. Singhal, N. Egebo, N. Usunier, N. Mehta, N. P. Laptev, N. Dong, N. Cheng, O. Chernoguz, O. Hart, O. Salpekar, O. Kalinli, P. Kent, P. Parekh, P. Saab, P. Balaji, P. Rittner, P. Bontrager, P. Roux, P. Dollar, P. Zvyagina, P. Ratanchandani, P. Yuvraj, Q. Liang, R. Alao, R. Rodriguez, R. Ayub, R. Murthy, R. Nayani, R. Mitra, R. Parthasarathy, R. Li, R. Hogan, R. Battey, R. Wang, R. Howes, R. Rinott, S. Mehta, S. Siby, S. J. Bondu, S. Datta, S. Chugh, S. Hunt, S. Dhillon, S. Sidorov, S. Pan, S. Mahajan, S. Verma, S. Yamamoto, S. Ramaswamy, S. Lindsay, S. Lindsay, S. Feng, S. Lin, S. C. Zha, S. Patil, S. Shankar, S. Zhang, S. Zhang, S. Wang, S. Agarwal, S. Sajuyigbe, S. Chintala, S. Max, S. Chen, S. Kehoe, S. Satterfield, S. Govindaprasad, S. Gupta, S. Deng, S. Cho, S. Virk, S. Subramanian, S. Choudhury, S. Goldman, T. Remez, T. Glaser, T. Best, T. Koehler, T. Robinson, T. Li, T. Zhang, T. Matthews, T. Chou, T. Shaked, V. Vontimitta, V. Ajayi, V. Montanez, V. Mohan, V. S. Kumar, V. Mangla, V. Ionescu, V. Poenaru, V. T. Mihailescu, V. Ivanov, W. Li, W. Wang, W. Jiang, W. Bouaziz, W. Constable, X. Tang, X. Wu, X. Wang, X. Wu, X. Gao, Y. Kleinman, Y. Chen, Y. Hu, Y. Jia, Y. Qi, Y. Li, Y. Zhang, Y. Zhang, Y. Adi, Y. Nam, Y. Wang, Y. Zhao, Y. Hao, Y. Qian, Y. Li, Y. He, Z. Rait, Z. DeVito, Z. Rosnbrick, Z. Wen, Z. Yang, Z. Zhao, Z. Ma. The Llama 3 herd of models, [Online], Available: https:\/\/arxiv.org\/abs\/2407.21783, 2024."},{"key":"1624_CR6","unstructured":"J. Bai, S. Bai, Y. Chu, Z. Cui, K. Dang, X. Deng, Y. Fan, W. Ge, Y. Han, F. Huang, B. Hui, L. Ji, M. Li, J. Lin, R. Lin, D. Liu, G. Liu, C. Lu, K. Lu, J. Ma, R. Men, X. Ren, X. Ren, C. Tan, S. Tan, J. Tu, P. Wang, S. Wang, W. Wang, S. Wu, B. Xu, J. Xu, A. Yang, H. Yang, J. Yang, S. Yang, Y. Yao, B. Yu, H. Yuan, Z. Yuan, J. Zhang, X. Zhang, Y. Zhang, Z. Zhang, C. Zhou, J. Zhou, X. Zhou, T. Zhu. Qwen technical report, [Online], Available: https:\/\/arxiv.org\/abs\/2309.16609, 2023."},{"key":"1624_CR7","unstructured":"A. Yang, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Li, D. Liu, F. Huang, H. Wei, H. Lin, J. Yang, J. Tu, J. Zhang, J. Yang, J. Yang, J. Zhou, J. Lin, K. Dang, K. Lu, K. Bao, K. Yang, L. Yu, M. Li, M. Xue, P. Zhang, Q. Zhu, R. Men, R. Lin, T. Li, T. Tang, T. Xia, X. Ren, X. Ren, Y. Fan, Y. Su, Y. Zhang, Y. Wan, Y. Liu, Z. Cui, Z. Zhang, Z. Qiu. Qwen2.5 technical report, [Online], Available: https:\/\/arxiv.org\/abs\/2412.15115, 2025."},{"key":"1624_CR8","unstructured":"A. Yang, A. Li, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Gao, C. Huang, C. Lv, C. Zheng, D. Liu, F. Zhou, F. Huang, F. Hu, H. Ge, H. Wei, H. Lin, J. Tang, J. Yang, J. Tu, J. Zhang, J. Yang, J. Yang, J. Zhou, J. Zhou, J. Lin, K. Dang, K. Bao, K. Yang, L. Yu, L. Deng, M. Li, M. Xue, M. Li, P. Zhang, P. Wang, Q. Zhu, R. Men, R. Gao, S. Liu, S. Luo, T. Li, T. Tang, W. Yin, X. Ren, X. Wang, X. Zhang, X. Ren, Y. Fan, Y. Su, Y. Zhang, Y. Zhang, Y. Wan, Y. Liu, Z. Wang, Z. Cui, Z. Zhang, Z. Zhou, Z. Qiu. Qwen3 technical report, [Online], Available: https:\/\/arxiv.org\/abs\/2505.09388, 2025."},{"key":"1624_CR9","doi-asserted-by":"crossref","unstructured":"S. Nie, F. Zhu, Z. You, X. Zhang, J. Ou, J. Hu, J. Zhou, Y. Lin, J. R. Wen, C. Li. Large language diffusion models, [Online], Available: https:\/\/arxiv.org\/abs\/2502.09992, 2025.","DOI":"10.52202\/085713-1689"},{"key":"1624_CR10","doi-asserted-by":"crossref","unstructured":"F. Zhu, R. Wang, S. Nie, X. Zhang, C. Wu, J. Hu, J. Zhou, J. Chen, Y. Lin, J. R. Wen, C. Li. LlaDA 1.5: Variance-reduced preference optimization for large language diffusion models, [Online], Available: https:\/\/arxiv.org\/abs\/2505.19223, 2025.","DOI":"10.18653\/v1\/2026.acl-long.524"},{"key":"1624_CR11","unstructured":"J. Ye, Z. Xie, L. Zheng, J. Gao, Z. Wu, X. Jiang, Z. Li, L. Kong. Dream 7B, [Online], Available: https:\/\/hkunlp.github.io\/blog\/2025\/dream, 2025."},{"key":"1624_CR12","volume-title":"Proceedings of the 13th International Conference on Learning Representations","author":"S Gong","year":"2025","unstructured":"S. Gong, S. Agarwal, Y. Zhang, J. Ye, L. Zheng, M. Li, C. An, P. Zhao, W. Bi, J. Han, H. Peng, L. Kong. Scaling diffusion language models via adaptation from autoregressive models. In Proceedings of the 13th International Conference on Learning Representations, Singapore, 2025."},{"key":"1624_CR13","unstructured":"Y. Song, Z. Zhang, C. Luo, P. Gao, F. Xia, H. Luo, Z. Li, Y. Yang, H. Yu, X. Qu, Y. Fu, J. Su, G. Zhang, W. Huang, M. Wang, L. Yan, X. Jia, J. Liu, W. Y. Ma, Y. Q. Zhang, Y. Wu, H. Zhou. Seed diffusion: A large-scale diffusion language model with high-speed inference, [Online], Available: https:\/\/arxiv.org\/abs\/2508.02193, 2025."},{"key":"1624_CR14","unstructured":"T. Li, M. Chen, B. Guo, Z. Shen. A survey on diffusion language models, [Online], Available: https:\/\/arxiv.org\/abs\/2508.10875, 2025."},{"key":"1624_CR15","unstructured":"R. Yu, Q. Li, X. Wang. Discrete diffusion in large language and multimodal models: A survey, [Online], Available: https:\/\/arxiv.org\/abs\/2506.13759, 2025."},{"key":"1624_CR16","unstructured":"C. Wu, H. Zhang, S. Xue, Z. Liu, S. Diao, L. Zhu, P. Luo, S. Han, E. Xie. Fast-dLLM: Training-free acceleration of diffusion LLM by enabling KV cache and parallel decoding, [Online], Available: https:\/\/arxiv.org\/abs\/2505.22618, 2025."},{"key":"1624_CR17","doi-asserted-by":"crossref","unstructured":"X. Ma, R. Yu, G. Fang, X. Wang. dKV-cache: The cache for diffusion language models, [Online], Available: https:\/\/arxiv.org\/abs\/2505.15781, 2025.","DOI":"10.52202\/085713-4984"},{"key":"1624_CR18","unstructured":"Z. Liu, Y. Yang, Y. Zhang, J. Chen, C. Zou, Q. Wei, S. Wang, L. Zhang. dLLM-cache: Accelerating diffusion large language models with adaptive caching, [Online], Available: https:\/\/arxiv.org\/abs\/2506.06295, 2025."},{"key":"1624_CR19","unstructured":"X. Wang, C. Xu, Y. Jin, J. Jin, H. Zhang, Z. Deng. Diffusion LLMs can do faster-than-AR inference via discrete diffusion forcing, [Online], Available: https:\/\/arxiv.org\/abs\/2508.09192, 2025."},{"key":"1624_CR20","volume-title":"Proceedings of the 41st International Conference on Machine Learning","author":"S Li","year":"2024","unstructured":"S. Li, X. Ning, L. Wang, T. Liu, X. Shi, S. Yan, G. Dai, H. Yang, Y. Wang. Evaluating quantized large language models. In Proceedings of the 41st International Conference on Machine Learning, Vienna, Austria, 2024."},{"key":"1624_CR21","unstructured":"R. Liu, Y. Sun, M. Zhang, H. Bai, X. Yu, T. Yu, C. Yuan, L. Hou. Quantization hurts reasoning? An empirical study on quantized reasoning models, [Online], Available: https:\/\/arxiv.org\/abs\/2504.04823, 2025."},{"key":"1624_CR22","volume-title":"Proceedings of the 42nd International Conference on Machine Learning","author":"Q Wei","year":"2025","unstructured":"Q. Wei, C. Y. Yau, H. T. Wai, Y. Zhao, D. Kang, Y. Park, M. Hong. RoSTE: An efficient quantization-aware supervised fine-tuning approach for large language models. In Proceedings of the 42nd International Conference on Machine Learning, Vancouver, Canada, 2025."},{"key":"1624_CR23","volume-title":"Proceedings of the 37th International Conference on Neural Information Processing Systems","author":"J Chee","year":"2024","unstructured":"J. Chee, Y. Cai, V. Kuleshov, C. De Sa. QuIP: 2-bit quantization of large language models with guarantees. In Proceedings of the 37th International Conference on Neural Information Processing Systems, New Orleans, USA, Article number 196, 2024."},{"key":"1624_CR24","doi-asserted-by":"publisher","first-page":"3355","DOI":"10.18653\/v1\/2024.emnlp-main.197","volume-title":"Proceedings of Conference on Empirical Methods in Natural Language Processing","author":"S Ashkboos","year":"2024","unstructured":"S. Ashkboos, I. Markov, E. Frantar, T. Zhong, X. Wang, J. Ren, T. Hoefler, D. Alistarh. OUIK: Towards end-to-end 4-bit inference on generative large language models. In Proceedings of Conference on Empirical Methods in Natural Language Processing, Miami, USA, pp. 3355\u20133371, 2024. DOI: https:\/\/doi.org\/10.18653\/v1\/2024.emnlp-main.197."},{"key":"1624_CR25","volume-title":"Proceedings of the 41st International Conference on Machine Learning","author":"A Tseng","year":"2024","unstructured":"A. Tseng, J. Chee, Q. Sun, V. Kuleshov, C. De Sa. QuIP#: Even better LLM quantization with Hadamard incoherence and lattice codebooks. In Proceedings of the 41st International Conference on Machine Learning, Vienna, Austria, 2024."},{"key":"1624_CR26","volume-title":"Proceedings of the 7th Annual Conference on Machine Learning and Systems","author":"Y Zhao","year":"2024","unstructured":"Y. Zhao, C. Y. Lin, K. Zhu, Z. Ye, L. Chen, S. Zheng, L. Ceze, A. Krishnamurthy, T. Chen, B. Kasikci. Atom: Low-bit quantization for efficient and accurate LLM serving. In Proceedings of the 7th Annual Conference on Machine Learning and Systems, Santa Clara, USA, 2024."},{"key":"1624_CR27","volume-title":"Proceedings of the 36th International Conference on Neural Information Processing Systems","author":"T Dettmers","year":"2022","unstructured":"T. Dettmers, M. Lewis, Y. Belkada, L. Zettlemoyer. LLM. int8(): 8-bit matrix multiplication for transformers at scale. In Proceedings of the 36th International Conference on Neural Information Processing Systems, New Orleans, USA, Article number 2198, 2022."},{"key":"1624_CR28","volume-title":"Proceedings of the 40th International Conference on Machine Learning","author":"G Xiao","year":"2023","unstructured":"G. Xiao, J. Lin, M. Seznec, H. Wu, J. Demouth, S. Han. SmoothQuant: Accurate and efficient post-training quantization for large language models. In Proceedings of the 40th International Conference on Machine Learning, Honolulu, USA, Article number 1585, 2023."},{"key":"1624_CR29","unstructured":"M. Sun, X. Chen, J. Z. Kolter, Z. Liu. Massive activations in large language models, [Online], Available: https:\/\/arxiv.org\/abs\/2402.17762, 2024."},{"issue":"4","key":"1624_CR30","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1145\/3714983.3714987","volume":"28","author":"J Lin","year":"2024","unstructured":"J. Lin, J. Tang, H. Tang, S. Yang, X. Dang, S. Han. AWQ: Activation-aware weight quantization for ondevice LLM compression and acceleration. GetMobile: Mobile Computing and Communications, vol. 28, no. 4, pp. 12\u201317, 2024. DOI: https:\/\/doi.org\/10.1145\/3714983.3714987.","journal-title":"GetMobile: Mobile Computing and Communications"},{"key":"1624_CR31","unstructured":"E. Frantar, S. Ashkboos, T. Hoefler, D. Alistarh. GPTQ: Accurate post-training quantization for generative pretrained transformers, [Online], Available: https:\/\/arxiv.org\/abs\/2210.17323, 2022."},{"key":"1624_CR32","volume-title":"Proceedings of the 38th International Conference on Neural Information Processing Systems","author":"S Ashkboos","year":"2024","unstructured":"S. Ashkboos, A. Mohtashami, M. L. Croci, B. Li, P. Cameron, M. Jaggi, D. Alistarh, T. Hoefler, J. Hensman. QuaRot: Outlier-free 4-bit inference in rotated LLMs. In Proceedings of the 38th International Conference on Neural Information Processing Systems, Vancouver, Canada, Article number 3180, 2024."},{"key":"1624_CR33","volume-title":"Proceedings of the 38th International Conference on Neural Information Processing System","author":"H Lin","year":"2024","unstructured":"H. Lin, H. Xu, Y. Wu, J. Cui, Y. Zhang, L. Mou, L. Song, Z. Sun, Y. Wei. DuQuant: Distributing outliers via dual transformation makes stronger quantized LLMs. In Proceedings of the 38th International Conference on Neural Information Processing System, Vancouver, Canada, Article number 2786, 2024."},{"issue":"3","key":"1624_CR34","doi-asserted-by":"publisher","first-page":"466","DOI":"10.1007\/s11633-023-1487-8","volume":"22","author":"H Liu","year":"2025","unstructured":"H. Liu, Y. Wang, M. Ren, J. Hu, Z. Luo, G. Hou, Z. Sun. Balanced representation learning for long-tailed skeleton-based action recognition. Machine Intelligence Research, vol. 22, no. 3, pp. 466\u2013483, 2025. DOI: https:\/\/doi.org\/10.1007\/s11633-023-1487-8.","journal-title":"Machine Intelligence Research"},{"issue":"5","key":"1624_CR35","doi-asserted-by":"publisher","first-page":"969","DOI":"10.1007\/s11633-024-1528-y","volume":"22","author":"Z Ju","year":"2025","unstructured":"Z. Ju, W. Zhou, L. Kong, Y. Chen, Y. Li, Z. Sun, C. Shan. HAGAN: Hybrid augmented generative adversarial network for medical image synthesis. Machine Intelligence Research, vol. 22, no. 5, pp. 969\u2013982, 2025. DOI: https:\/\/doi.org\/10.1007\/s11633-024-1528-y.","journal-title":"Machine Intelligence Research"},{"issue":"1","key":"1624_CR36","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1007\/s11633-023-1415-y","volume":"21","author":"Z Yan","year":"2024","unstructured":"Z. Yan, Y. Wang, K. Zhang, Z. Sun, L. He. Boosting multi-modal ocular recognition via spatial feature reconstruction and unsupervised image quality estimation. Machine Intelligence Research, vol. 21, no. 1, pp. 197\u2013214, 2024. DOI: https:\/\/doi.org\/10.1007\/s11633-023-1415-y.","journal-title":"Machine Intelligence Research"},{"issue":"5","key":"1624_CR37","doi-asserted-by":"publisher","first-page":"941","DOI":"10.1007\/s11633-023-1433-9","volume":"21","author":"Y Liu","year":"2024","unstructured":"Y. Liu, Q. Li, Z. Sun. One-shot face reenactment with dense correspondence estimation. Machine Intelligence Research, vol. 21, no. 5, pp. 941\u2013953, 2024. DOI: https:\/\/doi.org\/10.1007\/s11633-023-1433-9.","journal-title":"Machine Intelligence Research"},{"key":"1624_CR38","doi-asserted-by":"crossref","unstructured":"H. Peng, J. Jiang, Z. Dong, W. X. Zhao, L. Fang. CAFE: Retrieval head-based coarse-to-fine information seeking to enhance multi-document QA capability, [Online], Available: https:\/\/arxiv.org\/abs\/2505.10063, 2025.","DOI":"10.18653\/v1\/2025.emnlp-main.655"},{"key":"1624_CR39","volume-title":"Proceedings of the 41st International Conference on Machine Learning","author":"Z Zeng","year":"2024","unstructured":"Z. Zeng, R. Qiu, Z. Xu, Z. Liu, Y. Yan, T. Wei, L. Ying, J. He, H. Tong. Graph mixup on approximate Gromov-Wasserstein geodesics. In Proceedings of the 41st International Conference on Machine Learning, Vienna, Austria, Article number 2409, 2024."},{"key":"1624_CR40","unstructured":"Z. Zeng, R. Qiu, W. Bao, T. Wei, X. Lin, Y. Yan, T. F. Abdelzaher, J. Han, H. Tong. Pave your own path: Graph gradual domain adaptation on fused Gromov-Wasserstein geodesics, [Online], Available: https:\/\/arxiv.org\/abs\/2505.12709, 2025."},{"key":"1624_CR41","first-page":"3596","volume-title":"Proceedings of IEEE\/CVF International Conference on Computer Vision","author":"Y Zhou","year":"2025","unstructured":"Y. Zhou, Y. Chen, H. Lin, Y. Wu, S. Yang, Z. Qi, C. Ma, L. Zhu. DOGR: Towards versatile visual document grounding and referring. In Proceedings of IEEE\/CVF International Conference on Computer Vision, Hawaii, USA, pp. 3596\u20133606, 2025."},{"key":"1624_CR42","doi-asserted-by":"publisher","first-page":"7510","DOI":"10.1109\/TMM.2025.3599088","volume":"27","author":"Y Zhou","year":"2025","unstructured":"Y. Zhou, Y. Wang, H. Lin, C. Ma, L. Zhu, Z. Zheng. Scale up composed image retrieval learning via modification text generation. IEEE Transactions on Multimedia, vol. 27, pp. 7510\u20137521, 2025. DOI: https:\/\/doi.org\/10.1109\/TMM.2025.3599088.","journal-title":"IEEE Transactions on Multimedia"},{"key":"1624_CR43","unstructured":"S. Xia, H. Lin, Y. Wu, Y. Zhou, Z. Li, Z. Wan, X. Xing, Y. Zheng, X. Li, C. Shan, Z. Sun, Q. Li. MedREK: Retrieval-based editing for medical LLMs with key-aware prompts, [Online], Available: https:\/\/arxiv.org\/abs\/2510.13500, 2025."},{"key":"1624_CR44","unstructured":"Z. Wang, Y. Wu, R. Wang, H. Lin, Q. Wang, Q. Zhao, D. Meng. Singular value fine-tuning for few-shot class-incremental learning, [Online], Available: https:\/\/arxiv.org\/abs\/2503.10214, 2025."},{"key":"1624_CR45","volume-title":"Proceedings of the 13th International Conference on Learning Representations","author":"Y Jiang","year":"2025","unstructured":"Y. Jiang, H. Lin, Y. Bai, B. Peng, Z. Liu, Y. Lyu, Y. Yang, X. Zheng, J. Dong. Image-level memorization detection via inversion-based inference perturbation. In Proceedings of the 13th International Conference on Learning Representations, Singapore, 2025."},{"key":"1624_CR46","volume-title":"Proceedings of the 13th International Conference on Learning Representations","author":"T Zhao","year":"2025","unstructured":"T. Zhao, T. Fang, H. Huang, R. Wan, W. Soedarmadji, E. Liu, S. Li, Z. Lin, G. Dai, S. Yan, H. Yang, X. Ning, Y. Wang. ViDiT-Q: Efficient and accurate quantization of diffusion transformers for image and video generation. In Proceedings of the 13th International Conference on Learning Representations, Singapore, 2025."},{"issue":"4","key":"1624_CR47","doi-asserted-by":"publisher","first-page":"752","DOI":"10.1007\/s11633-024-1511-7","volume":"22","author":"Y Jiang","year":"2025","unstructured":"Y. Jiang, Y. Lyu, B. Peng, W. Wang, J. Dong. CMSL: Cross-modal style learning for few-shot image generation. Machine Intelligence Research, vol. 22, no. 4, pp. 752\u2013768, 2025. DOI: https:\/\/doi.org\/10.1007\/s11633-024-1511-7.","journal-title":"Machine Intelligence Research"},{"key":"1624_CR48","doi-asserted-by":"publisher","first-page":"4521","DOI":"10.18653\/v1\/2023.acl-long.248","volume-title":"Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics","author":"Z He","year":"2022","unstructured":"Z. He, T. Sun, Q. Tang, K. Wang, X. Huang, X. Qiu. DiffusionBERT: Improving generative masked language models with diffusion models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, Toronto, Canada, pp. 4521\u20134534, 2022. DOI: https:\/\/doi.org\/10.18653\/v1\/2023.acl-long.248."},{"key":"1624_CR49","doi-asserted-by":"publisher","first-page":"4171","DOI":"10.18653\/v1\/N19-1423","volume-title":"Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"J Devlin","year":"2019","unstructured":"J. Devlin, M. W. Chang, K. Lee, K. Toutanova. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, USA, pp. 4171\u20134186, 2019. DOI: https:\/\/doi.org\/10.18653\/v1\/N19-1423."},{"key":"1624_CR50","volume-title":"Proceedings of the 35th International Conference on Neural Information Processing Systems","author":"J Austin","year":"2021","unstructured":"J. Austin, D. D. Johnson, J. Ho, D. Tarlow, R. van der Berg. Structured denoising diffusion models in discrete state-spaces. In Proceedings of the 35th International Conference on Neural Information Processing Systems, Article number 1376, 2021."},{"key":"1624_CR51","volume-title":"Proceedings of the 41st International Conference on Machine Learning","author":"A Lou","year":"2024","unstructured":"A. Lou, C. Meng, S. Ermon. Discrete diffusion modeling by estimating the ratios of the data distribution. In Proceedings of the 41st International Conference on Machine Learning, Vienna, Austria, 2024."},{"key":"1624_CR52","volume-title":"Proceedings of the 13th International Conference on Learning Representations","author":"J Ou","year":"2025","unstructured":"J. Ou, S. Nie, K. Xue, F. Zhu, J. Sun, Z. Li, C. Li. Your absorbing discrete diffusion secretly models the conditional distributions of clean data. In Proceedings of the 13th International Conference on Learning Representations, Singapore, 2025."},{"key":"1624_CR53","volume-title":"Proceedings of the 38th International Conference on Neural Information Processing Systems","author":"J Shi","year":"2024","unstructured":"J. Shi, K. Han, Z. Wang, A. Doucet, M. K. Titsias. Simplified and generalized masked diffusion for discrete data. In Proceedings of the 38th International Conference on Neural Information Processing Systems, Vancouver, Canada, Article number 3277, 2024."},{"key":"1624_CR54","doi-asserted-by":"crossref","unstructured":"L. Yang, Y. Tian, B. Li, X. Zhang, K. Shen, Y. Tong, M. Wang. MMaDA: Multimodal large diffusion language models, [Online], Available: https:\/\/arxiv.org\/abs\/2505.15809, 2025.","DOI":"10.52202\/085713-4636"},{"key":"1624_CR55","doi-asserted-by":"publisher","first-page":"27370","DOI":"10.1109\/CVPR52733.2024.02584","volume-title":"Proceedings of IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"H Lin","year":"2024","unstructured":"H. Lin, H. Bai, Z. Liu, L. Hou, M. Sun, L. Song, Y. Wei, Z. Sun. MoPE-CLIP: Structured pruning for efficient vision-language models with module-wise pruning error metric. In Proceedings of IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, USA, pp. 27370\u201327380, 2024. DOI: https:\/\/doi.org\/10.1109\/CVPR52733.2024.02584."},{"key":"1624_CR56","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"Y Zhang","year":"2024","unstructured":"Y. Zhang, H. Bai, H. Lin, J. Zhao, L. Hou, C. V. Cannistraci. Plug-and-play: An efficient post-training pruning method for large language models. In Proceedings of the 12th International Conference on Learning Representations, Vienna, Austria, 2024."},{"key":"1624_CR57","unstructured":"X. Xing, Z. Liu, S. Xiao, B. Gao, Y. Liang, W. Zhang, H. Lin, G. Li, J. Zhang. EfficientLLM: Scalable pruning-aware pretraining for architecture-agnostic edge language models, [Online], Available: https:\/\/arxiv.org\/abs\/2502.06663, 2025."},{"key":"1624_CR58","doi-asserted-by":"publisher","first-page":"29836","DOI":"10.1109\/CVPR52734.2025.02777","volume-title":"Proceedings of IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"X Ye","year":"2025","unstructured":"X. Ye, Y. Gan, X. Huang, Y. Ge, Y. Tang. VoCoLLaMA: Towards vision compression with large language models. In Proceedings of IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, USA, pp. 29836\u201329846, 2025. DOI: https:\/\/doi.org\/10.1109\/CVPR52734.2025.02777."},{"key":"1624_CR59","doi-asserted-by":"publisher","first-page":"24972","DOI":"10.1109\/CVPR52734.2025.02325","volume-title":"Proceedings of IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"X Ye","year":"2025","unstructured":"X. Ye, Y. Gan, Y. Ge, X. P. Zhang, Y. Tang. ATP-LLaVA: Adaptive token pruning for large vision language models. In Proceedings of IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, USA, pp. 24972\u201324982, 2025. DOI: https:\/\/doi.org\/10.1109\/CVPR52734.2025.02325."},{"key":"1624_CR60","doi-asserted-by":"crossref","unstructured":"W. Wu, Y. Zhang, J. Zhao, C. V. Cannistraci. Alignment-enhanced integration of connectivity and spectral sparsity in dynamic sparse training of LLM, [Online], Available: https:\/\/openreview.net\/forum?id=jZplmg7Ad9, 2025.","DOI":"10.20944\/preprints202510.2334.v1"},{"key":"1624_CR61","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1007\/978-3-031-72630-9_17","volume-title":"Proceedings of the 18th European Conference on Computer Vision","author":"T Zhao","year":"2025","unstructured":"T. Zhao, X. Ning, T. Fang, E. Liu, G. Huang, Z. Lin, S. Yan, G. Dai, Y. Wang. MixDQ: Memory-efficient few-step text-to-image diffusion models with metric-decoupled mixed precision quantization. In Proceedings of the 18th European Conference on Computer Vision, Milan, Italy, pp. 285\u2013302, 2025. DOI: https:\/\/doi.org\/10.1007\/978-3-031-72630-9_17."},{"key":"1624_CR62","volume-title":"Proceedings of the 41st International Conference on Machine Learning","author":"H Xu","year":"2024","unstructured":"H. Xu, Y. Yan, D. Wang, Z. Xu, Z. Zeng, T. F. Abdelzaher, J. Han, H. Tong. SLOG: An inductive spectral graph neural network beyond polynomial filter. In Proceedings of the 41st International Conference on Machine Learning, Vienna, Austria, 2024."},{"key":"1624_CR63","doi-asserted-by":"crossref","unstructured":"L. Yang, H. Lin, T. Zhao, Y. Wu, H. Zhu, R. Xie, Z. Sun, Y. Wang, Q. Gu. LRQ-DiT: Log-rotation posttraining quantization of diffusion transformers for image and video generation, [Online], Available: https:\/\/arxiv.org\/abs\/2508.03485, 2025.","DOI":"10.1109\/TCSVT.2026.3723090"},{"key":"1624_CR64","doi-asserted-by":"publisher","first-page":"6481","DOI":"10.18653\/v1\/2025.acl-long.325","volume-title":"Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics","author":"H Huang","year":"2025","unstructured":"H. Huang, D. Wu. Quaff: Quantized parameter-efficient fine-tuning under outlier spatial stability hypothesis. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics, Vienna, Austria, pp. 6481\u20136496, 2025. DOI: https:\/\/doi.org\/10.18653\/v1\/2025.acl-long.325."},{"key":"1624_CR65","volume-title":"Proceedings of the 38th International Conference on Neural Information Processing Systems","author":"J Wu","year":"2024","unstructured":"J. Wu, H. Wang, Y. Shang, M. Shah, Y. Yan. PTQ4DiT: Post-training quantization for diffusion transformers. In Proceedings of the 38th International Conference on Neural Information Processing Systems, Vancouver, Canada, 2024."},{"key":"1624_CR66","unstructured":"L. Yang, H. Gong, H. Lin, Y. Wu, Z. Sun, Q. Gu. DopQViT: Towards distribution-friendly and outlier-aware post-training quantization for vision transformers, [Online], Available: https:\/\/arxiv.org\/abs\/2408.03291, 2024."},{"key":"1624_CR67","doi-asserted-by":"publisher","first-page":"10081","DOI":"10.18653\/v1\/2025.acl-long.498","volume-title":"Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics","author":"M Chen","year":"2025","unstructured":"M. Chen, W. Shao, P. Xu, J. Wang, P. Gao, K. Zhang, P. Luo. EfficientQAT: Efficient quantization-aware training for large language models. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics, Vienna, Austria, pp. 10081\u201310100, 2025. DOI: https:\/\/doi.org\/10.18653\/v1\/2025.acl-long.498."},{"key":"1624_CR68","unstructured":"M. Chen, C. Zhang, J. Liu, Y. Zeng, Z. Xue, Z. Liu, Y. Li, J. Ma, J. Huang, X. Zhou, P. Luo. Scaling law for quantization-aware training, [Online], Available: https:\/\/arxiv.org\/abs\/2505.14302, 2025."},{"key":"1624_CR69","doi-asserted-by":"publisher","first-page":"7716","DOI":"10.18653\/v1\/2024.findings-acl.460","volume-title":"Proceedings of Findings of the Association for Computational Linguistics","author":"R Liu","year":"2024","unstructured":"R. Liu, H. Bai, H. Lin, Y. Li, H. Gao, Z. Xu, L. Hou, J. Yao, C. Yuan. IntactKV: Improving large language model quantization by keeping pivot tokens intact. In Proceedings of Findings of the Association for Computational Linguistics, Bangkok, Thailand, pp. 7716\u20137741, 2024. DOI: https:\/\/doi.org\/10.18653\/v1\/2024.findings-acl.460."},{"key":"1624_CR70","unstructured":"H. Huang, D. Wu, R. Cen, G. Yu, Z. Li, K. Liu, J. Zhu, P. Chen, X. Liu, D. Wu. Tequila: Trapping-free ternary quantization for large language models, [Online], Available: https:\/\/arxiv.org\/abs\/2509.23809, 2025."},{"key":"1624_CR71","volume-title":"Proceedings of the 36th International Conference on Neural Information Processing Systems","author":"E Frantar","year":"2022","unstructured":"E. Frantar, S. P. Singh, D. Alistarh. Optimal brain compression: A framework for accurate post-training quantization and pruning. In Proceedings of the 36th International Conference on Neural Information Processing Systems, New Orleans, USA, Article number 323, 2022."},{"key":"1624_CR72","volume-title":"Proceedings of the 41st International Conference on Machine Learning","author":"S Kim","year":"2024","unstructured":"S. Kim, C. Hooper, A. Gholami, Z. Dong, X. Li, S. Shen, M. W. Mahoney, K. Keutzer. SqueezeLLM: Dense-and-sparse quantization. In Proceedings of the 41st International Conference on Machine Learning, Vienna, Austria, Article number 958, 2024."},{"key":"1624_CR73","volume-title":"Proceedings of the 41st International Conference on Machine Learning","author":"W Huang","year":"2024","unstructured":"W. Huang, Y. Liu, H. Qin, Y. Li, S. Zhang, X. Liu, M. Magno, X. Qi. BiLLM: Pushing the limit of post-training quantization for LLMs. In Proceedings of the 41st International Conference on Machine Learning, Vienna, Austria, Article number 806, 2024."},{"key":"1624_CR74","volume-title":"Proceedings of the 13th International Conference on Learning Representations","author":"Z Li","year":"2025","unstructured":"Z. Li, X. Yan, T. Zhang, H. Qin, D. Xie, J. Tian, Z. Shi, L. Kong, Y. Zhang, X. Yang. ARB-LLM: Alternating refined binarizations for large language models. In Proceedings of the 13th International Conference on Learning Representations, Singapore, 2025."},{"key":"1624_CR75","volume-title":"Proceedings of the 42nd International Conference on Machine Learning","author":"W Huang","year":"2025","unstructured":"W. Huang, H. Qin, Y. Liu, Y. Li, Q. Liu, X. Liu, L. Benini, M. Magno, S. Zhang, X. Qi. SliM-LLM: Salience-driven mixed-precision quantization for large language models. In Proceedings of the 42nd International Conference on Machine Learning, Vancouver, Canada, 2025."},{"key":"1624_CR76","doi-asserted-by":"publisher","first-page":"8719","DOI":"10.18653\/v1\/2024.findings-acl.516","volume-title":"Proceedings of Findings of the Association for Computational Linguistics","author":"H Chen","year":"2024","unstructured":"H. Chen, C. Lv, L. Ding, H. Qin, X. Zhou, Y. Ding, X. Liu, M. Zhang, J. Guo, X. Liu. DB-LLM: Accurate dualbinarization for efficient LLMs. In Proceedings of Findings of the Association for Computational Linguistics, Bangkok, Thailand, pp. 8719\u20138730, 2024. DOI: https:\/\/doi.org\/10.18653\/v1\/2024.findings-acl.516."},{"key":"1624_CR77","unstructured":"X. Yan, C. Bao, Z. Li, T. Zhang, K. Yang, H. Qin, R. Xie, X. Sun, Y. Zhang. PT 2-LLM: Post-training ternarization for large language models, [Online], Available: https:\/\/arxiv.org\/abs\/2510.03267, 2025."},{"key":"1624_CR78","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"W Shao","year":"2024","unstructured":"W. Shao, M. Chen, Z. Zhang, P. Xu, L. Zhao, Z. Li, K. Zhang, P. Gao, Y. Qiao, P. Luo. OmniQuant: Omnidirectionally calibrated quantization for large language models. In Proceedings of the 12th International Conference on Learning Representations, Vienna, Austria, 2024."},{"key":"1624_CR79","unstructured":"Y. Lin, H. Tang, S. Yang, Z. Zhang, G. Xiao, C. Gan, S. Han. QServe: W4A8KV4 quantization and system codesign for efficient LLM serving, [Online], Available: https:\/\/arxiv.org\/abs\/2405.04532, 2024."},{"key":"1624_CR80","unstructured":"X. Hu, Y. Cheng, D. Yang, Z. Xu, Z. Yuan, J. Yu, C. Xu, Z. Jiang, S. Zhou. OstQuant: Refining large language model quantization with orthogonal and scaling transformations for better distribution fitting, [Online], Available: https:\/\/arxiv.org\/abs\/2501.13987, 2025."},{"key":"1624_CR81","volume-title":"Proceedings of the 37th International Conference on Neural Information Processing Systems","author":"T Dettmers","year":"2023","unstructured":"T. Dettmers, A. Pagnoni, A. Holtzman, L. Zettlemoyer. QLoRA: Efficient finetuning of quantized LLMs. In Proceedings of the 37th International Conference on Neural Information Processing Systems, New Orleans, USA, 2023."},{"key":"1624_CR82","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"Y Li","year":"2024","unstructured":"Y. Li, Y. Yu, C. Liang, N. Karampatziakis, P. He, W. Chen, T. Zhao. LoftQ: LoRA-fine-tuning-aware quantization for large language models. In Proceedings of the 12th International Conference on Learning Representations, Vienna, Austria, 2024."},{"key":"1624_CR83","volume-title":"Proceedings of the 12th International Conference on Learning Representations","author":"H Guo","year":"2024","unstructured":"H. Guo, P. Greengard, E. P. Xing, Y. Kim. LQ-LoRA: Low-rank plus quantized matrix decomposition for efficient language model finetuning. In Proceedings of the 12th International Conference on Learning Representations, Vienna, Austria, 2024."},{"key":"1624_CR84","volume-title":"Proceedings of the 41st International Conference on Machine Learning","author":"H Qin","year":"2024","unstructured":"H. Qin, X. Ma, X. Zheng, X. Li, Y. Zhang, S. Liu, J. Luo, X. Liu, M. Magno. Accurate LoRA-finetuning quantization of LLMs via information retention. In Proceedings of the 41st International Conference on Machine Learning, Vienna, Austria, 2024."},{"key":"1624_CR85","volume-title":"Proceedings of the 5th International Conference on Learning Representations","author":"S Merity","year":"2017","unstructured":"S. Merity, C. Xiong, J. Bradbury, R. Socher. Pointer sentinel mixture models. In Proceedings of the 5th International Conference on Learning Representations, Toulon, France, 2017."},{"key":"1624_CR86","unstructured":"Y. An, X. Zhao, T. Yu, M. Tang, J. Wang. Systematic outliers in large language models, [Online], Available: https:\/\/arxiv.org\/abs\/2502.06415, 2025."},{"key":"1624_CR87","unstructured":"L. Gao, S. Biderman, S. Black, L. Golding, T. Hoppe, C. Foster, J. Phang, H. He, A. Thite, N. Nabeshima, S. Presser, C. Leahy. The pile: An 800 GB dataset of diverse text for language modeling, [Online], Available: https:\/\/arxiv.org\/abs\/2101.00027, 2020."},{"key":"1624_CR88","volume-title":"Proceedings of the 9th International Conference on Learning Representations","author":"D Hendrycks","year":"2021","unstructured":"D. Hendrycks, C. Burns, S. Basart, A. Zou, M. Mazeika, D. Song, J. Steinhardt. Measuring massive multitask language understanding. In Proceedings of the 9th International Conference on Learning Representations, 2021."},{"key":"1624_CR89","unstructured":"P. Clark, I. Cowhey, O. Etzioni, T. Khot, A. Sabharwal, C. Schoenick, O. Tafjord. Think you have solved question answering? Try ARC, the AI2 reasoning challenge, [Online], Available: https:\/\/arxiv.org\/abs\/1803.05457, 2018."},{"key":"1624_CR90","doi-asserted-by":"publisher","first-page":"4791","DOI":"10.18653\/v1\/P19-1472","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"R Zellers","year":"2019","unstructured":"R. Zellers, A. Holtzman, Y. Bisk, A. Farhadi, Y. Choi. HellaSwag: Can a machine really finish your sentence? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy, pp. 4791\u20134800, 2019. DOI: https:\/\/doi.org\/10.18653\/v1\/P19-1472."},{"issue":"9","key":"1624_CR91","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1145\/3474381","volume":"64","author":"K Sakaguchi","year":"2021","unstructured":"K. Sakaguchi, R. Le Bras, C. Bhagavatula, Y. Choi. WinoGrande: An adversarial Winograd schema challenge at scale. Communications of the ACM, vol. 64, no. 9, pp. 99\u2013106, 2021. DOI: https:\/\/doi.org\/10.1145\/3474381.","journal-title":"Communications of the ACM"},{"key":"1624_CR92","doi-asserted-by":"publisher","first-page":"7432","DOI":"10.1609\/aaai.v34i05.6239","volume-title":"Proceedings of the 34th AAAI Conference on Artificial Intelligence","author":"Y Bisk","year":"2020","unstructured":"Y. Bisk, R. Zellers, R. Le Bras, J. Gao, Y. Choi. PIQA: Reasoning about physical commonsense in natural language. In Proceedings of the 34th AAAI Conference on Artificial Intelligence, New York, USA, pp. 7432\u20137439, 2020. DOI: https:\/\/doi.org\/10.1609\/aaai.v34i05.6239."},{"key":"1624_CR93","unstructured":"K. Cobbe, V. Kosaraju, M. Bavarian, M. Chen, H. Jun, L. Kaiser, M. Plappert, J. Tworek, J. Hilton, R. Nakano, C. Hesse, J. Schulman. Training verifiers to solve math word problems, [Online], Available: https:\/\/arxiv.org\/abs\/2110.14168, 2021."},{"key":"1624_CR94","volume-title":"Proceedings of the 1st Neural Information Processing Systems Track on Datasets and Benchmarks","author":"D Hendrycks","year":"2021","unstructured":"D. Hendrycks, C. Burns, S. Kadavath, A. Arora, S. Basart, E. Tang, D. Song, J. Steinhardt. Measuring mathematical problem solving with the MATH dataset. In Proceedings of the 1st Neural Information Processing Systems Track on Datasets and Benchmarks, 2021."},{"key":"1624_CR95","unstructured":"M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. de Oliveira Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, A. Ray, R. Puri, G. Krueger, M. Petrov, H. Khlaaf, G. Sastry, P. Mishkin, B. Chan, S. Gray, N. Ryder, M. Pavlov, A. Power, L. Kaiser, M. Bavarian, C. Winter, P. Tillet, F. P. Such, D. Cummings, M. Plappert, F. Chantzis, E. Barnes, A. Herbert-Voss, W. H. Guss, A. Nichol, A. Paino, N. Tezak, J. Tang, I. Babuschkin, S. Balaji, S. Jain, W. Saunders, C. Hesse, A. N. Carr, J. Leike, J. Achiam, V. Misra, E. Morikawa, A. Radford, M. Knight, M. Brundage, M. Murati, K. Mayer, P. Welinder, B. McGrew, D. Amodei, S. McCandlish, I. Sutskever, W. Zaremba. Evaluating large language models trained on code, [Online], Available: https:\/\/arxiv.org\/abs\/2107.03374, 2021."},{"key":"1624_CR96","unstructured":"J. Austin, A. Odena, M. Nye, M. Bosma, H. Michalewski, D. Dohan, E. Jiang, C. Cai, M. Terry, Q. Le, C. Sutton. Program synthesis with large language models, [Online], Available: https:\/\/arxiv.org\/abs\/2108.07732, 2021."}],"container-title":["Machine Intelligence Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11633-025-1624-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11633-025-1624-x","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11633-025-1624-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T11:02:21Z","timestamp":1790679741000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11633-025-1624-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,25]]},"references-count":96,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2026,10]]}},"alternative-id":["1624"],"URL":"https:\/\/doi.org\/10.1007\/s11633-025-1624-x","relation":{},"ISSN":["2731-538X","2731-5398"],"issn-type":[{"value":"2731-538X","type":"print"},{"value":"2731-5398","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,25]]},"assertion":[{"value":"22 September 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 November 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 August 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declared that they have no conflicts of interest to this work.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations of conflict of interest"}}]}}