{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,26]],"date-time":"2026-10-26T20:31:32Z","timestamp":1793046692523,"version":"4.5.0"},"reference-count":89,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T00:00:00Z","timestamp":1741824000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T00:00:00Z","timestamp":1741824000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Vis"],"published-print":{"date-parts":[[2025,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>The rapid development of multimodal generative vision models has drawn scientific curiosity. Notable advancements, such as OpenAI\u2019s ChatGPT and Stable Diffusion, demonstrate the potential of combining multimodal data for generative content. Nonetheless, customising these models to specific domains or tasks is challenging due to computational costs and data requirements. Conventional fine-tuning methods take redundant processing resources, motivating the development of parameter-efficient fine-tuning technologies such as adapter module, low-rank factorization and orthogonal fine-tuning. These solutions selectively change a subset of model parameters, reducing learning needs while maintaining high-quality results. Orthogonal fine-tuning, regarded as a reliable technique, preserves semantic linkages in weight space but has limitations in its expressive powers. To better overcome these constraints, we provide a simple but innovative and effective transformation method inspired by M\u00f6bius geometry, which replaces conventional orthogonal transformations in parameter-efficient fine-tuning. This strategy improved fine-tuning\u2019s adaptability and expressiveness, allowing it to capture more data patterns. Our strategy, which is supported by theoretical understanding and empirical validation, outperforms existing approaches, demonstrating competitive improvements in generation quality for key generative tasks.\n<\/jats:p>","DOI":"10.1007\/s11263-025-02398-3","type":"journal-article","created":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T19:21:37Z","timestamp":1741893697000},"page":"4590-4603","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":43,"title":["Parameter Efficient Fine-Tuning for Multi-modal Generative Vision Models with M\u00f6bius-Inspired Transformation"],"prefix":"10.1007","volume":"133","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9956-7020","authenticated-orcid":false,"given":"Haoran","family":"Duan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuai","family":"Shao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bing","family":"Zhai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tejal","family":"Shah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jungong","family":"Han","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rajiv","family":"Ranjan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,3,13]]},"reference":[{"key":"2398_CR1","doi-asserted-by":"crossref","unstructured":"Blattmann, A., Rombach, R., Ling, H., Dockhorn, T., Kim, S.W., Fidler, S., & Kreis, K. (2023). Align your latents: High-resolution video synthesis with latent diffusion models. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR52729.2023.02161"},{"key":"2398_CR2","first-page":"25365","volume":"36","author":"M Brack","year":"2024","unstructured":"Brack, M., Friedrich, F., Hintersdorf, D., Struppek, L., Schramowski, P., & Kersting, K. (2024). Sega: Instructing text-to-image models using semantic guidance. Advances in Neural Information Processing Systems, 36, 25365\u201325389.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2398_CR3","unstructured":"Brock, A., Donahue, J., & Simonyan, K. (2018). Large scale gan training for high fidelity natural image synthesis. arXiv preprint arXiv:1809.11096"},{"key":"2398_CR4","doi-asserted-by":"crossref","unstructured":"Brooks, T., Holynski, A., & Efros, A. A. (2023). Instructpix2pix: Learning to follow image editing instructions. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR52729.2023.01764"},{"key":"2398_CR5","first-page":"1877","volume":"33","author":"T Brown","year":"2020","unstructured":"Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877\u20131901.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2398_CR6","unstructured":"Chen, B., Liu, W., Yu, Z., Kautz, J., Shrivastava, A., Garg, A., & Anandkumar, A. (2020). Angular visual hardness. In International conference on machine learning."},{"key":"2398_CR7","volume-title":"Generative Pretraining from Pixels","author":"M Chen","year":"2020","unstructured":"Chen, M., Radford, A., Child, R., Wu, J., Jun, H., Luan, D., & Sutskever, I. (2020). Generative Pretraining from Pixels. PMLR: In International conference on machine learning."},{"key":"2398_CR8","unstructured":"Child, R., Gray, S., Radford, A., & Sutskever, I. (2019). Generating long sequences with sparse transformers. arXiv preprint arXiv:1904.10509"},{"key":"2398_CR9","first-page":"47704","volume":"36","author":"J Copet","year":"2024","unstructured":"Copet, J., Kreuk, F., Gat, I., Remez, T., Kant, D., Synnaeve, G., Adi, Y., & D\u00e9fossez, A. (2024). Simple and controllable music generation. Advances in Neural Information Processing Systems, 36, 47704\u201347720.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2398_CR10","unstructured":"Couairon, G., Verbeek, J., Schwenk, H., & Cord, M. (2023). DiffEdit: Diffusion-based semantic image editing with mask guidance. https:\/\/openreview.net\/forum?id=3lge0p5o-M-"},{"key":"2398_CR11","unstructured":"Dettmers, T., Pagnoni, A., Holtzman, A., & Zettlemoyer, L. (2024). Qlora: Efficient finetuning of quantized llms."},{"key":"2398_CR12","unstructured":"Dhariwal, P., Jun, H., Payne, C., Kim, J. W., Radford, A., & Sutskever, I. (2020). Jukebox: A generative model for music. arXiv preprint arXiv:2005.00341"},{"key":"2398_CR13","first-page":"8780","volume":"34","author":"P Dhariwal","year":"2021","unstructured":"Dhariwal, P., & Nichol, A. (2021). Diffusion models beat gans on image synthesis. Advances in Neural Information Processing Systems, 34, 8780\u20138794.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2398_CR14","unstructured":"Dinh, L., Krueger, D., & Bengio, Y. (2014). Nice: Non-linear independent components estimation. arXiv preprint arXiv:1410.8516"},{"key":"2398_CR15","unstructured":"Dinh, L., Sohl-Dickstein, J., & Bengio, S. (2016). Density estimation using real nvp. arXiv preprint arXiv:1605.08803"},{"key":"2398_CR16","doi-asserted-by":"crossref","unstructured":"Esser, P., Rombach, R., & Ommer, B. (2021). Taming transformers for high-resolution image synthesis. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR46437.2021.01268"},{"key":"2398_CR17","unstructured":"Gal, R., Alaluf, Y., Atzmon, Y., Patashnik, O., Bermano, A.H., Chechik, G., & Cohen-or, D. (2023). An image is worth one word: Personalizing text-to-image generation using textual inversion. https:\/\/openreview.net\/forum?id=NAQvF08TcyG"},{"key":"2398_CR18","doi-asserted-by":"crossref","unstructured":"Gandikota, R., Materzynska, J., Zhou, T., Torralba, A., & Bau, D. (2023). Concept sliders: Lora adaptors for precise control in diffusion models. arXiv preprint arXiv:2311.12092.","DOI":"10.1007\/978-3-031-73661-2_10"},{"issue":"11","key":"2398_CR19","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1145\/3422622","volume":"63","author":"I Goodfellow","year":"2020","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., & Bengio, Y. (2020). Generative adversarial networks. Communications of the ACM, 63(11), 139\u2013144.","journal-title":"Communications of the ACM"},{"key":"2398_CR20","unstructured":"Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. C. (2017). Improved training of wasserstein gans. Advances in Neural Information Processing Systems, 30."},{"key":"2398_CR21","unstructured":"Hayou, S., Ghosh, N., & Yu, B. (2024). LoRA+: Efficient low rank adaptation of large models. arXiv preprint arXiv:2402.12354"},{"key":"2398_CR22","unstructured":"Hertz, A., Mokady, R., Tenenbaum, J., Aberman, K., Pritch, Y., & Cohen-or, D. (2023). Prompt-to-prompt image editing with cross-attention control. https:\/\/openreview.net\/forum?id=_CDixzkzeyb"},{"key":"2398_CR23","unstructured":"Ho, J., Chan, W., Saharia, C., Whang, J., Gao, R., Gritsenko, A., Kingma, D.P., Poole, B., Norouzi, M., Fleet, D. J., et\u00a0al. (2022). Imagen video: High definition video generation with diffusion models. arXiv preprint arXiv:2210.02303"},{"key":"2398_CR24","unstructured":"Houlsby, N., Giurgiu, A., Jastrzebski, S., Morrone, B., De\u00a0Laroussilhe, Q., Gesmundo, A., Attariyan, M., & Gelly, S. (2019). Parameter-efficient transfer learning for NLP. In International conference on machine learning, pp. 2790\u20132799. PMLR."},{"key":"2398_CR25","unstructured":"Hu, E. J., shen, Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2022). LoRA: Low-rank adaptation of large language models. https:\/\/openreview.net\/forum?id=nZeVKeeFYf9."},{"key":"2398_CR26","unstructured":"Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2021). Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685"},{"key":"2398_CR27","doi-asserted-by":"crossref","unstructured":"Jouppi, N.P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et\u00a0al. (2017). In-datacenter performance analysis of a tensor processing unit. In Proceedings of the 44th annual international symposium on computer architecture.","DOI":"10.1145\/3079856.3080246"},{"key":"2398_CR28","unstructured":"Karras, T., Aila, T., Laine, S., & Lehtinen, J. (2017). Progressive growing of gans for improved quality, stability, and variation. arXiv preprint arXiv:1710.10196"},{"key":"2398_CR29","doi-asserted-by":"crossref","unstructured":"Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020). Analyzing and improving the image quality of StyleGAN. In IEEE computer society, Los Alamitos, CA, USA","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"2398_CR30","first-page":"12104","volume":"33","author":"T Karras","year":"2020","unstructured":"Karras, T., Aittala, M., Hellsten, J., Laine, S., Lehtinen, J., & Aila, T. (2020). Training generative adversarial networks with limited data. Advances in Neural Information Processing Systems, 33, 12104\u201312114.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2398_CR31","doi-asserted-by":"crossref","unstructured":"Kawar, B., Zada, S., Lang, O., Tov, O., Chang, H., Dekel, T., Mosseri, I., & Irani, M. (2023). Imagic: Text-based real image editing with diffusion models. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR52729.2023.00582"},{"key":"2398_CR32","doi-asserted-by":"crossref","unstructured":"Kim, G., Kwon, T., & Ye, J. C. (2022). Diffusionclip: Text-guided diffusion models for robust image manipulation. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR52688.2022.00246"},{"key":"2398_CR33","unstructured":"Kingma, D. P., & Dhariwal, P. (2018). Glow: Generative flow with invertible 1x1 convolutions. Advances in Neural Information Processing Systems, 31."},{"key":"2398_CR34","unstructured":"Kingma, D. P., & Welling, M. (2013). Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114"},{"key":"2398_CR35","first-page":"21696","volume":"34","author":"D Kingma","year":"2021","unstructured":"Kingma, D., Salimans, T., Poole, B., & Ho, J. (2021). Variational diffusion models. Advances in Neural Information Processing Systems, 34, 21696\u201321707.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2398_CR36","doi-asserted-by":"crossref","unstructured":"Kumari, N., Zhang, B., Zhang, R., Shechtman, E., & Zhu, J.-Y. (2023). Multi-concept customization of text-to-image diffusion. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR52729.2023.00192"},{"key":"2398_CR37","doi-asserted-by":"crossref","unstructured":"Lester, B., Al-Rfou, R., & Constant, N. (2021). The power of scale for parameter-efficient prompt tuning. arXiv preprint arXiv:2104.08691","DOI":"10.18653\/v1\/2021.emnlp-main.243"},{"key":"2398_CR38","doi-asserted-by":"crossref","unstructured":"Li, X. L., & Liang, P. (2021). Prefix-tuning: Optimizing continuous prompts for generation. arXiv preprint arXiv:2101.00190","DOI":"10.18653\/v1\/2021.acl-long.353"},{"key":"2398_CR39","unstructured":"Li, S., Weijer, J., Hu, T., Khan, F.S., Hou, Q., Wang, Y., & Yang, J. (2023). Stylediffusion: Prompt-embedding inversion for text-based editing. arXiv preprint arXiv:2303.15649"},{"key":"2398_CR40","doi-asserted-by":"crossref","unstructured":"Lin, C.-H., Gao, J., Tang, L., Takikawa, T., Zeng, X., Huang, X., Kreis, K., Fidler, S., Liu, M.-Y., Lin, T.-Y. (2023). Magic3d: High-resolution text-to-3d content creation. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR52729.2023.00037"},{"key":"2398_CR41","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., & Zitnick, C. L. (2014). Microsoft coco: Common objects in context. In Computer vision\u2013ECCV 2014: 13th European conference, Zurich, Switzerland, September 6\u201312, 2014, Proceedings, Part V 13, pp. 740\u2013755. Springer.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"2398_CR42","doi-asserted-by":"crossref","unstructured":"Liu, X., Ji, K., Fu, Y., Tam, W.L., Du, Z., Yang, Z., & Tang, J. (2021). P-tuning v2: Prompt tuning can be comparable to fine-tuning universally across scales and tasks. arXiv preprint arXiv:2110.07602","DOI":"10.18653\/v1\/2022.acl-short.8"},{"key":"2398_CR43","unstructured":"Liu, H., Li, C., Wu, Q., & Lee, Y. J. (2024). Visual instruction tuning. Advances in Neural Information Processing Systems, 36."},{"key":"2398_CR44","doi-asserted-by":"crossref","unstructured":"Liu, W., Liu, Z., Yu, Z., Dai, B., Lin, R., Wang, Y., Rehg, J. M., & Song, L. (2018). Decoupled networks. In Proceedings of the IEEE conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR.2018.00293"},{"key":"2398_CR45","doi-asserted-by":"crossref","unstructured":"Liu, X., Park, D. H., Azadi, S., Zhang, G., Chopikyan, A., Hu, Y., Shi, H., Rohrbach, A., & Darrell, T. (2023). More control for free! image synthesis with semantic diffusion guidance. In Proceedings of the IEEE\/CVF winter conference on applications of computer vision.","DOI":"10.1109\/WACV56688.2023.00037"},{"key":"2398_CR46","unstructured":"Liu, W., Qiu, Z., Feng, Y., Xiu, Y., Xue, Y., Yu, L., Feng, H., Liu, Z., Heo, J., Peng, S., Wen, Y., Black, M. J., Weller, A., & Sch\u00f6lkopf, B. (2024). Parameter-efficient orthogonal finetuning via butterfly factorization. https:\/\/openreview.net\/forum?id=7NzgkEdGyr"},{"key":"2398_CR47","unstructured":"Liu, S.-Y., Wang, C.-Y., Yin, H., Molchanov, P., Wang, Y.-C.F., Cheng, K.-T., & Chen, M.-H. (2024). DoRA: Weight-decomposed low-rank adaptation. arxiv.org\/abs\/2402.09353"},{"key":"2398_CR48","doi-asserted-by":"crossref","unstructured":"Liu, R., Wu, R., Van\u00a0Hoorick, B., Tokmakov, P., Zakharov, S., & Vondrick, C. (2023). Zero-1-to-3: Zero-shot one image to 3d object. In Proceedings of the IEEE\/CVF international conference on computer vision.","DOI":"10.1109\/ICCV51070.2023.00853"},{"key":"2398_CR49","unstructured":"Liu, W., Zhang, Y.-M., Li, X., Yu, Z., Dai, B., Zhao, T., & Song, L. (2017). Deep hyperspherical learning."},{"key":"2398_CR50","unstructured":"Liu, M., Xu, C., Jin, H., Chen, L., Varma, T., & M., Xu, Z., & Su, H. (2024). One-2-3-45: Any single image to 3d mesh in 45 seconds without per-shape optimization. Advances in Neural Information Processing Systems, 36, 22226\u201322246."},{"key":"2398_CR51","unstructured":"Meng, C., He, Y., Song, Y., Song, J., Wu, J., Zhu, J.-Y., & Ermon, S. (2022). SDEdit: Guided image synthesis and editing with stochastic differential equations. https:\/\/openreview.net\/forum?id=aBsCjcPu_tE"},{"key":"2398_CR52","unstructured":"Metz, L., Poole, B., Pfau, D., & Sohl-Dickstein, J. (2016). Unrolled generative adversarial networks. arXiv preprint arXiv:1611.02163"},{"key":"2398_CR53","doi-asserted-by":"publisher","first-page":"4296","DOI":"10.1609\/aaai.v38i5.28226","volume":"38","author":"C Mou","year":"2024","unstructured":"Mou, C., Wang, X., Xie, L., Wu, Y., Zhang, J., Qi, Z., & Shan, Y. (2024). T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models. In Proceedings of the AAAI conference on artificial intelligence, 38, 4296\u20134304.","journal-title":"In Proceedings of the AAAI conference on artificial intelligence"},{"key":"2398_CR54","unstructured":"Nickel, M., & Kiela, D. (2017). Poincar\u00e9 embeddings for learning hierarchical representations. Advances in Neural Information Processing Systems, 30."},{"key":"2398_CR55","unstructured":"Oord, A., Kalchbrenner, N., Espeholt, L., Vinyals, O., Graves, A., et\u00a0al. (2016). Conditional image generation with pixelcnn decoders. Advances in Neural Information Processing Systems, 29."},{"key":"2398_CR56","unstructured":"Oquab, M., Darcet, T., Moutakanni, T., Vo, H., Szafraniec, M., Khalidov, V., Fernandez, P., Haziza, D., Massa, F., El-Nouby, A., et\u00a0al. (2023). Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193"},{"key":"2398_CR57","unstructured":"Papamakarios, G., Pavlakou, T., & Murray, I. (2017). Masked autoregressive flow for density estimation. Advances in Neural Information Processing Systems, 30."},{"key":"2398_CR58","doi-asserted-by":"crossref","unstructured":"Patashnik, O., Garibi, D., Azuri, I., Averbuch-Elor, H., & Cohen-Or, D. (2023). Localizing object-level shape variations with text-to-image diffusion models. In Proceedings of the IEEE\/CVF international conference on computer vision.","DOI":"10.1109\/ICCV51070.2023.02107"},{"key":"2398_CR59","unstructured":"Qiu, Z., Liu, W., Feng, H., Xue, Y., Feng, Y., Liu, Z., Zhang, D., Weller, A., & Sch\u00f6lkopf, B. (2023). Controlling text-to-image diffusion by orthogonal finetuning. In Thirty-seventh conference on neural information processing systems. https:\/\/openreview.net\/forum?id=K30wTdIIYc"},{"key":"2398_CR60","unstructured":"Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022). Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125"},{"key":"2398_CR61","unstructured":"Razavi, A., Oord, A., & Vinyals, O. (2019). Generating diverse high-fidelity images with vq-vae-2. Advances in Neural Information Processing Systems, 32."},{"key":"2398_CR62","doi-asserted-by":"crossref","unstructured":"Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022). High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"2398_CR63","doi-asserted-by":"crossref","unstructured":"Ruiz, N., Li, Y., Jampani, V., Pritch, Y., Rubinstein, M., & Aberman, K. (2023). Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR52729.2023.02155"},{"key":"2398_CR64","first-page":"36479","volume":"35","author":"C Saharia","year":"2022","unstructured":"Saharia, C., Chan, W., Saxena, S., Li, L., Whang, J., Denton, E. L., Ghasemipour, K., Gontijo Lopes, R., Karagol Ayan, B., Salimans, T., et al. (2022). Photorealistic text-to-image diffusion models with deep language understanding. Advances in Neural Information Processing Systems, 35, 36479\u201336494.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2398_CR65","unstructured":"Salimans, T., Karpathy, A., Chen, X., & Kingma, D. P. (2017). Pixelcnn++: Improving the pixelcnn with discretized logistic mixture likelihood and other modifications. arXiv preprint arXiv:1701.05517"},{"key":"2398_CR66","doi-asserted-by":"publisher","unstructured":"Shen, J., Pang, R., Weiss, R. J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., Skerrv-Ryan, R., Saurous, R. A., Agiomvrgiannakis, Y., & Wu, Y. (2018). Natural TTS synthesis by conditioning wavenet on MEL spectrogram predictions. In 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP). https:\/\/doi.org\/10.1109\/ICASSP.2018.8461368","DOI":"10.1109\/ICASSP.2018.8461368"},{"key":"2398_CR67","unstructured":"Sohl-Dickstein, J., Weiss, E., Maheswaranathan, N., & Ganguli, S. (2015). Deep unsupervised learning using nonequilibrium thermodynamics. In International conference on machine learning."},{"key":"2398_CR68","unstructured":"Su, X., Song, J., Meng, C., & Ermon, S. (2023). Dual diffusion implicit bridges for image-to-image translation. https:\/\/openreview.net\/forum?id=5HLoTvVGDe"},{"key":"2398_CR69","doi-asserted-by":"publisher","first-page":"4234","DOI":"10.1109\/TPAMI.2024.3356232","volume":"46","author":"X Tan","year":"2024","unstructured":"Tan, X., Chen, J., Liu, H., Cong, J., Zhang, C., Liu, Y., Wang, X., Leng, Y., Yi, Y., He, L., et al. (2024). Naturalspeech: End-to-end text-to-speech synthesis with human-level quality. IEEE Transactions on Pattern Analysis and Machine Intelligence., 46, 4234\u20134245.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence."},{"key":"2398_CR70","doi-asserted-by":"crossref","unstructured":"Tumanyan, N., Geyer, M., Bagon, S., & Dekel, T. (2023). Plug-and-play diffusion features for text-driven image-to-image translation. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition.","DOI":"10.1109\/CVPR52729.2023.00191"},{"key":"2398_CR71","first-page":"19667","volume":"33","author":"A Vahdat","year":"2020","unstructured":"Vahdat, A., & Kautz, J. (2020). NVAE: A deep hierarchical variational autoencoder. Advances in Neural Information Processing Systems, 33, 19667\u201319679.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2398_CR72","doi-asserted-by":"publisher","unstructured":"Valipour, M., Rezagholizadeh, M., Kobyzev, I., & Ghodsi, A. (2023). DyLoRA: Parameter-efficient tuning of pre-trained models using dynamic search-free low-rank adaptation. In Vlachos, A., Augenstein, I. (eds.) Proceedings of the 17th conference of the European chapter of the association for computational linguistics, pp. 3274\u20133287. Association for Computational Linguistics, Dubrovnik, Croatia. https:\/\/doi.org\/10.18653\/v1\/2023.eacl-main.239. https:\/\/aclanthology.org\/2023.eacl-main.239","DOI":"10.18653\/v1\/2023.eacl-main.239"},{"key":"2398_CR73","unstructured":"Van Den\u00a0Oord, A., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., Kavukcuoglu, K., et\u00a0al. (2016). Wavenet: A generative model for raw audio. arXiv preprint arXiv:1609.03499"},{"key":"2398_CR74","doi-asserted-by":"crossref","unstructured":"Dai, W., Chen, LH., Wang, J., Liu, J., dai, B., Tang, Y. (2024). Real-time controllable motion generation via latent consistency model. European Conference on Computer Vision. (pp. 390-408). Springer","DOI":"10.1007\/978-3-031-72640-8_22"},{"key":"2398_CR75","doi-asserted-by":"crossref","unstructured":"Atiyah, MF., Todd, JA. (1960). On complex Stiefel manifolds. Mathematical Proceedings of the Cambridge Philosophical Society, 56(4), 342-353. Cambridge University Press.","DOI":"10.1017\/S0305004100034642"},{"issue":"7","key":"2398_CR76","doi-asserted-by":"publisher","first-page":"7368","DOI":"10.1609\/aaai.v38i7.28567","volume":"38","author":"Y Zhang","year":"2024","unstructured":"Zhang, Y., Huang, D., Liu, B., Tang, S., Lu, Y., Chen, L., Bai, L., Chu, Q., Yu, N., & Ouyang, W. (2024). Motiongpt: Finetuned llms are general-purpose motion generators. In Proceedings of the AAAI Conference on Artificial Intelligence, 38(7), 7368\u20137376.","journal-title":"In Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"2398_CR77","doi-asserted-by":"crossref","unstructured":"Guo, C., Zou, S., Zuo X., Wang, S., Ji, W., Li, X., Cheng, L. (2022). Generating diverse and natural 3d human motions from text. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, 5152-5161.","DOI":"10.1109\/CVPR52688.2022.00509"},{"issue":"7","key":"2398_CR78","doi-asserted-by":"publisher","first-page":"7368","DOI":"10.1609\/aaai.v38i7.28567","volume":"38","author":"Y Zhang","year":"2024","unstructured":"Zhang, Y., Huang, D., Liu, B., Tang, S., Lu, Y., Chen, L., Bai, L., Chu, Q., Yu, N., & Ouyang, W. (2024). Motiongpt: Finetuned llms are general-purpose motion generators. In Proceedings of the AAAI Conference on Artificial Intelligence, 38(7), 7368\u20137376.","journal-title":"In Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"2398_CR79","unstructured":"Van Den\u00a0Oord, A., Kalchbrenner, N., & Kavukcuoglu, K. (2016). Pixel recurrent neural networks. In International conference on machine learning, PMLR."},{"key":"2398_CR80","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, \u0141., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30."},{"key":"2398_CR81","unstructured":"Xia, W., Qin, C., & Hazan, E. (2024). Chain of lora: Efficient fine-tuning of language models via residual learning. arXiv preprint arXiv:2401.04151"},{"key":"2398_CR82","first-page":"26291","volume":"36","author":"F Yang","year":"2024","unstructured":"Yang, F., Yang, S., Butt, M. A., Weijer, J., et al. (2024). Dynamic prompt learning: Addressing cross-attention leakage for text-based image editing. Advances in Neural Information Processing Systems, 36, 26291\u201326303.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2398_CR83","unstructured":"Yu, T., Feng, R., Feng, R., Liu, J., Jin, X., Zeng, W., & Chen, Z. (2023). Inpaint anything: Segment anything meets image inpainting. arXiv preprint arXiv:2304.06790"},{"key":"2398_CR84","unstructured":"Zhang, F., & Pilanci, M. (2024). Riemannian preconditioned lora for fine-tuning foundation models. arXiv preprint arXiv:2402.02347"},{"key":"2398_CR85","unstructured":"Zhang, Q., Chen, M., Bukharin, A., He, P., Cheng, Y., Chen, W., & Zhao, T. (2023). Adaptive budget allocation for parameter-efficient fine-tuning. arXiv preprint arXiv:2303.10512"},{"key":"2398_CR86","unstructured":"Zhang, F., Li, L., Chen, J., Jiang, Z., Wang, B., & Qian, Y. (2023). IncreLoRA: Incremental parameter allocation method for parameter-efficient fine-tuning. arXiv preprint arXiv:2308.12043"},{"key":"2398_CR87","doi-asserted-by":"crossref","unstructured":"Zhang, L., Rao, A., & Agrawala, M. (2023). Adding conditional control to text-to-image diffusion models. In Proceedings of the IEEE\/CVF international conference on computer vision.","DOI":"10.1109\/ICCV51070.2023.00355"},{"key":"2398_CR88","doi-asserted-by":"crossref","unstructured":"Zhang, H., Xu, T., Li, H., Zhang, S., Huang, X., Wang, X., & Metaxas, D. (2017). Stackgan: Text to photo-realistic image synthesis with stacked generative adversarial networks. In Proceedings of the IEEE international conference on computer vision.","DOI":"10.1109\/ICCV.2017.629"},{"key":"2398_CR89","doi-asserted-by":"crossref","unstructured":"Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., & Torralba, A. (2017). Scene parsing through ade20k dataset. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 633\u2013641.","DOI":"10.1109\/CVPR.2017.544"}],"updated-by":[{"DOI":"10.1007\/s11263-025-02456-w","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2025,4,21]],"date-time":"2025-04-21T00:00:00Z","timestamp":1745193600000}}],"container-title":["International Journal of Computer Vision"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-025-02398-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11263-025-02398-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11263-025-02398-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,7]],"date-time":"2025-06-07T06:00:44Z","timestamp":1749276044000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11263-025-02398-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,13]]},"references-count":89,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,7]]}},"alternative-id":["2398"],"URL":"https:\/\/doi.org\/10.1007\/s11263-025-02398-3","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s11263-025-02456-w","asserted-by":"object"}]},"ISSN":["0920-5691","1573-1405"],"issn-type":[{"value":"0920-5691","type":"print"},{"value":"1573-1405","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,13]]},"assertion":[{"value":"23 July 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 February 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 March 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 April 2025","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The co-author\u2019s affiliation has been corrected","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 April 2025","order":7,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":8,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":9,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s11263-025-02456-w","URL":"https:\/\/doi.org\/10.1007\/s11263-025-02456-w","order":10,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}}]}}