{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T10:40:03Z","timestamp":1734345603930,"version":"3.30.2"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T00:00:00Z","timestamp":1727654400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T00:00:00Z","timestamp":1727654400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Pattern Anal Applic"],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Deep learning methods demand enormous amounts of labeled data. Although collecting labeled data is a challenge but it can be accomplished with difficulty. Nevertheless, domain shift or bias may occur due to some conditions. Recollecting data under similar conditions is too expensive or impossible. Domain adaptation is an effective technique to deal with this problem. Among domain adaptation methods, adversarial learning models handled domain shifts well. Adversarial learning\u2019s biggest issue is matching the features to the appropriate classes. In other words, domain adaptation may lead to negative transfer. Utilizing adversarial learning and Variational Auto-Encoder (VAE) cluster-forming capabilities, we propose a method that overcomes these limitations. Our structure attempts to generate a smooth latent representation based on both the target and the source data using a variational auto-encoder. Then the affected data are fed into an adversarial learning component. The component includes an encoder and a discriminator. The discriminator aims to identify the source and target encoders\u2019 features. The target encoder uses inverted domain labels to mislead the discriminator. To emphasize the desired effect of VAE on domain adaptation, we test the model performance without adversarial training. In comparison to the most prevalent adversarial domain adaptation benchmarks, our method yields approving and comparable results.<\/jats:p>","DOI":"10.1007\/s10044-024-01325-5","type":"journal-article","created":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T18:02:23Z","timestamp":1727719343000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Variational inference based adversarial domain adaptation"],"prefix":"10.1007","volume":"27","author":[{"given":"Mahta Hassan Pour","family":"Zonoozi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vahid","family":"Seydi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mahmood","family":"Deypir","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,9,30]]},"reference":[{"key":"1325_CR1","doi-asserted-by":"crossref","unstructured":"Torralba A, Efros A (2011) Unbiased look at dataset bias. CVPR\u201911","DOI":"10.1109\/CVPR.2011.5995347"},{"key":"1325_CR2","unstructured":"Donahue J, Jia Y, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) Decaf: a deep convolutional activation feature for generic visual recognition. In: International conference on machine learning (ICML)., pp. 647\u2013655"},{"key":"1325_CR3","first-page":"131","volume-title":"Covariate shift and local learning by distribution matching","author":"A Gretton","year":"2009","unstructured":"Gretton A, Smola A, Huang J, Schmittfull M, Borgwardt K, Sch\u00f6lkopf B (2009) Covariate shift and local learning by distribution matching. MIT Press, Cambridge, pp 131\u2013160"},{"issue":"10","key":"1325_CR4","doi-asserted-by":"publisher","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","volume":"22","author":"S Pan","year":"2010","unstructured":"Pan S, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345\u20131359","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"1325_CR5","doi-asserted-by":"publisher","DOI":"10.1007\/s11063-022-10977-5","author":"M Hassan Pour Zonoozi","year":"2022","unstructured":"Hassan Pour Zonoozi M, Seydi V (2022) A survey on adversarial domain adaptation. Neural Process Lett. https:\/\/doi.org\/10.1007\/s11063-022-10977-5","journal-title":"Neural Process Lett"},{"key":"1325_CR6","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.neucom.2018.05.083","volume":"312","author":"M Wang","year":"2018","unstructured":"Wang M, Deng W (2018) Deep visual domain adaptation: a survey. Neurocomput 312:135\u2013153. https:\/\/doi.org\/10.1016\/j.neucom.2018.05.083","journal-title":"Neurocomput"},{"issue":"19","key":"1325_CR7","doi-asserted-by":"publisher","first-page":"3283","DOI":"10.1049\/iet-ipr.2020.0087","volume":"14","author":"Y Madadi","year":"2020","unstructured":"Madadi Y, Seydi V, Nasrollahi K, Hosseini R, Moeslund T (2020) Deep visual unsupervised domain adaptation for classification tasks: a survey. IET Image Proc. 14(19):3283\u20133299","journal-title":"IET Image Proc."},{"issue":"1","key":"1325_CR8","first-page":"723","volume":"13","author":"A Gretton","year":"2012","unstructured":"Gretton A, Borgwardt K, Rasch MJ, Sch\u00f6lkopf B, Smola A (2012) A kernel two-sample test. J Mach Learning Res 13(1):723\u2013773","journal-title":"J Mach Learning Res"},{"key":"1325_CR9","doi-asserted-by":"crossref","unstructured":"Ghifary M, Kleijn WB, Zhang M, Balduzzi D, Li W (2016) Deep reconstruction classification networks for unsupervised domain adaptation. In: European Conference on Computer Vision., pp. 597\u2013613","DOI":"10.1007\/978-3-319-46493-0_36"},{"key":"1325_CR10","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1007\/978-3-319-58347-1_10","volume":"17","author":"G Ganin","year":"2017","unstructured":"Ganin G, Ustinova Y, Ajakan H, Germain P, Larochelle H, Laviolette F, Marchand M, Lempitsky V (2017) Domain-adversarial training of neural networks. Adv Comput Vis Pattern Recognit 17:189\u2013209","journal-title":"Adv Comput Vis Pattern Recognit"},{"key":"1325_CR11","doi-asserted-by":"publisher","unstructured":"Tzeng E, Hoffman J, Saenko K, Darrell T (2017) Adversarial discriminative domain adaptation. In: Proceedings of the 30th IEEE conference on computer vision pattern recognition, CVPR. 316, pp. 2962\u20132971 https:\/\/doi.org\/10.1109\/CVPR.2017.316","DOI":"10.1109\/CVPR.2017.316"},{"issue":"11","key":"1325_CR12","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1145\/3422622","volume":"63","author":"I Goodfellow","year":"2014","unstructured":"Goodfellow I, Pouget-Abadie J, Mirza M, Balduzzi D, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial networks. Commun ACM. 63(11):139\u2013144. https:\/\/doi.org\/10.1145\/3422622","journal-title":"Commun ACM."},{"key":"1325_CR13","doi-asserted-by":"publisher","unstructured":"Volpi R, Morerio P, Savarese S, Murino V (2018) Adversarial feature augmentation for unsupervised domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition., pp. 5495\u20135504 https:\/\/doi.org\/10.1109\/CVPR.2018.00576","DOI":"10.1109\/CVPR.2018.00576"},{"key":"1325_CR14","doi-asserted-by":"crossref","unstructured":"Laradji I, Babanezhad R (2018) M-adda: unsupervised domain adaptation with deep metric learning. Domain Adapt Vis Underst., pp. 17\u201331","DOI":"10.1007\/978-3-030-30671-7_2"},{"key":"1325_CR15","doi-asserted-by":"crossref","unstructured":"Pei Z, Cao Z, Long M, Wang J (2018) Multi-adversarial domain adaptation. In: 32nd AAAI conference on artificial intelligence AAAI., pp. 3934\u20133941","DOI":"10.1609\/aaai.v32i1.11767"},{"key":"1325_CR16","unstructured":"Wang Z, Jing B, Ni Y, Dong N, Xie P, Xing EP (2020) Adversarial domain adaptation being aware of class relationships. In: European conference on artificial intelligence"},{"key":"1325_CR17","unstructured":"Yuntao D, Zhiwen T, Qian C, Xiaowen Z, Yirong Y, Chongjun W (2020) Dual adversarial domain adaptation. arXiv. preprintarXiv:2001.00153"},{"key":"1325_CR18","unstructured":"Kingma D, Welling M (2014) Auto-encoding variational bayes. ICML"},{"key":"1325_CR19","unstructured":"Wilson G, Cook D (2018) A survey of unsupervised deep domain adaptation. arXiv"},{"key":"1325_CR20","unstructured":"Tzeng E, Hoffman J, Zhang N, Saenko K, Darrell T (2014) Deep domain confusion: maximizing for domain invariance. CoRR. abs\/1412.3474"},{"key":"1325_CR21","unstructured":"Long M, Cao Y, Wang J, Jordan M (2015) Learning transferable features with deep adaptation networks. In: International Conference on Machine Learning., pp. 97\u2013105"},{"key":"1325_CR22","doi-asserted-by":"crossref","unstructured":"Sun B, Saenko K (2016) Deep coral: correlation alignment for deep domain adaptation. In: European Conference on Computer Vision. Springer., pp. 443\u2013450","DOI":"10.1007\/978-3-319-49409-8_35"},{"key":"1325_CR23","doi-asserted-by":"crossref","unstructured":"Shen J, Qu Y, Zhang W, Yu Y (2018) Wasserstein distance guided representation learning for domain adaptation. In: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence., pp. 4058\u20134065","DOI":"10.1609\/aaai.v32i1.11784"},{"issue":"1","key":"1325_CR24","first-page":"57","volume":"11","author":"Y Madadi","year":"2020","unstructured":"Madadi Y, Seydi V, Tuzel O (2020) Deep unsupervised domain adaptation for image classification via low rank representation learning. J Adv Comput Res 11(1):57\u201367","journal-title":"J Adv Comput Res"},{"key":"1325_CR25","unstructured":"Shui C, Li Z, Li J, Gagn\u00b4e C, Ling CX, Wang B (2021) Aggregating from multiple target-shifted sources. In: Proceedings of the 38th International conference on machine learning. Proceedings of machine learning research, vol 139, pp 9638\u20139648. PMLR"},{"key":"1325_CR26","unstructured":"Mirza M, Osindero S (2014) Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784"},{"key":"1325_CR27","unstructured":"Liu MY, Tuzel O (2016) Coupled generative adversarial networks. In: Advances in neural information processing systems, vol 29. Curran Associates, Inc, pp 469\u2013477"},{"key":"1325_CR28","doi-asserted-by":"crossref","unstructured":"Wang J, Jiang J (2020) Conditional coupled generative adversarial networks for zero-shot domain adaptation. In: Proceedings of the IEEE\/CVF International conference on computer vision., pp. 3375\u20133384","DOI":"10.1109\/ICCV.2019.00347"},{"key":"1325_CR29","doi-asserted-by":"crossref","unstructured":"Sankaranarayanan S, Balaji Y, Castillo C, Chellappa R (2018) Generate to adapt: aligning domains using generative adversarial networks. Computer vision and pattern recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 8503-8512","DOI":"10.1109\/CVPR.2018.00887"},{"key":"1325_CR30","doi-asserted-by":"crossref","unstructured":"Hu L, Kan M, Shan S, Chen X (2018) Duplex generative adversarial network for unsupervised domain adaptation. In: IEEE\/CVF conference on computer vision and pattern recognition., pp. 1498\u20131507","DOI":"10.1109\/CVPR.2018.00162"},{"issue":"10","key":"1325_CR31","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.109808","volume":"257","author":"C Shui","year":"2022","unstructured":"Shui C, Chen Q, Wen J, Zhou F, Gagn\u00e9 C, Wang B (2022) A novel domain adaptation theory with Jensen-Shannon divergence. Knowl-Based Syst 257(10):109808","journal-title":"Knowl-Based Syst"},{"issue":"10","key":"1325_CR32","doi-asserted-by":"publisher","first-page":"10140","DOI":"10.1109\/TKDE.2023.3266785","volume":"35","author":"C Shui","year":"2023","unstructured":"Shui C, Pu R, Xu G, Wen J, Zhou F, Gagn\u00e9 C, Ling CX, Wang B (2023) Towards more general loss and setting in unsupervised domain adaptation. IEEE Trans Knowl Data Eng 35(10):10140\u201310150. https:\/\/doi.org\/10.1109\/TKDE.2023.3266785","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"4","key":"1325_CR33","doi-asserted-by":"publisher","first-page":"2193","DOI":"10.1109\/TCYB.2023.3236008","volume":"54","author":"K Li","year":"2024","unstructured":"Li K, Lu J, Zuo H, Zhang G (2024) Multidomain adaptation with sample and source distillation. IEEE Trans Cybern 54(4):2193\u20132205. https:\/\/doi.org\/10.1109\/TCYB.2023.3236008","journal-title":"IEEE Trans Cybern"},{"issue":"12","key":"1325_CR34","doi-asserted-by":"publisher","first-page":"4180","DOI":"10.1109\/TFUZZ.2023.3276978","volume":"31","author":"K Li","year":"2023","unstructured":"Li K, Lu J, Zuo H, Zhang G (2023) Source-free multidomain adaptation with fuzzy rule-based deep neural networks. IEEE Trans Fuzzy Syst 31(12):4180\u20134194. https:\/\/doi.org\/10.1109\/TFUZZ.2023.3276978","journal-title":"IEEE Trans Fuzzy Syst"},{"key":"1325_CR35","unstructured":"Rezende DJ, Mohamed S, Wierstra D (2014) Stochastic backpropagation and approximate inference in deep generative models. In: Proceedings of the 31st International conference on machine learning (ICML)"},{"key":"1325_CR36","unstructured":"Carl D (2016) Tutorial on variational autoencoders. arXiv. preprintarXiv:1606.05908"},{"key":"1325_CR37","doi-asserted-by":"publisher","first-page":"859","DOI":"10.1080\/01621459.2017.1285773","volume":"112","author":"D Blei","year":"2017","unstructured":"Blei D, Kucukelbir A, McAuliffe J (2017) Variational inference: a review for statisticians. J Am Stat Assoc 112:859\u2013877","journal-title":"J Am Stat Assoc"},{"issue":"11","key":"1325_CR38","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y LeCun","year":"1998","unstructured":"LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient based learning applied to document recognition. Proc IEEE 86(11):2278\u20132324","journal-title":"Proc IEEE"},{"key":"1325_CR39","unstructured":"Denker JS, Gardner W, Graf HP, Henderson D, Howard RE, Hubbard W, Jackel LD, Baird HS, Guyon I (1988) Neural network recognizer for handwritten zip code digits. In: Advances in neural information processing systems, vol 1, pp 323\u2013331"},{"key":"1325_CR40","unstructured":"Netzer Y, Wang T, Coates A, Bissacco A, Wu B, Ng AY (2011) Reading digits in natural images with unsupervised feature learning. NIPS workshop on deep learning and unsupervised feature learning. p. 5"},{"key":"1325_CR41","first-page":"2579","volume":"9","author":"L Maaten","year":"2008","unstructured":"Maaten L, Hinton G (2008) Visualizing high dimensional data using t-SNE. J Mach Learn Res 9:2579\u20132605","journal-title":"J Mach Learn Res"},{"issue":"8","key":"1325_CR42","doi-asserted-by":"publisher","first-page":"2027","DOI":"10.1109\/TKDE.2016.2554549","volume":"28","author":"M Long","year":"2016","unstructured":"Long M, Wang J, Cao Y, Sun J, Philip SY (2016) Deep learning of transferable representation for scalable domain adaptation. IEEE Trans Knowl Data Eng 28(8):2027\u20132040","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"1325_CR43","doi-asserted-by":"crossref","unstructured":"Long M, Wang J, Ding G, Sun J, Yu PS (2013) Transfer feature learning with joint distribution adaptation. In: IEEE International Conference on Computer Vision., pp. 2200\u20132207","DOI":"10.1109\/ICCV.2013.274"},{"key":"1325_CR44","unstructured":"Ioffe S, Szegedy C (2015) Accelerating deep network training by reducing internal covariate shift. CoRR. abs\/1502.03167"},{"key":"1325_CR45","unstructured":"Nair V, Hinton GE (2010) Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10). Omnipress, pp. 807\u2013814"},{"issue":"1","key":"1325_CR46","first-page":"1929","volume":"15","author":"N Srivastava","year":"2014","unstructured":"Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn 15(1):1929\u20131958","journal-title":"J. Mach. Learn"},{"key":"1325_CR47","unstructured":"Kingma DP, Adam JB (2014) A method for stochastic optimization. CoRR. abs\/1412.6980"},{"key":"1325_CR48","first-page":"343","volume":"29","author":"K Bousmalis","year":"2016","unstructured":"Bousmalis K, Trigeorgis G, Silberman N, Krishnan D, Erhan D (2016) Domain separation networks. Adv Neural Inf Process Syst 29:343\u2013351","journal-title":"Adv Neural Inf Process Syst"},{"key":"1325_CR49","first-page":"700","volume":"30","author":"MY Liu","year":"2017","unstructured":"Liu MY, Breuel T, Kautz J (2017) Unsupervised image-to image translation networks. Adv Neural Inf Process Syst 30:700\u2013708","journal-title":"Adv Neural Inf Process Syst"},{"key":"1325_CR50","doi-asserted-by":"publisher","unstructured":"Lee S, Cho S, Im S (2021) Dranet: disentangling representation and adaptation networks for unsupervised cross-domain adaptation. In: Proceedings - 2021 IEEE\/CVF conference on computer vision and pattern recognition, CVPR 2021, pp 15247\u201315256. IEEE Computer Society. https:\/\/doi.org\/10.1109\/CVPR46437.2021.01500","DOI":"10.1109\/CVPR46437.2021.01500"},{"key":"1325_CR51","first-page":"1640","volume":"31","author":"M Long","year":"2018","unstructured":"Long M, Cao Z, Wang J, Jordan MI (2018) Conditional adversarial domain adaptation. Adv Neural Inf Process Syst 31:1640\u20131650","journal-title":"Adv Neural Inf Process Syst"}],"container-title":["Pattern Analysis and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10044-024-01325-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10044-024-01325-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10044-024-01325-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T09:30:55Z","timestamp":1734341455000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10044-024-01325-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,30]]},"references-count":51,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["1325"],"URL":"https:\/\/doi.org\/10.1007\/s10044-024-01325-5","relation":{},"ISSN":["1433-7541","1433-755X"],"issn-type":[{"type":"print","value":"1433-7541"},{"type":"electronic","value":"1433-755X"}],"subject":[],"published":{"date-parts":[[2024,9,30]]},"assertion":[{"value":"19 April 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 August 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 September 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no Conflict of interest to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not Applicable","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Not Applicable","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not Applicable","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}],"article-number":"130"}}