{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T21:43:06Z","timestamp":1775079786092,"version":"3.50.1"},"reference-count":65,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2022,9,21]],"date-time":"2022-09-21T00:00:00Z","timestamp":1663718400000},"content-version":"vor","delay-in-days":1,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["52238011"],"award-info":[{"award-number":["52238011"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"publisher","award":["2019YFC1509305"],"award-info":[{"award-number":["2019YFC1509305"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100015803","name":"Tencent","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100015803","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,10,22]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>There are numerous advantages of deep neural network surrogate modeling for response time-history prediction. However, due to the high cost of refined numerical simulations and actual experiments, the lack of data has become an unavoidable bottleneck in practical applications. An iterative self-transfer learning method for training neural networks based on small datasets is proposed in this study. A new mapping-based transfer learning network, named as deep adaptation network with three branches for regression (DAN-TR), is proposed. A general iterative network training strategy is developed by coupling DAN-TR and the pseudo-label strategy, and the establishment of corresponding datasets is also discussed. Finally, a complex component is selected as a case study. The results show that the proposed method can improve the model performance by near an order of magnitude on small datasets without the need of external labeled samples, well behaved pre-trained models, additional artificial labeling, and complex physical\/mathematical analysis.<\/jats:p>","DOI":"10.1093\/jcde\/qwac098","type":"journal-article","created":{"date-parts":[[2022,9,21]],"date-time":"2022-09-21T20:47:03Z","timestamp":1663793223000},"page":"2089-2102","source":"Crossref","is-referenced-by-count":7,"title":["Iterative self-transfer learning: A general methodology for response time-history prediction based on small dataset"],"prefix":"10.1093","volume":"9","author":[{"given":"Yongjia","family":"Xu","sequence":"first","affiliation":[{"name":"Zhejiang University\u2013University of Illinois at Urbana Champaign Institute, Zhejiang University , Zhejiang, 314400, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3313-7420","authenticated-orcid":false,"given":"Xinzheng","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, Tsinghua University , Beijing, 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yifan","family":"Fei","sequence":"additional","affiliation":[{"name":"Beijing Engineering Research Center of Steel and Concrete Composite Structures, Tsinghua University , Beijing, 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuli","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, Tsinghua University , Beijing, 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2022,9,20]]},"reference":[{"key":"2022110904481004700_bib1","article-title":"Mixmatch: A holistic approach to semi-supervised learning","volume-title":"Proceedings of the 33rd International Conference on Neural Information Processing Systems (NIPS)","author":"Berthelot","year":"2019"},{"key":"2022110904481004700_bib2","article-title":"Language models are few-shot learners","volume-title":"Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS)","author":"Brown","year":"2020"},{"issue":"4","key":"2022110904481004700_bib3","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1111\/mice.12495","article-title":"A deep learning algorithm for simulating autonomous driving considering prior knowledge and temporal information","volume":"35","author":"Chen","year":"2020","journal-title":"Computer-Aided Civil and Infrastructure Engineering"},{"key":"2022110904481004700_bib4","doi-asserted-by":"crossref","first-page":"2147","DOI":"10.18653\/v1\/2020.acl-main.194","article-title":"Mixtext: Linguistically-informed interpolation of hidden space for semi-supervised text classification","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Chen","year":"2020"},{"key":"2022110904481004700_bib5","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1109\/TASLP.2020.3036611","article-title":"A deep adaptation network for speech enhancement: Combining a relativistic discriminator with multi-kernel maximum mean discrepancy","volume":"29","author":"Cheng","year":"2021","journal-title":"IEEE\/ACM Transactions on Audio, Speech, and Language Processing"},{"key":"2022110904481004700_bib6","doi-asserted-by":"crossref","first-page":"3008","DOI":"10.1109\/CVPRW50498.2020.00359","article-title":"Randaugment: Practical automated data augmentation with a reduced search space","volume-title":"Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)","author":"Cubuk","year":"2020"},{"key":"2022110904481004700_bib7","doi-asserted-by":"crossref","first-page":"2978","DOI":"10.18653\/v1\/P19-1285","article-title":"Transformer-XL: Attentive language models beyond a fixed-length context","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Dai","year":"2019"},{"key":"2022110904481004700_bib8","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1109\/CVPR.2009.5206848","article-title":"ImageNet: A large-scale hierarchical image database","volume-title":"Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Deng","year":"2009"},{"key":"2022110904481004700_bib9","first-page":"4171","article-title":"Bert: Pre-training of deep bidirectional transformers for language understanding","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Devlin","year":"2019"},{"issue":"1","key":"2022110904481004700_bib10","first-page":"2096","article-title":"Domain-adversarial training of neural networks","volume":"17","author":"Ganin","year":"2016","journal-title":"The Journal of Machine Learning Research"},{"issue":"9","key":"2022110904481004700_bib11","doi-asserted-by":"crossref","first-page":"748","DOI":"10.1111\/mice.12363","article-title":"Deep transfer learning for image-based structural damage recognition","volume":"33","author":"Gao","year":"2018","journal-title":"Computer-Aided Civil and Infrastructure Engineering"},{"key":"2022110904481004700_bib12","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.conbuildmat.2017.09.110","article-title":"Deep convolutional neural networks with transfer learning for computer vision-based data-driven pavement distress detection","volume":"157","author":"Gopalakrishnan","year":"2017","journal-title":"Construction and Building Materials"},{"key":"2022110904481004700_bib13","doi-asserted-by":"crossref","first-page":"102447","DOI":"10.1016\/j.tafmec.2019.102447","article-title":"Transfer learning enhanced physics informed neural network for phase-field modeling of fracture","volume":"106","author":"Goswami","year":"2020","journal-title":"Theoretical and Applied Fracture Mechanics"},{"key":"2022110904481004700_bib14","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-24797-2","volume-title":"Supervised sequence labelling with recurrent neural networks","author":"Graves","year":"2012"},{"issue":"8","key":"2022110904481004700_bib15","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Computation"},{"key":"2022110904481004700_bib16","volume-title":"Simulating the inelastic seismic behavior of steel braced frames including the effects of low-cycle fatigue","author":"Huang","year":"2009"},{"key":"2022110904481004700_bib17","doi-asserted-by":"crossref","first-page":"8506","DOI":"10.1109\/ICCV48922.2021.00841","article-title":"Towards discriminative representation learning for unsupervised person re-identification","volume-title":"Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"Isobe","year":"2021"},{"issue":"2","key":"2022110904481004700_bib18","doi-asserted-by":"crossref","first-page":"04017082","DOI":"10.1061\/(ASCE)CP.1943-5487.0000731","article-title":"Detecting construction equipment using a region-based fully convolutional network and transfer learning","volume":"32","author":"Kim","year":"2018","journal-title":"Journal of Computing in Civil Engineering"},{"key":"2022110904481004700_bib19","article-title":"Adam: A method for stochastic optimization","volume-title":"Proceedings of the 3rd International Conference for Learning Representations (ICLR)","author":"Kingma","year":"2014"},{"key":"2022110904481004700_bib20","volume-title":"Learning multiple layers of features from tiny images","author":"Krizhevsky","year":"2009"},{"key":"2022110904481004700_bib21","volume-title":"Seismic evaluation and retrofit of existing tall buildings in California: Case study of a 35-story steel moment resisting frame building in San Francisco","author":"Lai","year":"2015"},{"key":"2022110904481004700_bib22","article-title":"Temporal ensembling for semi-supervised learning","volume-title":"Proceedings of the 5th International Conference on Learning Representations","author":"Laine","year":"2017"},{"key":"2022110904481004700_bib23","first-page":"896","article-title":"Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks","volume-title":"Proceedings of the Workshop on Challenges in Representation Learning","author":"Lee","year":"2013"},{"issue":"1","key":"2022110904481004700_bib24","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1093\/jcde\/qwab072","article-title":"Dataset and method for deep learning-based reconstruction of 3D CAD models containing machining features for mechanical parts","volume":"9","author":"Lee","year":"2022","journal-title":"Journal of Computational Design and Engineering"},{"issue":"4","key":"2022110904481004700_bib25","doi-asserted-by":"crossref","first-page":"526","DOI":"10.1061\/(ASCE)ST.1943-541X.0000664","article-title":"Simulation of steel brace hysteretic response using the force analogy method","volume":"139","author":"Li","year":"2013","journal-title":"Journal of Structural Engineering-ASCE"},{"key":"2022110904481004700_bib26","article-title":"RoBERTa: A robustly optimized BERT pretraining approach","author":"Liu","year":"2019"},{"key":"2022110904481004700_bib27","volume-title":"Transfer learning: Problems and methods","author":"Long","year":"2014"},{"key":"2022110904481004700_bib28","article-title":"Learning transferable features with deep adaptation networks","volume-title":"Proceedings of the 32nd International Conference on Machine Learning (ICML)","author":"Long","year":"2015"},{"key":"2022110904481004700_bib29","article-title":"Deep transfer learning with joint adaptation networks","volume-title":"Proceedings of the 34th International Conference on Machine Learning (ICML)","author":"Long","year":"2017"},{"key":"2022110904481004700_bib30","article-title":"Learning multiple tasks with multilinear relationship networks","volume-title":"Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS)","author":"Long","year":"2017"},{"issue":"3","key":"2022110904481004700_bib31","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1109\/TPAMI.2015.2452921","article-title":"Contrastive pessimistic likelihood estimation for semi-supervised classification","volume":"38","author":"Loog","year":"2015","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"6","key":"2022110904481004700_bib32","doi-asserted-by":"crossref","first-page":"1612","DOI":"10.1002\/eqe.3415","article-title":"A deep learning approach to rapid regional post-event seismic damage assessment using time-frequency distributions of ground motions","volume":"50","author":"Lu","year":"2021","journal-title":"Earthquake Engineering & Structural Dynamics"},{"issue":"7-8","key":"2022110904481004700_bib33","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1177\/1077546320933756","article-title":"An improved linear quadratic regulator control method through convolutional neural network-based vibration identification","volume":"27","author":"Lu","year":"2021","journal-title":"Journal of Vibration and Control"},{"key":"2022110904481004700_bib34","doi-asserted-by":"crossref","first-page":"1930","DOI":"10.1145\/3219819.3220007","article-title":"Modeling task relationships in multi-task learning with multi-gate mixture-of-experts","volume-title":"Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD)","author":"Ma","year":"2018"},{"key":"2022110904481004700_bib35","doi-asserted-by":"crossref","first-page":"3994","DOI":"10.1109\/CVPR.2016.433","article-title":"Cross-stitch networks for multi-task learning","volume-title":"Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Misra","year":"2016"},{"issue":"15","key":"2022110904481004700_bib36","doi-asserted-by":"crossref","first-page":"2811","DOI":"10.1002\/eqe.2932","article-title":"Finite element analysis of damage and failure of reinforced concrete members under earthquake loading","volume":"46","author":"Moharrami","year":"2017","journal-title":"Earthquake Engineering & Structural Dynamics"},{"key":"2022110904481004700_bib37","volume-title":"The NIED strong-motion seismograph networks","author":"NIED","year":"2021"},{"key":"2022110904481004700_bib38","volume-title":"PEER NGA database (NGA-West, NGA-West2, NGA-East)","author":"Pacific Earthquake Engineering Research Center (PEER)","year":"2021"},{"key":"2022110904481004700_bib39","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1016\/j.matdes.2012.03.002","article-title":"Artificial neural network modeling to predict the high temperature flow behavior of an AZ81 magnesium alloy","volume":"39","author":"Sabokpa","year":"2012","journal-title":"Materials & Design"},{"issue":"2","key":"2022110904481004700_bib40","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1111\/mice.12579","article-title":"Detecting safety helmet wearing on construction sites with bounding-box regression and deep transfer learning","volume":"36","author":"Shen","year":"2021","journal-title":"Computer-Aided Civil and Infrastructure Engineering"},{"issue":"2","key":"2022110904481004700_bib41","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1093\/jcde\/qwac029","article-title":"Supervised segmentation with domain adaptation for small sampled orbital CT images","volume":"9","author":"Suh","year":"2022","journal-title":"Journal of Computational Design and Engineering"},{"key":"2022110904481004700_bib42","article-title":"ERNIE 3.0: Large-scale knowledge enhanced pre-training for language understanding and generation","author":"Sun","year":"2021","journal-title":"arXiv preprint"},{"key":"2022110904481004700_bib43","first-page":"270","article-title":"A survey on deep transfer learning","volume-title":"Proceedings of the 27th International Conference on Artificial Neural Networks (ICANN)","author":"Tan","year":"2018"},{"key":"2022110904481004700_bib44","article-title":"Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS)","author":"Tarvainen","year":"2017"},{"issue":"5","key":"2022110904481004700_bib45","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1109\/LGRS.2019.2931063","article-title":"Classification of isolated volcano-seismic events based on inductive transfer learning","volume":"17","author":"Titos","year":"2019","journal-title":"IEEE Geoscience and Remote Sensing Letters"},{"key":"2022110904481004700_bib46","article-title":"Deep domain confusion: Maximizing for domain invariance","author":"Tzeng","year":"2014","journal-title":"arXiv preprint"},{"key":"2022110904481004700_bib47","doi-asserted-by":"crossref","first-page":"4068","DOI":"10.1109\/ICCV.2015.463","article-title":"Simultaneous deep transfer across domains and tasks","volume-title":"Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV)","author":"Tzeng","year":"2015"},{"key":"2022110904481004700_bib48","volume-title":"Toward earthquake-resistant design of concentrically braced steel-frame structures","author":"Uriz","year":"2008"},{"issue":"4","key":"2022110904481004700_bib49","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1093\/jcde\/qwab030","article-title":"Intervertebral disc instance segmentation using a multistage optimization mask-RCNN (MOM-RCNN)","volume":"8","author":"Vania","year":"2021","journal-title":"Journal of Computational Design and Engineering"},{"key":"2022110904481004700_bib50","doi-asserted-by":"crossref","first-page":"113357","DOI":"10.1016\/j.cma.2020.113357","article-title":"A general deep learning framework for history-dependent response prediction based on UA-Seq2Seq model","volume":"372","author":"Wang","year":"2020","journal-title":"Computer Methods in Applied Mechanics and Engineering"},{"key":"2022110904481004700_bib51","volume-title":"Transfer learning (GitHub repository)","author":"Wang","year":"2021"},{"key":"2022110904481004700_bib52","doi-asserted-by":"crossref","first-page":"8990","DOI":"10.1109\/ICCV48922.2021.00888","article-title":"Adaptive adversarial network for source-free domain adaptation","volume-title":"Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"Xia","year":"2021"},{"key":"2022110904481004700_bib53","first-page":"6256","article-title":"Unsupervised data augmentation for consistency training","volume":"33","author":"Xie","year":"2020","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"6","key":"2022110904481004700_bib54","doi-asserted-by":"crossref","first-page":"1158","DOI":"10.1109\/TKDE.2017.2669193","article-title":"A unified framework for metric transfer learning","volume":"29","author":"Xu","year":"2017","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"4","key":"2022110904481004700_bib56","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1111\/mice.12628","article-title":"Real-time regional seismic damage assessment framework based on long short-term memory neural network","volume":"36","author":"Xu","year":"2021","journal-title":"Computer-Aided Civil and Infrastructure Engineering"},{"key":"2022110904481004700_bib55","doi-asserted-by":"crossref","first-page":"4259","DOI":"10.1080\/13632469.2020.1826371","article-title":"Real-time seismic damage prediction and comparison of various ground motion intensity measures based on machine learning","volume":"26","author":"Xu","year":"2022","journal-title":"Journal of Earthquake Engineering"},{"key":"2022110904481004700_bib57","doi-asserted-by":"crossref","first-page":"1792","DOI":"10.1016\/j.istruc.2022.05.097","article-title":"Advanced corrective training strategy for surrogating complex hysteretic behavior","volume":"41","author":"Xu","year":"2022","journal-title":"Structures"},{"key":"2022110904481004700_bib59","doi-asserted-by":"crossref","first-page":"945","DOI":"10.1109\/CVPR.2017.107","article-title":"Mind the class weight bias: Weighted maximum mean discrepancy for unsupervised domain adaptation","volume-title":"Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Yan","year":"2017"},{"key":"2022110904481004700_bib58","first-page":"1855","article-title":"Boosting for transfer learning with multiple sources","volume-title":"Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Yao","year":"2010"},{"key":"2022110904481004700_bib60","article-title":"How transferable are features in deep neural networks?","volume-title":"Proceedings of the 28th Conference on Neural Information Processing Systems (NIPS)","author":"Yosinski","year":"2014"},{"key":"2022110904481004700_bib61","doi-asserted-by":"crossref","DOI":"10.1109\/ICDM.2019.00088","article-title":"Transfer learning with dynamic adversarial adaptation network","volume-title":"Proceedings of the 2019 IEEE International Conference on Data Mining (ICDM)","author":"Yu","year":"2019"},{"key":"2022110904481004700_bib62","article-title":"Deep transfer network: Unsupervised domain adaptation","author":"Zhang","year":"2015","journal-title":"arXiv preprint"},{"key":"2022110904481004700_bib63","article-title":"Mixup: Beyond empirical risk minimization","volume-title":"Proceedings of 6th International Conference on Learning Representations (ICLR)","author":"Zhang","year":"2017"},{"key":"2022110904481004700_bib64","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.compstruc.2019.05.006","article-title":"Deep long short-term memory networks for nonlinear structural seismic response prediction","volume":"220","author":"Zhang","year":"2019","journal-title":"Computers & Structures"},{"key":"2022110904481004700_bib65","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1016\/j.compstruc.2016.12.012","article-title":"Numerical characterisation of uncured elastomers by a neural network based approach","volume":"182","author":"Zopf","year":"2017","journal-title":"Computers & Structures"}],"container-title":["Journal of Computational Design and Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jcde\/advance-article-pdf\/doi\/10.1093\/jcde\/qwac098\/45956240\/qwac098.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/9\/5\/2089\/46878028\/qwac098.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jcde\/article-pdf\/9\/5\/2089\/46878028\/qwac098.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,9]],"date-time":"2022-11-09T04:49:00Z","timestamp":1667969340000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jcde\/article\/9\/5\/2089\/6708375"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,20]]},"references-count":65,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,10,22]]}},"URL":"https:\/\/doi.org\/10.1093\/jcde\/qwac098","relation":{},"ISSN":["2288-5048"],"issn-type":[{"value":"2288-5048","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,10]]},"published":{"date-parts":[[2022,9,20]]}}}