{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T05:10:09Z","timestamp":1760764209177,"version":"build-2065373602"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2025,10,6]],"date-time":"2025-10-06T00:00:00Z","timestamp":1759708800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"},{"start":{"date-parts":[[2025,10,6]],"date-time":"2025-10-06T00:00:00Z","timestamp":1759708800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"}],"funder":[{"DOI":"10.13039\/100005744","name":"Maine Space Grant Consortium","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100005744","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000143","name":"Division of Computing and Communication Foundations","doi-asserted-by":"publisher","award":["2451457"],"award-info":[{"award-number":["2451457"]}],"id":[{"id":"10.13039\/100000143","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Process Lett"],"DOI":"10.1007\/s11063-025-11758-6","type":"journal-article","created":{"date-parts":[[2025,10,6]],"date-time":"2025-10-06T08:57:20Z","timestamp":1759741040000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Ghost-Connect Net: A Generalization-Enhanced Guidance for Sparse Deep Networks Under Distribution Shifts"],"prefix":"10.1007","volume":"57","author":[{"given":"Mary","family":"Wisell","sequence":"first","affiliation":[]},{"given":"Salimeh","family":"Sekeh","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,10,6]]},"reference":[{"key":"11758_CR1","doi-asserted-by":"crossref","unstructured":"Bechtel MG, McEllhiney E, Kim M, Yun H (2018) Deeppicar: a low-cost deep neural network-based autonomous car. In: 2018 IEEE 24th international conference on embedded and real-time computing systems and applications (RTCSA), pp. 11\u201321. IEEE","DOI":"10.1109\/RTCSA.2018.00011"},{"key":"11758_CR2","doi-asserted-by":"publisher","first-page":"102021","DOI":"10.1109\/ACCESS.2019.2926040","volume":"7","author":"L Fridman","year":"2019","unstructured":"Fridman L, Brown DE, Glazer M, Angell W, Dodd S, Jenik B, Terwilliger J, Patsekin A, Kindelsberger J, Ding L et al (2019) Mit advanced vehicle technology study: large-scale naturalistic driving study of driver behavior and interaction with automation. IEEE Access 7:102021\u2013102038","journal-title":"IEEE Access"},{"key":"11758_CR3","doi-asserted-by":"publisher","first-page":"38","DOI":"10.3389\/frsc.2020.00038","volume":"2","author":"F Cugurullo","year":"2020","unstructured":"Cugurullo F (2020) Urban artificial intelligence: from automation to autonomy in the smart city. Front Sustain Cities 2:38","journal-title":"Front Sustain Cities"},{"key":"11758_CR4","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1613\/jair.1.12007","volume":"69","author":"F Stahlberg","year":"2020","unstructured":"Stahlberg F (2020) Neural machine translation: a review. J Artif Intell Res 69:343\u2013418","journal-title":"J Artif Intell Res"},{"key":"11758_CR5","doi-asserted-by":"crossref","unstructured":"Yoo H, Han S, Chung K (2020) A frequency pattern mining model based on deep neural network for real-time classification of heart conditions. In: Healthcare, vol. 8, p. 234. MDPI","DOI":"10.3390\/healthcare8030234"},{"key":"11758_CR6","unstructured":"Akbari A, Awais M, Bashar M, Kittler J (2021) How does loss function affect generalization performance of deep learning? application to human age estimation. In: international conference on machine learning, pp. 141\u2013151. PMLR"},{"issue":"3","key":"11758_CR7","doi-asserted-by":"publisher","first-page":"1603","DOI":"10.1109\/TPAMI.2022.3187079","volume":"46","author":"A Akbari","year":"2022","unstructured":"Akbari A, Awais M, Fatemifar S, Khalid SS, Kittler J (2022) Rage: robust age estimation through subject anchoring with consistency regularisation. IEEE Trans Pattern Anal Mach Intell 46(3):1603\u20131617","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"11758_CR8","unstructured":"Wen W, Wu C, Wang Y, Chen Y, Li H (2016) Learning structured sparsity in deep neural networks. Adv Neural Inf Process Syst 29"},{"key":"11758_CR9","doi-asserted-by":"crossref","unstructured":"Han K, Wang Y, Tian Q, Guo J, Xu C, Xu C (2020) Ghostnet: more features from cheap operations. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp. 1580\u20131589","DOI":"10.1109\/CVPR42600.2020.00165"},{"key":"11758_CR10","unstructured":"Gale T, Elsen E, Hooker S (2019) The state of sparsity in deep neural networks. arXiv preprint arXiv:1902.09574"},{"key":"11758_CR11","first-page":"664","volume":"34","author":"J Diffenderfer","year":"2021","unstructured":"Diffenderfer J, Bartoldson B, Chaganti S, Zhang J, Kailkhura B (2021) A winning hand: compressing deep networks can improve out-of-distribution robustness. Adv Neural Inf Process Syst 34:664\u2013676","journal-title":"Adv Neural Inf Process Syst"},{"issue":"Suppl 1","key":"11758_CR12","doi-asserted-by":"publisher","first-page":"1513","DOI":"10.1007\/s10462-023-10562-9","volume":"56","author":"J Gawlikowski","year":"2023","unstructured":"Gawlikowski J, Tassi CRN, Ali M, Lee J, Humt M, Feng J, Kruspe A, Triebel R, Jung P, Roscher R et al (2023) A survey of uncertainty in deep neural networks. Artif Intell Rev 56(Suppl 1):1513\u20131589","journal-title":"Artif Intell Rev"},{"key":"11758_CR13","unstructured":"Hooker S, Courville A, Clark G, Dauphin Y, Frome A (2019) What do compressed deep neural networks forget?"},{"key":"11758_CR14","unstructured":"Aditi\u00a0Raghunathan A, Michael S, Xie MX, Yang F, Duchi J, Liang P (2022) Understanding and mitigating the tradeoff between robustness and accuracy. In: Proceedings of the 37th international conference on machine Learning, PMLR"},{"key":"11758_CR15","unstructured":"Hendrycks D, Dietterich T (2018) Benchmarking neural network robustness to common corruptions and perturbations. In: International conference on learning representations"},{"key":"11758_CR16","unstructured":"Koh PW, Sagawa S, Marklund H, Xie SM, Zhang M, Balsubramani A, Hu W, Yasunaga M, Phillips RL, Gao I et al (2021) Wilds: a benchmark of in-the-wild distribution shifts. In: International conference on machine learning, pp. 5637\u20135664x. PMLR"},{"key":"11758_CR17","first-page":"3290","volume":"33","author":"S Garg","year":"2020","unstructured":"Garg S, Wu Y, Balakrishnan S, Lipton Z (2020) A unified view of label shift estimation. Adv Neural Inf Process Syst 33:3290\u20133300","journal-title":"Adv Neural Inf Process Syst"},{"key":"11758_CR18","unstructured":"Liu S, Yin L, Mocanu DC, Pechenizkiy M (2021) Do we actually need dense over-parameterization? in-time over-parameterization in sparse training. In: International conference on machine learning, pp. 6989\u20137000. PMLR"},{"key":"11758_CR19","unstructured":"Sun Y, Wang X, Liu Z, Miller J, Efros A, Hardt M (2020) Test-time training with self-supervision for generalization under distribution shifts. In: International conference on machine learning, pp. 9229\u20139248. PMLR"},{"key":"11758_CR20","unstructured":"Kumar A, Raghunathan A, Jones R, Ma T, Liang P (2022) Fine-tuning can distort pretrained features and underperform out-of-distribution."},{"key":"11758_CR21","doi-asserted-by":"crossref","unstructured":"Liu X, Cheng M, Zhang H, Hsieh C-J (2018) Towards robust neural networks via random self-ensemble. In: Proceedings of the European conference on computer vision (ECCV), pp. 369\u2013385","DOI":"10.1007\/978-3-030-01234-2_23"},{"key":"11758_CR22","unstructured":"Arjovsky M, Bottou L, Gulrajani I, Lopez-Paz D (2019) Invariant risk minimization."},{"key":"11758_CR23","unstructured":"Krueger D, Caballero E, Jacobsen J-H, Zhang A, Binas J, Zhang D, Le\u00a0Priol R, Courville A (2021) Out-of-distribution generalization via risk extrapolation (rex). In: international conference on machine learning, pp. 5815\u20135826. PMLR"},{"key":"11758_CR24","unstructured":"Frankle J, Dziugaite GK, Roy DM, Carbin M (2020) Pruning neural networks at initialization: Why are we missing the mark?"},{"key":"11758_CR25","unstructured":"Wang H, Qin C, Zhang Y, Fu Y (2020) Neural pruning via growing regularization."},{"key":"11758_CR26","unstructured":"Lee J, Park S, Mo S, Ahn S, Shin J (2020) Layer-adaptive sparsity for the magnitude-based pruning."},{"key":"11758_CR27","first-page":"26609","volume":"34","author":"X Chen","year":"2021","unstructured":"Chen X, Cheng Y, Wang S, Gan Z, Liu J, Wang Z (2021) The elastic lottery ticket hypothesis. Adv Neural Inf Process Syst 34:26609\u201326621","journal-title":"Adv Neural Inf Process Syst"},{"key":"11758_CR28","doi-asserted-by":"crossref","unstructured":"Andle J, Yasaei\u00a0Sekeh S (2022) Theoretical understanding of the information flow on continual learning performance. In: European conference on computer vision, pp. 86\u2013101. Springer","DOI":"10.1007\/978-3-031-19775-8_6"},{"key":"11758_CR29","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"11758_CR30","unstructured":"Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition."},{"key":"11758_CR31","doi-asserted-by":"publisher","unstructured":"Phan H (2021) huyvnphan\/pytorch_cifar10 . https:\/\/doi.org\/10.5281\/zenodo.4431043","DOI":"10.5281\/zenodo.4431043"},{"key":"11758_CR32","first-page":"6377","volume":"33","author":"H Tanaka","year":"2020","unstructured":"Tanaka H, Kunin D, Yamins DL, Ganguli S (2020) Pruning neural networks without any data by iteratively conserving synaptic flow. Adv Neural Inf Process Syst 33:6377\u20136389","journal-title":"Adv Neural Inf Process Syst"},{"key":"11758_CR33","unstructured":"Lee N, Ajanthan T, Torr PH (2018) Snip: single-shot network pruning based on connection sensitivity."},{"key":"11758_CR34","unstructured":"Aaraki (2022) vit-base-patch16-224-in21k-finetuned-cifar10. Hugging Face. Accessed on February, 2025"},{"key":"11758_CR35","doi-asserted-by":"crossref","unstructured":"Li B, Wu B, Su J, Wang G (2020) Eagleeye: fast sub-net evaluation for efficient neural network pruning. In: Computer Vision\u2013ECCV 2020: 16th European conference, glasgow, UK, August 23\u201328, 2020, Proceedings, Part II 16, pp. 639\u2013654. Springer","DOI":"10.1007\/978-3-030-58536-5_38"},{"issue":"8","key":"11758_CR36","doi-asserted-by":"publisher","first-page":"4004","DOI":"10.1109\/TVT.2011.2165976","volume":"60","author":"X Yi","year":"2011","unstructured":"Yi X, Au EK (2011) User scheduling for heterogeneous multiuser mimo systems: a subspace viewpoint. IEEE Trans Vehic Technol 60(8):4004\u20134013","journal-title":"IEEE Trans Vehic Technol"},{"key":"11758_CR37","doi-asserted-by":"crossref","unstructured":"Fang G, Ma X, Song M, Mi MB, Wang X (2023) Depgraph: towards any structural pruning. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp. 16091\u201316101","DOI":"10.1109\/CVPR52729.2023.01544"}],"container-title":["Neural Processing Letters"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11063-025-11758-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11063-025-11758-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11063-025-11758-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T04:43:42Z","timestamp":1760762622000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11063-025-11758-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,6]]},"references-count":37,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,10]]}},"alternative-id":["11758"],"URL":"https:\/\/doi.org\/10.1007\/s11063-025-11758-6","relation":{},"ISSN":["1573-773X"],"issn-type":[{"type":"electronic","value":"1573-773X"}],"subject":[],"published":{"date-parts":[[2025,10,6]]},"assertion":[{"value":"21 March 2025","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 October 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"84"}}