{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:23:44Z","timestamp":1777656224948,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,17]]},"DOI":"10.1145\/3511808.3557550","type":"proceedings-article","created":{"date-parts":[[2022,10,16]],"date-time":"2022-10-16T01:22:22Z","timestamp":1665883342000},"page":"4219-4223","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Invariance Testing and Feature Selection Using Sparse Linear Layers"],"prefix":"10.1145","author":[{"given":"Zukang","family":"Liao","sequence":"first","affiliation":[{"name":"University of Oxford, Oxford, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Cheung","sequence":"additional","affiliation":[{"name":"Oracle Corporation, San Francisco, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"key":"e_1_3_2_2_1_1","first-page":"1","article-title":"Why do deep convolutional networks generalize so poorly to small image transformations","volume":"20","author":"Azulay Aharon","year":"2019","unstructured":"Aharon Azulay and Yair Weiss . 2019 . Why do deep convolutional networks generalize so poorly to small image transformations ? Journal of Machine Learning Research , Vol. 20 (2019), 1 -- 25 . Aharon Azulay and Yair Weiss. 2019. Why do deep convolutional networks generalize so poorly to small image transformations? Journal of Machine Learning Research, Vol. 20 (2019), 1--25.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_2_2_1","volume-title":"Towards evaluating the robustness of neural networks. In 2017 ieee symposium on security and privacy (sp)","author":"Carlini Nicholas","unstructured":"Nicholas Carlini and David Wagner . 2017. Towards evaluating the robustness of neural networks. In 2017 ieee symposium on security and privacy (sp) . IEEE , 39--57. Nicholas Carlini and David Wagner. 2017. Towards evaluating the robustness of neural networks. In 2017 ieee symposium on security and privacy (sp). IEEE, 39--57."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41870-017-0080-1"},{"key":"e_1_3_2_2_4_1","first-page":"1","article-title":"A group-theoretic framework for data augmentation","volume":"21","author":"Chen Shuxiao","year":"2020","unstructured":"Shuxiao Chen , Edgar Dobriban , and Jane H Lee . 2020 . A group-theoretic framework for data augmentation . Journal of Machine Learning Research , Vol. 21 , 245 (2020), 1 -- 71 . Shuxiao Chen, Edgar Dobriban, and Jane H Lee. 2020. A group-theoretic framework for data augmentation. Journal of Machine Learning Research, Vol. 21, 245 (2020), 1--71.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_2_5_1","volume-title":"Shaping the future of ict research. methods and approaches","author":"Crowston Kevin","unstructured":"Kevin Crowston . 2012. Amazon mechanical turk: A research tool for organizations and information systems scholars . In Shaping the future of ict research. methods and approaches . Springer , 210--221. Kevin Crowston. 2012. Amazon mechanical turk: A research tool for organizations and information systems scholars. In Shaping the future of ict research. methods and approaches. Springer, 210--221."},{"key":"e_1_3_2_2_6_1","volume-title":"SAGA: A fast incremental gradient method with support for non-strongly convex composite objectives. Advances in neural information processing systems","author":"Defazio Aaron","year":"2014","unstructured":"Aaron Defazio , Francis Bach , and Simon Lacoste-Julien . 2014 . SAGA: A fast incremental gradient method with support for non-strongly convex composite objectives. Advances in neural information processing systems , Vol. 27 (2014). Aaron Defazio, Francis Bach, and Simon Lacoste-Julien. 2014. SAGA: A fast incremental gradient method with support for non-strongly convex composite objectives. Advances in neural information processing systems, Vol. 27 (2014)."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3213846.3213858"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1017\/dsd.2020.153"},{"key":"e_1_3_2_2_9_1","volume-title":"International Conference on Machine Learning. PMLR","author":"Engstrom Logan","year":"2019","unstructured":"Logan Engstrom , Brandon Tran , Dimitris Tsipras , Ludwig Schmidt , and Aleksander Madry . 2019 . Exploring the landscape of spatial robustness . In International Conference on Machine Learning. PMLR , 1802--1811. Logan Engstrom, Brandon Tran, Dimitris Tsipras, Ludwig Schmidt, and Aleksander Madry. 2019. Exploring the landscape of spatial robustness. In International Conference on Machine Learning. PMLR, 1802--1811."},{"key":"e_1_3_2_2_10_1","unstructured":"Beno^it Fr\u00e9nay Ata Kab\u00e1n etal 2014. A comprehensive introduction to label noise. In ESANN. Citeseer.  Beno^it Fr\u00e9nay Ata Kab\u00e1n et al. 2014. A comprehensive introduction to label noise. In ESANN. Citeseer."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380415"},{"key":"e_1_3_2_2_12_1","volume-title":"Measuring invariances in deep networks. Advances in neural information processing systems","author":"Goodfellow Ian","year":"2009","unstructured":"Ian Goodfellow , Honglak Lee , Quoc Le , Andrew Saxe , and Andrew Ng. 2009. Measuring invariances in deep networks. Advances in neural information processing systems , Vol. 22 ( 2009 ), 646--654. Ian Goodfellow, Honglak Lee, Quoc Le, Andrew Saxe, and Andrew Ng. 2009. Measuring invariances in deep networks. Advances in neural information processing systems, Vol. 22 (2009), 646--654."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2020.2992393"},{"key":"e_1_3_2_2_14_1","volume-title":"Accelerating stochastic gradient descent using predictive variance reduction. Advances in neural information processing systems","author":"Johnson Rie","year":"2013","unstructured":"Rie Johnson and Tong Zhang . 2013. Accelerating stochastic gradient descent using predictive variance reduction. Advances in neural information processing systems , Vol. 26 ( 2013 ), 315--323. Rie Johnson and Tong Zhang. 2013. Accelerating stochastic gradient descent using predictive variance reduction. Advances in neural information processing systems, Vol. 26 (2013), 315--323."},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00108"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"crossref","unstructured":"Brian Kulis et al. 2012. Metric learning: A survey. Foundations and trends in machine learning Vol. 5 4 (2012) 287--364.  Brian Kulis et al. 2012. Metric learning: A survey. Foundations and trends in machine learning Vol. 5 4 (2012) 287--364.","DOI":"10.1561\/2200000019"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-013-9619-2"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2019.8756539"},{"key":"e_1_3_2_2_19_1","volume-title":"Automated Invariance Testing for Machine Learning Models Using Sparse Linear Layers. In ICML: Workshop on Spurious Correlations, Invariance and Stability.","author":"Liao Zukang","year":"2022","unstructured":"Zukang Liao and Michael Cheung . 2022 . Automated Invariance Testing for Machine Learning Models Using Sparse Linear Layers. In ICML: Workshop on Spurious Correlations, Invariance and Stability. Zukang Liao and Michael Cheung. 2022. Automated Invariance Testing for Machine Learning Models Using Sparse Linear Layers. In ICML: Workshop on Spurious Correlations, Invariance and Stability."},{"key":"e_1_3_2_2_20_1","volume-title":"ML4ML: Automated Invariance Testing for Machine Learning Models. arXiv preprint arXiv:2109.12926","author":"Liao Zukang","year":"2021","unstructured":"Zukang Liao , Pengfei Zhang , and Min Chen . 2021. ML4ML: Automated Invariance Testing for Machine Learning Models. arXiv preprint arXiv:2109.12926 ( 2021 ). Zukang Liao, Pengfei Zhang, and Min Chen. 2021. ML4ML: Automated Invariance Testing for Machine Learning Models. arXiv preprint arXiv:2109.12926 (2021)."},{"key":"e_1_3_2_2_21_1","volume-title":"On detecting adversarial perturbations. arXiv preprint arXiv:1702.04267","author":"Metzen Jan Hendrik","year":"2017","unstructured":"Jan Hendrik Metzen , Tim Genewein , Volker Fischer , and Bastian Bischoff . 2017. On detecting adversarial perturbations. arXiv preprint arXiv:1702.04267 ( 2017 ). Jan Hendrik Metzen, Tim Genewein, Volker Fischer, and Bastian Bischoff. 2017. On detecting adversarial perturbations. arXiv preprint arXiv:1702.04267 (2017)."},{"key":"e_1_3_2_2_22_1","volume-title":"Insights on representational similarity in neural networks with canonical correlation. arXiv preprint arXiv:1806.05759","author":"Morcos Ari S","year":"2018","unstructured":"Ari S Morcos , Maithra Raghu , and Samy Bengio . 2018. Insights on representational similarity in neural networks with canonical correlation. arXiv preprint arXiv:1806.05759 ( 2018 ). Ari S Morcos, Maithra Raghu, and Samy Bengio. 2018. Insights on representational similarity in neural networks with canonical correlation. arXiv preprint arXiv:1806.05759 (2018)."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_3_2_2_24_1","volume-title":"International Conference on Modelling and Simulation in Management Sciences. Springer, 127--141","author":"Quiroga Facundo","year":"2018","unstructured":"Facundo Quiroga , Franco Ronchetti , Laura Lanzarini , and Aurelio F Bariviera . 2018 . Revisiting data augmentation for rotational invariance in convolutional neural networks . In International Conference on Modelling and Simulation in Management Sciences. Springer, 127--141 . Facundo Quiroga, Franco Ronchetti, Laura Lanzarini, and Aurelio F Bariviera. 2018. Revisiting data augmentation for rotational invariance in convolutional neural networks. In International Conference on Modelling and Simulation in Management Sciences. Springer, 127--141."},{"key":"e_1_3_2_2_25_1","volume-title":"Svcca: Singular vector canonical correlation analysis for deep learning dynamics and interpretability. arXiv preprint arXiv:1706.05806","author":"Raghu Maithra","year":"2017","unstructured":"Maithra Raghu , Justin Gilmer , Jason Yosinski , and Jascha Sohl-Dickstein . 2017 . Svcca: Singular vector canonical correlation analysis for deep learning dynamics and interpretability. arXiv preprint arXiv:1706.05806 (2017). Maithra Raghu, Justin Gilmer, Jason Yosinski, and Jascha Sohl-Dickstein. 2017. Svcca: Singular vector canonical correlation analysis for deep learning dynamics and interpretability. arXiv preprint arXiv:1706.05806 (2017)."},{"key":"e_1_3_2_2_26_1","first-page":"40","article-title":"Feature selection using a multilayer perceptron","volume":"2","author":"Ruck Dennis W","year":"1990","unstructured":"Dennis W Ruck , Steven K Rogers , and Matthew Kabrisky . 1990 . Feature selection using a multilayer perceptron . Journal of Neural Network Computing , Vol. 2 , 2 (1990), 40 -- 48 . Dennis W Ruck, Steven K Rogers, and Matthew Kabrisky. 1990. Feature selection using a multilayer perceptron. Journal of Neural Network Computing, Vol. 2, 2 (1990), 40--48.","journal-title":"Journal of Neural Network Computing"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/MS.2018.2875968"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/QRS-C.2018.00032"},{"key":"e_1_3_2_2_29_1","volume-title":"Towards out-of-distribution generalization: A survey. arXiv preprint arXiv:2108.13624","author":"Shen Zheyan","year":"2021","unstructured":"Zheyan Shen , Jiashuo Liu , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , and Peng Cui . 2021. Towards out-of-distribution generalization: A survey. arXiv preprint arXiv:2108.13624 ( 2021 ). Zheyan Shen, Jiashuo Liu, Yue He, Xingxuan Zhang, Renzhe Xu, Han Yu, and Peng Cui. 2021. Towards out-of-distribution generalization: A survey. arXiv preprint arXiv:2108.13624 (2021)."},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-019-0197-0"},{"key":"e_1_3_2_2_31_1","volume-title":"Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199","author":"Szegedy Christian","year":"2013","unstructured":"Christian Szegedy , Wojciech Zaremba , Ilya Sutskever , Joan Bruna , Dumitru Erhan , Ian Goodfellow , and Rob Fergus . 2013. Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199 ( 2013 ). Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow, and Rob Fergus. 2013. Intriguing properties of neural networks. arXiv preprint arXiv:1312.6199 (2013)."},{"key":"e_1_3_2_2_32_1","volume-title":"Ensemble adversarial training: Attacks and defenses. arXiv preprint arXiv:1705.07204","author":"Tram\u00e8r Florian","year":"2017","unstructured":"Florian Tram\u00e8r , Alexey Kurakin , Nicolas Papernot , Ian Goodfellow , Dan Boneh , and Patrick McDaniel . 2017. Ensemble adversarial training: Attacks and defenses. arXiv preprint arXiv:1705.07204 ( 2017 ). Florian Tram\u00e8r, Alexey Kurakin, Nicolas Papernot, Ian Goodfellow, Dan Boneh, and Patrick McDaniel. 2017. Ensemble adversarial training: Attacks and defenses. arXiv preprint arXiv:1705.07204 (2017)."},{"key":"e_1_3_2_2_33_1","volume-title":"Leveraging Sparse Linear Layers for Debuggable Deep Networks. arXiv preprint arXiv:2105.04857","author":"Wong Eric","year":"2021","unstructured":"Eric Wong , Shibani Santurkar , and Aleksander Mka dry. 2021. Leveraging Sparse Linear Layers for Debuggable Deep Networks. arXiv preprint arXiv:2105.04857 ( 2021 ). Eric Wong, Shibani Santurkar, and Aleksander Mka dry. 2021. Leveraging Sparse Linear Layers for Debuggable Deep Networks. arXiv preprint arXiv:2105.04857 (2021)."},{"key":"e_1_3_2_2_34_1","volume-title":"Do CNNs Encode Data Augmentations? arXiv preprint arXiv:2003.08773","author":"Yan Eddie","year":"2020","unstructured":"Eddie Yan and Yanping Huang . 2020. Do CNNs Encode Data Augmentations? arXiv preprint arXiv:2003.08773 ( 2020 ). Eddie Yan and Yanping Huang. 2020. Do CNNs Encode Data Augmentations? arXiv preprint arXiv:2003.08773 (2020)."},{"key":"e_1_3_2_2_35_1","volume-title":"Generalized out-of-distribution detection: A survey. arXiv preprint arXiv:2110.11334","author":"Yang Jingkang","year":"2021","unstructured":"Jingkang Yang , Kaiyang Zhou , Yixuan Li , and Ziwei Liu . 2021. Generalized out-of-distribution detection: A survey. arXiv preprint arXiv:2110.11334 ( 2021 ). Jingkang Yang, Kaiyang Zhou, Yixuan Li, and Ziwei Liu. 2021. Generalized out-of-distribution detection: A survey. arXiv preprint arXiv:2110.11334 (2021)."},{"key":"e_1_3_2_2_36_1","volume-title":"Machine learning testing: Survey, landscapes and horizons","author":"Zhang Jie M","year":"2020","unstructured":"Jie M Zhang , Mark Harman , Lei Ma , and Yang Liu . 2020. Machine learning testing: Survey, landscapes and horizons . IEEE Transactions on Software Engineering ( 2020 ). Jie M Zhang, Mark Harman, Lei Ma, and Yang Liu. 2020. Machine learning testing: Survey, landscapes and horizons. IEEE Transactions on Software Engineering (2020)."},{"key":"e_1_3_2_2_37_1","volume-title":"International Conference on Machine Learning. PMLR, 7324--7334","author":"Zhang Richard","year":"2019","unstructured":"Richard Zhang . 2019 a. Making convolutional networks shift-invariant again . In International Conference on Machine Learning. PMLR, 7324--7334 . Richard Zhang. 2019a. Making convolutional networks shift-invariant again. In International Conference on Machine Learning. PMLR, 7324--7334."},{"key":"e_1_3_2_2_38_1","volume-title":"International conference on machine learning. PMLR, 7324--7334","author":"Zhang Richard","year":"2019","unstructured":"Richard Zhang . 2019 b. Making convolutional networks shift-invariant again . In International conference on machine learning. PMLR, 7324--7334 . Richard Zhang. 2019b. Making convolutional networks shift-invariant again. In International conference on machine learning. PMLR, 7324--7334."},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2005.00503.x"}],"event":{"name":"CIKM '22: The 31st ACM International Conference on Information and Knowledge Management","location":"Atlanta GA USA","acronym":"CIKM '22","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 31st ACM International Conference on Information & Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557550","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3511808.3557550","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:08Z","timestamp":1750182668000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557550"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,17]]},"references-count":39,"alternative-id":["10.1145\/3511808.3557550","10.1145\/3511808"],"URL":"https:\/\/doi.org\/10.1145\/3511808.3557550","relation":{},"subject":[],"published":{"date-parts":[[2022,10,17]]},"assertion":[{"value":"2022-10-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}