{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T15:04:12Z","timestamp":1782918252529,"version":"3.54.5"},"reference-count":70,"publisher":"MIT Press","license":[{"start":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T00:00:00Z","timestamp":1629331200000},"content-version":"vor","delay-in-days":230,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,18]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We introduce a theoretical framework for understanding and predicting the complexity of sequence classification tasks, using a novel extension of the theory of Boolean function sensitivity. The sensitivity of a function, given a distribution over input sequences, quantifies the number of disjoint subsets of the input sequence that can each be individually changed to change the output. We argue that standard sequence classification methods are biased towards learning low-sensitivity functions, so that tasks requiring high sensitivity are more difficult. To that end, we show analytically that simple lexical classifiers can only express functions of bounded sensitivity, and we show empirically that low-sensitivity functions are easier to learn for LSTMs. We then estimate sensitivity on 15 NLP tasks, finding that sensitivity is higher on challenging tasks collected in GLUE than on simple text classification tasks, and that sensitivity predicts the performance both of simple lexical classifiers and of vanilla BiLSTMs without pretrained contextualized embeddings. Within a task, sensitivity predicts which inputs are hard for such simple models. Our results suggest that the success of massively pretrained contextual representations stems in part because they provide representations from which information can be extracted by low-sensitivity decoders.<\/jats:p>","DOI":"10.1162\/tacl_a_00403","type":"journal-article","created":{"date-parts":[[2021,9,20]],"date-time":"2021-09-20T19:31:15Z","timestamp":1632166275000},"page":"891-908","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":7,"title":["Sensitivity as a Complexity Measure for Sequence Classification Tasks"],"prefix":"10.1162","volume":"9","author":[{"given":"Michael","family":"Hahn","sequence":"first","affiliation":[{"name":"Stanford University, United States. mhahn2@stanford.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dan","family":"Jurafsky","sequence":"additional","affiliation":[{"name":"Stanford University, United States. jurafsky@stanford.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"Futrell","sequence":"additional","affiliation":[{"name":"University of California, Irvine, United States. rfutrell@uci.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2021,8,18]]},"reference":[{"key":"2021081914590098500_bib1","article-title":"A simple but tough-to-beat baseline for sentence embeddings","volume-title":"ICLR 2017: International Conference on Learning Representations 2017","author":"Arora","year":"2017"},{"issue":"3","key":"2021081914590098500_bib2","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1016\/0020-0190(96)00105-6","article-title":"Sensitivity vs. block sensitivity (an average-case study)","volume":"59","author":"Bernasconi","year":"1996","journal-title":"Information Processing Letters"},{"key":"2021081914590098500_bib3","article-title":"Towards understanding the spectral bias of deep learning","author":"Cao","year":"2019","journal-title":"arXiv preprint arXiv:1912.01198"},{"key":"2021081914590098500_bib4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18653\/v1\/S17-2001","article-title":"Semeval-2017 task 1: Semantic textual similarity multilingual and crosslingual focused evaluation","volume-title":"Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017)","author":"Cer","year":"2017"},{"key":"2021081914590098500_bib5","first-page":"2635","article-title":"One billion word benchmark for measuring progress in statistical language modeling","volume-title":"INTERSPEECH","author":"Chelba","year":"2014"},{"issue":"3","key":"2021081914590098500_bib6","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1109\/TIT.1956.1056813","article-title":"Three models for the description of language","volume":"2","author":"Chomsky","year":"1956","journal-title":"IEEE Transactions on Information Theory"},{"issue":"4","key":"2021081914590098500_bib7","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324909990209","article-title":"Recognizing textual entailment: Rational, evaluation and approaches","volume":"15","author":"Dagan","year":"2009","journal-title":"Natural Language Engineering"},{"key":"2021081914590098500_bib8","article-title":"Geometry matters: Exploring language examples at the decision boundary","author":"Datta","year":"2020","journal-title":"CoRR"},{"key":"2021081914590098500_bib9","first-page":"4171","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","volume-title":"NAACL-HLT 2019: Annual Conference of the North American Chapter of the Association for Computational Linguistics","author":"Devlin","year":"2019"},{"key":"2021081914590098500_bib10","article-title":"Automatically constructing a corpus of sentential paraphrases","volume-title":"Proceedings of the Third International Workshop on Paraphrasing, IWP@IJCNLP 2005, Jeju Island, Korea, October 2005, 2005","author":"Dolan","year":"2005"},{"key":"2021081914590098500_bib11","doi-asserted-by":"publisher","first-page":"91","DOI":"10.18653\/v1\/W18-3012","article-title":"Unsupervised random walk sentence embeddings: A strong but simple baseline","volume-title":"Proceedings of The Third Workshop on Representation Learning for NLP","author":"Ethayarajh","year":"2018"},{"issue":"1","key":"2021081914590098500_bib12","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1016\/j.neucom.2006.01.025","article-title":"Generalization ability of boolean functions implemented in feedforward neural networks","volume":"70","author":"Franco","year":"2006","journal-title":"Neurocomputing"},{"key":"2021081914590098500_bib13","doi-asserted-by":"publisher","first-page":"32","DOI":"10.18653\/v1\/N19-1004","article-title":"Neural language models as psycholinguistic subjects: Representations of syntactic state","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Futrell","year":"2019"},{"key":"2021081914590098500_bib14","doi-asserted-by":"crossref","first-page":"1307","DOI":"10.18653\/v1\/2020.findings-emnlp.117","article-title":"Evaluating NLP models via contrast sets","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2020","author":"Gardner","year":"2020"},{"key":"2021081914590098500_bib15","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/2020.acl-demos.10","article-title":"SyntaxGym: An online platform for targeted evaluation of language models","volume-title":"Proceedings of the Association for Computational Linguistics: System Demonstrations (ACL 2020)","author":"Gauthier","year":"2020"},{"issue":"1","key":"2021081914590098500_bib16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/S0010-0277(98)00034-1","article-title":"Linguistic complexity: Locality of syntactic dependencies","volume":"68","author":"Gibson","year":"1998","journal-title":"Cognition"},{"key":"2021081914590098500_bib17","doi-asserted-by":"publisher","first-page":"107","DOI":"10.18653\/v1\/N18-2017","article-title":"Annotation artifacts in natural language inference data","volume-title":"NAACL HLT 2018: 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Gururangan","year":"2018"},{"key":"2021081914590098500_bib18","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1162\/tacl_a_00306","article-title":"Theoretical limitations of self-attention in neural sequence models","volume":"8","author":"Hahn","year":"2020","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2021081914590098500_bib19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3115\/1073336.1073357","article-title":"A probabilistic Earley parser as a psycholinguistic model","volume-title":"Proceedings of the Second Meeting of the North American Chapter of the Association for Computational Linguistics and Language Technologies","author":"Hale","year":"2001"},{"key":"2021081914590098500_bib20","first-page":"1","article-title":"Variations on the sensitivity conjecture","volume":"4","author":"Hatami","year":"2010","journal-title":"Theory of Computing"},{"issue":"8","key":"2021081914590098500_bib21","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Computation"},{"key":"2021081914590098500_bib22","first-page":"359","article-title":"Bounds on the complexity of recurrent neural network implementations of finite state machines","volume-title":"Advances in Neural Information Processing Systems","author":"Horne","year":"1994"},{"key":"2021081914590098500_bib23","doi-asserted-by":"publisher","first-page":"328","DOI":"10.18653\/v1\/P18-1031","article-title":"Universal language model fine-tuning for text classification","volume-title":"ACL 2018: 56th Annual Meeting of the Association for Computational Linguistics","author":"Howard","year":"2018"},{"issue":"1","key":"2021081914590098500_bib24","first-page":"382","article-title":"A closer look at the performance of neural language models on reflexive anaphor licensing","volume":"3","author":"Hu","year":"2020","journal-title":"Proceedings of the Society for Computation in Linguistics"},{"key":"2021081914590098500_bib25","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1145\/1014052.1014073","article-title":"Mining and summarizing customer reviews","volume-title":"Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Hu","year":"2004"},{"key":"2021081914590098500_bib26","doi-asserted-by":"publisher","first-page":"8690","DOI":"10.18653\/v1\/2020.acl-main.768","article-title":"Are natural language inference models IMPPRESsive? Learning IMPlicature and PRESupposition","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online, July 5\u201310, 2020","author":"Jeretic","year":"2020"},{"key":"2021081914590098500_bib27","doi-asserted-by":"publisher","first-page":"2021","DOI":"10.18653\/v1\/D17-1215","article-title":"Adversarial examples for evaluating reading comprehension systems","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing","author":"Jia","year":"2017"},{"key":"2021081914590098500_bib28","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1109\/SFCS.1988.21923","article-title":"The influence of variables on Boolean functions","volume-title":"[Proceedings 1988] 29th Annual Symposium on Foundations of Computer Science","author":"Kahn","year":"1988"},{"key":"2021081914590098500_bib29","article-title":"Learning the difference that makes a difference with counterfactually-augmented data","volume-title":"ICLR 2020: Eighth International Conference on Learning Representations","author":"Kaushik","year":"2020"},{"key":"2021081914590098500_bib30","doi-asserted-by":"publisher","first-page":"5010","DOI":"10.18653\/v1\/D18-1546","article-title":"How much reading does reading comprehension require? A critical investigation of popular benchmarks","volume-title":"EMNLP 2018: 2018 Conference on Empirical Methods in Natural Language Processing","author":"Kaushik","year":"2018"},{"key":"2021081914590098500_bib31","doi-asserted-by":"publisher","first-page":"1746","DOI":"10.3115\/v1\/D14-1181","article-title":"Convolutional neural networks for sentence classification","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Kim","year":"2014"},{"key":"2021081914590098500_bib32","first-page":"552","article-title":"The winograd schema challenge","volume-title":"KR\u201912 Proceedings of the Thirteenth International Conference on Principles of Knowledge Representation and Reasoning","author":"Levesque","year":"2012"},{"key":"2021081914590098500_bib33","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-3860-5","volume-title":"An Introduction to Kolmogorov Complexity and its Applications","author":"Li","year":"1993"},{"key":"2021081914590098500_bib34","doi-asserted-by":"publisher","first-page":"263","DOI":"10.18653\/v1\/2020.acl-main.24","article-title":"Probabilistically masked language model capable of autoregressive generation in arbitrary word order","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Liao","year":"2020"},{"key":"2021081914590098500_bib35","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1162\/tacl_a_00115","article-title":"Assessing the ability of LSTMs to learn syntax-sensitive dependencies","volume":"4","author":"Linzen","year":"2016","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2021081914590098500_bib36","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1151","article-title":"Targeted syntactic evaluation of language models","author":"Marvin","year":"2018","journal-title":"arXiv preprint arXiv:1808.09031"},{"key":"2021081914590098500_bib37","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-3901","article-title":"Sequential neural networks as automata","author":"Merrill","year":"2019","journal-title":"arXiv preprint arXiv:1906.01615"},{"key":"2021081914590098500_bib38","volume-title":"Perceptrons: An Introduction to Computational Geometry","author":"Minsky","year":"1969"},{"key":"2021081914590098500_bib39","doi-asserted-by":"publisher","first-page":"4566","DOI":"10.18653\/v1\/P19-1449","article-title":"Human vs. muppet: A conservative estimate of human performance on the glue benchmark","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Nangia","year":"2019"},{"issue":"6","key":"2021081914590098500_bib40","doi-asserted-by":"publisher","first-page":"999","DOI":"10.1137\/0220062","article-title":"CREW PRAMs and decision trees","volume":"20","author":"Nisan","year":"1991","journal-title":"SIAM Journal on Computing"},{"key":"2021081914590098500_bib41","article-title":"Universal dependencies v1: A multilingual treebank collection","volume-title":"Tenth International Conference on Language Resources and Evaluation (LREC 2016)","author":"Nivre","year":"2016"},{"key":"2021081914590098500_bib42","article-title":"Sensitivity and generalization in neural networks: an empirical study","volume-title":"6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 \u2013 May 3, 2018, Conference Track Proceedings","author":"Novak","year":"2018"},{"key":"2021081914590098500_bib43","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139814782","volume-title":"Analysis of Boolean Functions","author":"O\u2019Donnell","year":"2014"},{"key":"2021081914590098500_bib44","first-page":"48","article-title":"fairseq: A fast, extensible toolkit for sequence modeling","volume-title":"NAACL-HLT 2019: Annual Conference of the North American Chapter of the Association for Computational Linguistics","author":"Ott","year":"2019"},{"key":"2021081914590098500_bib45","first-page":"1962","article-title":"Random deep neural networks are biased towards simple functions","volume-title":"Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8\u201314, 2019, Vancouver, BC, Canada","author":"Palma","year":"2019"},{"key":"2021081914590098500_bib46","doi-asserted-by":"publisher","first-page":"271","DOI":"10.3115\/1218955.1218990","article-title":"A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts","volume-title":"Proceedings of the 42nd Meeting of the Association for Computational Linguistics (ACL\u201904), Main Volume","author":"Pang","year":"2004"},{"key":"2021081914590098500_bib47","doi-asserted-by":"publisher","first-page":"115","DOI":"10.3115\/1219840.1219855","article-title":"Seeing stars: Exploiting class relationships for sentiment categorization with respect to rating scales","volume-title":"Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL\u201905)","author":"Pang","year":"2005"},{"key":"2021081914590098500_bib48","doi-asserted-by":"publisher","first-page":"1532","DOI":"10.3115\/v1\/D14-1162","article-title":"GloVe: Global vectors for word representation","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Pennington","year":"2014"},{"key":"2021081914590098500_bib49","doi-asserted-by":"publisher","first-page":"2227","DOI":"10.18653\/v1\/N18-1202","article-title":"Deep contextualized word representations","volume-title":"NAACL HLT 2018: 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Peters","year":"2018"},{"key":"2021081914590098500_bib50","first-page":"2089","article-title":"A universal part-of-speech tagset","volume-title":"Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC-2012)","author":"Petrov","year":"2012"},{"key":"2021081914590098500_bib51","doi-asserted-by":"publisher","first-page":"180","DOI":"10.18653\/v1\/S18-2023","article-title":"Hypothesis only baselines in natural language inference","volume-title":"Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics","author":"Poliak","year":"2018"},{"key":"2021081914590098500_bib52","first-page":"160","article-title":"Universal dependency parsing from scratch","volume-title":"Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies","author":"Qi","year":"2018"},{"key":"2021081914590098500_bib53","doi-asserted-by":"crossref","first-page":"101","DOI":"10.18653\/v1\/2020.acl-demos.14","article-title":"Stanza: A Python natural language processing toolkit for many human languages","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, ACL 2020, Online, July 5\u201310, 2020","author":"Qi","year":"2020"},{"issue":"8","key":"2021081914590098500_bib54","first-page":"9","article-title":"Language models are unsupervised multitask learners","volume":"1","author":"Radford","year":"2019","journal-title":"OpenAI Blog"},{"key":"2021081914590098500_bib55","first-page":"5301","article-title":"On the spectral bias of neural networks","volume-title":"ICML 2019: Thirty-sixth International Conference on Machine Learning","author":"Rahaman","year":"2019"},{"key":"2021081914590098500_bib56","doi-asserted-by":"publisher","first-page":"2383","DOI":"10.18653\/v1\/D16-1264","article-title":"Squad: 100,000+ questions for machine comprehension of text","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Rajpurkar","year":"2016"},{"key":"2021081914590098500_bib57","first-page":"2897","article-title":"A gold standard dependency corpus for English","volume-title":"Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC\u201914)","author":"Silveira","year":"2014"},{"key":"2021081914590098500_bib58","first-page":"1631","article-title":"Recursive deep models for semantic compositionality over a sentiment treebank","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing","author":"Socher","year":"2013"},{"key":"2021081914590098500_bib59","article-title":"Intriguing properties of neural networks","volume-title":"2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada, April 14\u201316, 2014, Conference Track Proceedings","author":"Szegedy","year":"2014"},{"key":"2021081914590098500_bib60","article-title":"Deep learning generalizes because the parameter-function map is biased towards simple functions","volume-title":"ICLR 2019: 7th International Conference on Learning Representations","author":"Valle-Perez","year":"2019"},{"key":"2021081914590098500_bib61","first-page":"5998","article-title":"Attention is all you need","volume-title":"Advances in Neural Information Processing Systems","author":"Vaswani","year":"2017"},{"key":"2021081914590098500_bib62","first-page":"3266","article-title":"SuperGLUE: A stickier benchmark for general-purpose language understanding systems","volume-title":"Advances in Neural Information Processing Systems","author":"Wang","year":"2019"},{"key":"2021081914590098500_bib63","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00290","article-title":"GLUE: A multi-task benchmark and analysis platform for natural language understanding","volume-title":"ICLR 2019: 7th International Conference on Learning Representations","author":"Wang","year":"2019"},{"key":"2021081914590098500_bib64","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1162\/tacl_a_00290","article-title":"Neural network acceptability judgments","volume":"7","author":"Warstadt","year":"2019","journal-title":"Transactions of the Association for Computational Linguistics"},{"issue":"2","key":"2021081914590098500_bib65","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s10579-005-7880-9","article-title":"Annotating expressions of opinions and emotions in language","volume":"39","author":"Wiebe","year":"2005","journal-title":"Language Resources and Evaluation"},{"key":"2021081914590098500_bib66","article-title":"Towards universal paraphrastic sentence embeddings","volume-title":"4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2\u20134, 2016, Conference Track Proceedings","author":"Wieting","year":"2016"},{"key":"2021081914590098500_bib67","doi-asserted-by":"publisher","first-page":"1112","DOI":"10.18653\/v1\/N18-1101","article-title":"A broad-coverage challenge corpus for sentence understanding through inference","volume-title":"NAACL HLT 2018: 16th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Williams","year":"2018"},{"key":"2021081914590098500_bib68","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-demos.6","article-title":"Huggingface\u2019s transformers: State-of-the-art natural language processing","author":"Wolf","year":"2019","journal-title":"arXiv preprint arXiv:1910.03771"},{"key":"2021081914590098500_bib69","doi-asserted-by":"publisher","first-page":"264","DOI":"10.1007\/978-3-030-36708-4_22","article-title":"Training behavior of deep neural network in frequency domain","volume-title":"International Conference on Neural Information Processing","author":"Xu","year":"2019"},{"key":"2021081914590098500_bib70","first-page":"5753","article-title":"XLNet: Generalized autoregressive pretraining for language understanding","volume-title":"NeurIPS 2019: Thirty-third Conference on Neural Information Processing Systems","author":"Yang","year":"2019"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00403\/1957707\/tacl_a_00403.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00403\/1957707\/tacl_a_00403.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,9]],"date-time":"2023-11-09T02:37:42Z","timestamp":1699497462000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/doi\/10.1162\/tacl_a_00403\/106992\/Sensitivity-as-a-Complexity-Measure-for-Sequence"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":70,"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00403","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}