{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T17:25:24Z","timestamp":1778347524548,"version":"3.51.4"},"reference-count":64,"publisher":"Springer Science and Business Media LLC","issue":"15","license":[{"start":{"date-parts":[[2022,4,2]],"date-time":"2022-04-02T00:00:00Z","timestamp":1648857600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,4,2]],"date-time":"2022-04-02T00:00:00Z","timestamp":1648857600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100012704","name":"University of Agder","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100012704","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Recent research in novelty detection focuses mainly on document-level classification, employing deep neural networks (DNN). However, the black-box nature of DNNs makes it difficult to extract an exact explanation of why a document is considered novel. In addition, dealing with novelty at the word level is crucial to provide a more fine-grained analysis than what is available at the document level. In this work, we propose a Tsetlin Machine (TM)-based architecture for scoring individual words according to their contribution to novelty. Our approach encodes a description of the novel documents using the linguistic patterns captured by TM clauses. We then adapt this description to measure how much a word contributes to making documents novel. Our experimental results demonstrate how our approach breaks down novelty into interpretable phrases, successfully measuring novelty.<\/jats:p>","DOI":"10.1007\/s10489-022-03281-1","type":"journal-article","created":{"date-parts":[[2022,4,2]],"date-time":"2022-04-02T11:03:22Z","timestamp":1648897402000},"page":"17465-17489","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Word-level human interpretable scoring mechanism for novel text detection using Tsetlin Machines"],"prefix":"10.1007","volume":"52","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7339-3621","authenticated-orcid":false,"given":"Bimal","family":"Bhattarai","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ole-Christoffer","family":"Granmo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lei","family":"Jiao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,4,2]]},"reference":[{"key":"3281_CR1","doi-asserted-by":"publisher","unstructured":"Abeyrathna KD, Granmo O, Jiao L, Goodwin M (2019) The regression tsetlin machine: A tsetlin machine for continuous output problems. In: Oliveira PM, Novais P, Reis LP (eds) Progress in Artificial Intelligence, 19th EPIA Conference on Artificial Intelligence, EPIA 2019, Vila Real, Portugal, September 3-6, 2019, Proceedings, Part II, Springer, Lecture Notes in Computer Science, vol 11805, pp 268\u2013280. https:\/\/doi.org\/10.1007\/978-3-030-30244-3_23","DOI":"10.1007\/978-3-030-30244-3_23"},{"key":"3281_CR2","unstructured":"Abeyrathna KD, Bhattarai B, Goodwin M, Gorji SR, Granmo O, Jiao L, Saha R, Yadav RK (2021) Massively parallel and asynchronous tsetlin machine architecture supporting almost constant-time scaling. In: Meila M, Zhang T (eds) Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, PMLR, Proceedings of Machine Learning Research, vol 139, pp 10\u201320. http:\/\/proceedings.mlr.press\/v139\/abeyrathna21a.html"},{"key":"3281_CR3","doi-asserted-by":"publisher","unstructured":"Aggarwal CC (2017) An introduction to outlier analysis. In: Outlier analysis. Springer International Publishing, pp 1\u201334. https:\/\/doi.org\/10.1007\/978-3-319-47578-3_1","DOI":"10.1007\/978-3-319-47578-3_1"},{"key":"3281_CR4","doi-asserted-by":"publisher","unstructured":"Allan J, Papka R, Lavrenko V (1998) On-line new event detection and tracking. In: Croft W B, Moffat A, van Rijsbergen C J, Wilkinson R, Zobel J (eds) SIGIR \u201998: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, August 24-28, 1998. https:\/\/doi.org\/10.1145\/290941.290954. ACM, Australia, pp 37\u201345","DOI":"10.1145\/290941.290954"},{"key":"3281_CR5","doi-asserted-by":"publisher","unstructured":"Bendale A, Boult TE (2016) Towards open set deep networks. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27-30, 2016, IEEE Computer Society, pp 1563\u20131572 . https:\/\/doi.org\/10.1109\/CVPR.2016.173","DOI":"10.1109\/CVPR.2016.173"},{"key":"3281_CR6","unstructured":"Bentivogli L, Clark P, Dagan I, Giampiccolo D (2011) The seventh PASCAL recognizing textual entailment challenge. In: Proceedings of the Fourth Text Analysis Conference, TAC 2011, Gaithersburg, Maryland, USA, November 14-15, 2011, NIST. https:\/\/tac.nist.gov\/publications\/2011\/additional.papers\/RTE7_overview.proceedings.pdf"},{"key":"3281_CR7","doi-asserted-by":"publisher","first-page":"115134","DOI":"10.1109\/ACCESS.2019.2935416","volume":"7","author":"GT Berge","year":"2019","unstructured":"Berge GT, Granmo O, Tveit TO, Goodwin M, Jiao L, Matheussen BV (2019) Using the tsetlin machine to learn human-interpretable rules for high-accuracy text categorization with medical applications. IEEE Access 7:115134\u2013115146. https:\/\/doi.org\/10.1109\/ACCESS.2019.2935416","journal-title":"IEEE Access"},{"key":"3281_CR8","doi-asserted-by":"publisher","unstructured":"Bhattarai B, Granmo O, Jiao L (2021) Measuring the novelty of natural language text using the conjunctive clauses of a tsetlin machine text classifier. In: Rocha AP, Steels L, van den Herik HJ (eds) Proceedings of the 13th International Conference on Agents and Artificial Intelligence, ICAART 2021, Volume 2, Online Streaming, February 4-6, 2021, SCITEPRESS. https:\/\/doi.org\/10.5220\/0010382204100417, pp 410\u2013417","DOI":"10.5220\/0010382204100417"},{"key":"3281_CR9","first-page":"2973","volume":"11","author":"G Blanchard","year":"2010","unstructured":"Blanchard G, Lee G, Scott C (2010) Semi-supervised novelty detection. J Mach Learn Res 11:2973\u20133009. http:\/\/portal.acm.org\/citation.cfm?id=1953028","journal-title":"J Mach Learn Res"},{"key":"#cr-split#-3281_CR10.1","unstructured":"Boudin F (2016) Pke: an open source python-based keyphrase extraction toolkit. In: Watanabe H"},{"key":"#cr-split#-3281_CR10.2","unstructured":"(ed) COLING 2016, 26th International Conference on Computational Linguistics, Proceedings of the Conference System Demonstrations, December 11-16, 2016, Osaka, Japan, ACL, pp 69-73. https:\/\/aclanthology.org\/C16-2015\/"},{"key":"3281_CR11","doi-asserted-by":"publisher","unstructured":"Boudin F (2018) Unsupervised keyphrase extraction with multipartite graphs. In: Walker MA, Ji H, Stent A (eds) Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT, New Orleans, Louisiana, USA, June 1-6, 2018 Short Papers. https:\/\/doi.org\/10.18653\/v1\/n18-2105, vol 2. Association for Computational Linguistics, pp 667\u2013672","DOI":"10.18653\/v1\/n18-2105"},{"key":"3281_CR12","unstructured":"Bougouin A, Boudin F, Daille B (2013) Topicrank: Graph-based topic ranking for keyphrase extraction. In: Sixth International Joint Conference on Natural Language Processing, IJCNLP 2013, Nagoya, Japan, October 14-18, 2013, Asian Federation of Natural Language Processing \/ ACL, pp 543\u2013551. https:\/\/aclanthology.org\/I13-1062\/"},{"key":"3281_CR13","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1016\/j.ins.2019.09.013","volume":"509","author":"R Campos","year":"2020","unstructured":"Campos R, Mangaravite V, Pasquali A, Jorge A, Nunes C, Jatowt A (2020) Yake! keyword extraction from single documents using multiple local features. Inf Sci 509:257\u2013289. https:\/\/doi.org\/10.1016\/j.ins.2019.09.013","journal-title":"Inf Sci"},{"issue":"2","key":"3281_CR14","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1145\/3130348.3130369","volume":"51","author":"J Carbinell","year":"2017","unstructured":"Carbinell J, Goldstein J (2017) The use of mmr, diversity-based reranking for reordering documents and producing summaries. SIGIR Forum 51(2):209\u2013210. https:\/\/doi.org\/10.1145\/3130348.3130369","journal-title":"SIGIR Forum"},{"issue":"5","key":"3281_CR15","doi-asserted-by":"publisher","first-page":"823","DOI":"10.1109\/TKDE.2010.235","volume":"24","author":"V Chandola","year":"2012","unstructured":"Chandola V, Banerjee A, Kumar V (2012) Anomaly detection for discrete sequences: a survey. IEEE Trans Knowl Data Eng 24(5):823\u2013839. https:\/\/doi.org\/10.1109\/TKDE.2010.235","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"3281_CR16","doi-asserted-by":"publisher","unstructured":"Dasgupta D, Nino L (2000) A comparison of negative and positive selection algorithms in novel pattern detection, Proceedings of the IEEE International Conference on Systems, Man & Cybernetics. In: Cybernetics evolving to systems, humans, organizations, and their complex interactions, sheraton music city hotel, nashville, tennessee, USA. 8-11 October, 2000. https:\/\/doi.org\/10.1109\/ICSMC.2000.884976. IEEE, pp 125\u2013130","DOI":"10.1109\/ICSMC.2000.884976"},{"key":"3281_CR17","unstructured":"Dasgupta T, Dey L (2016) Automatic scoring for innovativeness of textual ideas. In: Fortuna B, Grobelnik M, ERH Jr, Witbrock MJ (eds) Knowledge Extraction from Text, Papers from the 2016 AAAI Workshop, Phoenix, Arizona, USA, February 12, 2016, AAAI Press, AAAI Workshops, vol WS-16-10. http:\/\/www.aaai.org\/ocs\/index.php\/WS\/AAAIW16\/paper\/view\/12663"},{"key":"3281_CR18","doi-asserted-by":"publisher","unstructured":"Devlin J, Chang M, Lee K, Toutanova K (2019) BERT: Pre-training of deep bidirectional transformers for language understanding. In: Burstein J, Doran C, Solorio T (eds) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019 vol 1 (Long and Short Papers). https:\/\/doi.org\/10.18653\/v1\/n19-1423. Association for Computational Linguistics, pp 4171\u20134186","DOI":"10.18653\/v1\/n19-1423"},{"key":"3281_CR19","first-page":"2121","volume":"12","author":"JC Duchi","year":"2011","unstructured":"Duchi JC, Hazan E, Singer Y (2011) Adaptive subgradient methods for online learning and stochastic optimization. J Mach Learn Res 12:2121\u20132159. http:\/\/dl.acm.org\/citation.cfm?id=2021068","journal-title":"J Mach Learn Res"},{"key":"3281_CR20","doi-asserted-by":"publisher","unstructured":"Fei G, Liu B, Callison-burch C, Su J, Pighin D, Marton Y (2015) Social media text classification under negative covariate shift. In: M\u00e1rquez L (ed) Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, EMNLP 2015, Lisbon, Portugal, September 17-21, 2015, The Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/d15-1282, pp 2347\u20132356","DOI":"10.18653\/v1\/d15-1282"},{"key":"3281_CR21","doi-asserted-by":"publisher","unstructured":"Fei G, Liu B (2016) Breaking the closed world assumption in text classification. In: Knight K, Nenkova A, Rambow O (eds) NAACL HLT 2016, The 2016 conference of the north american chapter of the association for computational linguistics: Human language technologies, san diego california, USA, June 12-17, 2016, The Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/n16-1061, pp 506\u2013514","DOI":"10.18653\/v1\/n16-1061"},{"issue":"10","key":"3281_CR22","doi-asserted-by":"publisher","first-page":"4291","DOI":"10.1109\/TNNLS.2020.3019893","volume":"32","author":"A Galassi","year":"2021","unstructured":"Galassi A, Lippi M, Torroni P (2021) Attention in natural language processing. IEEE Trans Neural Networks Learn Syst 32(10):4291\u20134308. https:\/\/doi.org\/10.1109\/TNNLS.2020.3019893","journal-title":"IEEE Trans Neural Networks Learn Syst"},{"key":"3281_CR23","unstructured":"Goodfellow IJ, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville AC, Bengio Y (2014) Generative adversarial nets. In: Ghahramani Z, Welling M, Cortes C, Lawrence ND, Weinberger KQ (eds) Advances in Neural Information Processing Systems 27: Annual Conference on Neural Information Processing Systems 2014, December 8-13 2014, Montreal, Quebec, Canada, pp 2672\u20132680. https:\/\/proceedings.neurips.cc\/paper\/2014\/hash\/5ca3e9b122f61f8f06494c97b1afccf3-Abstract.html"},{"key":"3281_CR24","unstructured":"Granmo O (2018) The tsetlin machine - A game theoretic bandit driven approach to optimal pattern recognition with propositional logic. arXiv:1804.01508"},{"key":"3281_CR25","unstructured":"Granmo O, Glimsdal S, Jiao L, Goodwin M, Omlin CW, Berge GT (2019)"},{"key":"3281_CR26","doi-asserted-by":"publisher","unstructured":"Grootendorst M (2020) Keybert: Minimal keyword extraction with bert. https:\/\/doi.org\/10.5281\/zenodo.4461265","DOI":"10.5281\/zenodo.4461265"},{"issue":"1","key":"3281_CR27","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1148\/radiology.143.1.7063747","volume":"143","author":"JA Hanley","year":"1982","unstructured":"Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operating characteristic (roc) curve. Radiology 143(1):29\u201336. https:\/\/doi.org\/10.1148\/radiology.143.1.7063747","journal-title":"Radiology"},{"key":"3281_CR28","doi-asserted-by":"publisher","unstructured":"Hautam\u00e4ki V, K\u00e4rkk\u00e4inen I, Fr\u00e4nti P (2004) Outlier detection using k-nearest neighbour graph. In: 17th International Conference on Pattern Recognition, ICPR 2004, Cambridge, UK, August 23-26, 2004, IEEE Computer Society, pp 430\u2013433. https:\/\/doi.org\/10.1109\/ICPR.2004.1334558","DOI":"10.1109\/ICPR.2004.1334558"},{"key":"3281_CR29","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-015-3994-4","volume-title":"Identification of outliers, Monographs on Applied Probability and Statistics","author":"DM Hawkins","year":"1980","unstructured":"Hawkins DM (1980) Identification of outliers, Monographs on Applied Probability and Statistics. Springer, Berlin. https:\/\/doi.org\/10.1007\/978-94-015-3994-4"},{"key":"3281_CR30","unstructured":"Hendrycks D, Gimpel K (2017) A baseline for detecting misclassified and out-of-distribution examples in neural networks. In: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings, OpenReview.net. https:\/\/openreview.net\/forum?id=Hkg4TI9xl"},{"key":"3281_CR31","doi-asserted-by":"publisher","unstructured":"Hill F, Cho K, Korhonen A (2016) Learning distributed representations of sentences from unlabelled data. In: Knight K, Nenkova A, Rambow O (eds) NAACL HLT 2016, The 2016 conference of the north american chapter of the association for computational linguistics: Human language technologies, san diego california, USA, June 12-17, 2016, The Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/n16-1162, pp 1367\u20131377","DOI":"10.18653\/v1\/n16-1162"},{"key":"3281_CR32","doi-asserted-by":"publisher","unstructured":"Hospedales TM, Gong S, Xiang T (2011) Finding rare classes: Adapting generative and discriminative models in active learning. In: Huang JZ, Cao L, Srivastava J (eds) Advances in Knowledge Discovery and Data Mining - 15th Pacific-Asia Conference, PAKDD 2011, Shenzhen, China, May 24-27, 2011, Proceedings, Part II, Springer, Lecture Notes in Computer Science, vol 6635, pp 296\u2013308. https:\/\/doi.org\/10.1007\/978-3-642-20847-8_25","DOI":"10.1007\/978-3-642-20847-8_25"},{"key":"3281_CR33","doi-asserted-by":"publisher","unstructured":"Jain LP, Scheirer WJ, Boult TE (2014) Multi-class open set recognition using probability of inclusion. In: Fleet DJ, Pajdla T, Schiele B, Tuytelaars T (eds) Computer Vision - ECCV 2014 - 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part III, Springer, Lecture Notes in Computer Science, vol 8691, pp 393\u2013409. https:\/\/doi.org\/10.1007\/978-3-319-10578-9_26","DOI":"10.1007\/978-3-319-10578-9_26"},{"key":"3281_CR34","doi-asserted-by":"publisher","unstructured":"Jain S, Wallace BC (2019) Attention is not explanation. In: Burstein J, Doran C, Solorio T (eds) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, vol 1 (Long and Short Papers). https:\/\/doi.org\/10.18653\/v1\/n19-1357. Association for Computational Linguistics, pp 3543\u20133556","DOI":"10.18653\/v1\/n19-1357"},{"key":"3281_CR35","doi-asserted-by":"crossref","unstructured":"Jiao L, Zhang X, Granmo O, Abeyrathna KD (2021) On the convergence of tsetlin machines for the XOR operator. arXiv:2101.02547","DOI":"10.1109\/TPAMI.2022.3203150"},{"key":"3281_CR36","unstructured":"Kiros R, Zhu Y, Salakhutdinov R, Zemel RS, Urtasun R, Torralba A, Fidler S (2015) Skip-thought vectors. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R (eds) Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, December 7-12, 2015, Montreal, Quebec, Canada, pp 3294\u20133302 . https:\/\/proceedings.neurips.cc\/paper\/2015\/hash\/f442d33fa06832082290ad8544a8da27-Abstract.html"},{"key":"3281_CR37","unstructured":"Kliger M, Fleishman S (2018) Novelty detection with GAN. arXiv:1802.10560"},{"key":"3281_CR38","doi-asserted-by":"publisher","unstructured":"Kumaran G, Allan J (2004) Text classification and named entities for new event detection. In: Sanderson M, J\u00e1rvelin K, Allan J, Bruza P (eds) SIGIR 2004: Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Sheffield, UK, July 25-29, 2004, ACM. https:\/\/doi.org\/10.1145\/1008992.1009044, pp 297\u2013304","DOI":"10.1145\/1008992.1009044"},{"key":"3281_CR39","volume-title":"Testing statistical hypotheses","author":"E LANN","year":"1959","unstructured":"LANN E (1959) Testing statistical hypotheses. Wiley, New York"},{"key":"3281_CR40","doi-asserted-by":"publisher","unstructured":"Li Z, Zhao Y, Botta N, Ionescu C, Hu X (2020) COPOD: Copula-based outlier detection. In: Plant C, Wang H, Cuzzocrea A, Zaniolo C, Wu X (eds) 20Th IEEE international conference on data mining, ICDM 2020, sorrento, italy, november 17-20, 2020, IEEE. https:\/\/doi.org\/10.1109\/ICDM50108.2020.00135, pp 1118\u20131123","DOI":"10.1109\/ICDM50108.2020.00135"},{"issue":"8","key":"3281_CR41","doi-asserted-by":"publisher","first-page":"1517","DOI":"10.1109\/TKDE.2019.2905606","volume":"32","author":"Y Liu","year":"2020","unstructured":"Liu Y, Li Z, Zhou C, Jiang Y, Sun J, Wang M, He X (2020) Generative adversarial active learning for unsupervised outlier detection. IEEE Trans Knowl Data Eng 32(8):1517\u20131528. https:\/\/doi.org\/10.1109\/TKDE.2019.2905606","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"3281_CR42","doi-asserted-by":"publisher","unstructured":"Peters ME, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L (2018) Deep contextualized word representations. In: Walker M A, Ji H, Stent A (eds) Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2018, New Orleans, Louisiana, USA, June 1-6, 2018, vol 1 (Long Papers). https:\/\/doi.org\/10.18653\/v1\/n18-1202. Association for Computational Linguistics, pp 2227\u20132237","DOI":"10.18653\/v1\/n18-1202"},{"key":"3281_CR43","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/j.sigpro.2013.12.026","volume":"99","author":"MAF Pimentel","year":"2014","unstructured":"Pimentel MAF, Clifton DA, Clifton LA, Tarassenko L (2014) A review of novelty detection. Signal Process 99:215\u2013249. https:\/\/doi.org\/10.1016\/j.sigpro.2013.12.026","journal-title":"Signal Process"},{"key":"3281_CR44","unstructured":"Platt JC (1999) Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Advances in large margin classifiers"},{"key":"3281_CR45","unstructured":"Ramos J et al (2003) Using tf-idf to determine word relevance in document queries. In: Proceedings of the first instructional conference on machine learning, pp 29\u201348"},{"key":"3281_CR46","doi-asserted-by":"publisher","unstructured":"Rebuffi S, Kolesnikov A, Sperl G, Lampert CH (2017) icarl: Incremental classifier and representation learning. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA, July 21-26, 2017, IEEE Computer Society, pp 5533\u20135542. https:\/\/doi.org\/10.1109\/CVPR.2017.587","DOI":"10.1109\/CVPR.2017.587"},{"key":"3281_CR47","doi-asserted-by":"publisher","unstructured":"Saha R, Granmo O, Goodwin M (2020) Mining interpretable rules for sentiment and semantic relation analysis using tsetlin machines. In: Bramer M, Ellis R (eds) Artificial Intelligence XXXVII - 40th SGAI International Conference on Artificial Intelligence, AI 2020, Cambridge, UK, December 15-17, 2020, Proceedings, Springer, Lecture Notes in Computer Science, vol 12498, pp 67\u201378. https:\/\/doi.org\/10.1007\/978-3-030-63799-6_5","DOI":"10.1007\/978-3-030-63799-6_5"},{"key":"3281_CR48","doi-asserted-by":"publisher","unstructured":"Salazar J, Liang D, Nguyen TQ, Kirchhoff K (2020) Masked language model scoring. In: Jurafsky D, Chai J, Schluter N, Tetreault J R (eds) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online, July 5-10, 2020, Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.240, pp 2699\u20132712","DOI":"10.18653\/v1\/2020.acl-main.240"},{"issue":"7","key":"3281_CR49","doi-asserted-by":"publisher","first-page":"1757","DOI":"10.1109\/TPAMI.2012.256","volume":"35","author":"WJ Scheirer","year":"2013","unstructured":"Scheirer WJ, de Rezende Rocha A, Sapkota A, Boult TE (2013) Toward open set recognition. IEEE Trans Pattern Anal Mach Intell 35(7):1757\u20131772. https:\/\/doi.org\/10.1109\/TPAMI.2012.256","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"7","key":"3281_CR50","doi-asserted-by":"publisher","first-page":"1443","DOI":"10.1162\/089976601750264965","volume":"13","author":"B Sch\u00f6lkopf","year":"2001","unstructured":"Sch\u00f6lkopf B, Platt JC, Shawe-taylor J, Smola AJ, Williamson RC (2001) Estimating the support of a high-dimensional distribution. Neural Comput 13(7):1443\u20131471. https:\/\/doi.org\/10.1162\/089976601750264965","journal-title":"Neural Comput"},{"key":"3281_CR51","doi-asserted-by":"publisher","unstructured":"Serrano S, Smith NA (2019) Is attention interpretable?. In: Korhonen A, Traum D R, M\u00e1rquez L (eds) Proceedings of the 57th Conference of the Association for Computational Linguistics, ACL 2019, Florence, Italy, July 28- August 2, 2019, vol 1 (Long Papers). https:\/\/doi.org\/10.18653\/v1\/p19-1282. Association for Computational Linguistics, pp 2931\u20132951","DOI":"10.18653\/v1\/p19-1282"},{"key":"3281_CR52","doi-asserted-by":"crossref","unstructured":"Soboroff I, Harman D (2005) Novelty detection: The TREC experience. In: HLT\/EMNLP 2005, Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference, 6-8 October 2005, Vancouver, British Columbia, Canada, The Association for Computational Linguistics, pp 105\u2013112. https:\/\/aclanthology.org\/H05-1014\/","DOI":"10.3115\/1220575.1220589"},{"key":"3281_CR53","doi-asserted-by":"publisher","unstructured":"Sun X, Lu W (2020) Understanding attention for text classification. In: Jurafsky D, Chai J, Schluter N, Tetreault J R (eds) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online, July 5-10, 2020, Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.312, pp 3418\u20133428","DOI":"10.18653\/v1\/2020.acl-main.312"},{"key":"3281_CR54","doi-asserted-by":"publisher","unstructured":"Tax DMJ, Duin RPW (1998) Outlier detection using classifier instability. In: Amin A, Dori D, Pudil P, Freeman H (eds) Advances in pattern recognition, joint IAPR international workshops SSPR \u201998 and SPR \u201998, sydney, NSW, Australia, August 11-13, 1998 (Proceedings, Springer), Lecture Notes in Computer Science, vol 1451. https:\/\/doi.org\/10.1007\/BFb0033283, pp 593\u2013601","DOI":"10.1007\/BFb0033283"},{"issue":"1","key":"3281_CR55","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1023\/B:MACH.0000008084.60811.49","volume":"54","author":"DMJ Tax","year":"2004","unstructured":"Tax DMJ, Duin RPW (2004) Support vector data description. Mach Learn 54(1):45\u201366. https:\/\/doi.org\/10.1023\/B:MACH.0000008084.60811.49","journal-title":"Mach Learn"},{"issue":"12","key":"3281_CR56","doi-asserted-by":"publisher","first-page":"2359","DOI":"10.1016\/j.ins.2010.02.020","volume":"180","author":"FS Tsai","year":"2010","unstructured":"Tsai FS, Tang W, Chan KL (2010) Evaluation of novelty metrics for sentence-level novelty mining. Inf Sci 180(12):2359\u20132374. https:\/\/doi.org\/10.1016\/j.ins.2010.02.020","journal-title":"Inf Sci"},{"key":"3281_CR57","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Guyon I, von Luxburg U, Bengio S, Wallach HM, Fergus R, Vishwanathan SVN, Garnett R (eds) Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA, pp 5998\u20136008. https:\/\/proceedings.neurips.cc\/paper\/2017\/hash\/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html"},{"key":"3281_CR58","doi-asserted-by":"publisher","unstructured":"Wang Y, Huang H, Feng C, Zhou Q, Gu J, Gao X (2016) CSE: Conceptual sentence embeddings based on attention model. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016, August 7-12, 2016, Berlin, Germany, Volume 1 (Long Papers). https:\/\/doi.org\/10.18653\/v1\/p16-1048. The Association for Computer Linguistics","DOI":"10.18653\/v1\/p16-1048"},{"key":"3281_CR59","doi-asserted-by":"crossref","unstructured":"Yadav RK, Jiao L, Granmo O, Goodwin M (2021a) Human-level interpretable learning for aspect-based sentiment analysis. In: In: Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021, AAAI Press, pp 14203\u201314212. https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/17671","DOI":"10.1609\/aaai.v35i16.17671"},{"key":"3281_CR60","doi-asserted-by":"publisher","unstructured":"Yadav RK, Jiao L, Granmo OC, Goodwin M (2021b) Enhancing interpretable clauses semantically using pretrained word representation. In: Proceedings of the Fourth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP, Association for Computational Linguistics, Punta Cana, Dominican Republic, pp 265\u2013274 https:\/\/doi.org\/10.18653\/v1\/2021.blackboxnlp-1.19. https:\/\/aclanthology.org\/2021.blackboxnlp-1.19","DOI":"10.18653\/v1\/2021.blackboxnlp-1.19"},{"key":"3281_CR61","doi-asserted-by":"publisher","unstructured":"Yu Y, Qu W, Li N, Guo Z (2017) Open category classification by adversarial sample generation. In: Sierra C (ed) Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, Melbourne, Australia, August 19-25, 2017, ijcai.org. https:\/\/doi.org\/10.24963\/ijcai.2017\/469, pp 3357\u20133363","DOI":"10.24963\/ijcai.2017\/469"},{"key":"3281_CR62","doi-asserted-by":"publisher","unstructured":"Zhang X, Jiao L, Granmo O, Goodwin M (5555) On the convergence of tsetlin machines for the identity- and not operators. IEEE Transactions on Pattern Analysis & Machine Intelligence pp 1\u20131. https:\/\/doi.org\/10.1109\/TPAMI.2021.3085591","DOI":"10.1109\/TPAMI.2021.3085591"},{"key":"3281_CR63","doi-asserted-by":"publisher","unstructured":"Zhang Y, Tsai FS (2009) Combining named entities and tags for novel sentence detection. In: Proceedings of the WSDM\u201909 Workshop on Exploiting Semantic Annotations in Information Retrieval, Association for Computing Machinery, New York, NY, USA, ESAIR \u201909, p 30\u201334 . https:\/\/doi.org\/10.1145\/1506250.1506256.","DOI":"10.1145\/1506250.1506256."}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-022-03281-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-022-03281-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-022-03281-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,19]],"date-time":"2022-11-19T10:29:41Z","timestamp":1668853781000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-022-03281-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,2]]},"references-count":64,"journal-issue":{"issue":"15","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["3281"],"URL":"https:\/\/doi.org\/10.1007\/s10489-022-03281-1","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"value":"0924-669X","type":"print"},{"value":"1573-7497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,2]]},"assertion":[{"value":"20 January 2022","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 April 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflict of Interests"}}]}}