{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T02:42:02Z","timestamp":1747190522189,"version":"3.40.5"},"reference-count":32,"publisher":"Wiley","license":[{"start":{"date-parts":[[2021,5,17]],"date-time":"2021-05-17T00:00:00Z","timestamp":1621209600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Tsinghua University Humanities and Social Sciences Revitalization Project","award":["2019THZWJC38","20202000291","62073284","61603331","2019YFB1406300"],"award-info":[{"award-number":["2019THZWJC38","20202000291","62073284","61603331","2019YFB1406300"]}]},{"name":"Project of Baidu Netcom Technology Co. Ltd. Open Source Course and Case Construction Based on the Deep Learning Framework PaddlePaddle","award":["2019THZWJC38","20202000291","62073284","61603331","2019YFB1406300"],"award-info":[{"award-number":["2019THZWJC38","20202000291","62073284","61603331","2019YFB1406300"]}]},{"name":"Distributed Secure Estimation of Multi-sensor Systems Subject to Stealthy Attacks","award":["2019THZWJC38","20202000291","62073284","61603331","2019YFB1406300"],"award-info":[{"award-number":["2019THZWJC38","20202000291","62073284","61603331","2019YFB1406300"]}]},{"name":"Multi-sensor-based Estimation Theory and Algorithms with Clustering Hierarchical Structures","award":["2019THZWJC38","20202000291","62073284","61603331","2019YFB1406300"],"award-info":[{"award-number":["2019THZWJC38","20202000291","62073284","61603331","2019YFB1406300"]}]},{"name":"National Key Research and Development Program of China","award":["2019THZWJC38","20202000291","62073284","61603331","2019YFB1406300"],"award-info":[{"award-number":["2019THZWJC38","20202000291","62073284","61603331","2019YFB1406300"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Applied Mathematics"],"published-print":{"date-parts":[[2021,5,17]]},"abstract":"Key\n \n n<\/a:mi>\n <\/a:math>\n <\/jats:inline-formula>-gram extraction can be seen as extracting \n \n n<\/c:mi>\n <\/c:math>\n <\/jats:inline-formula>-grams which can distinguish different registers. Keyword (as \n \n n<\/e:mi>\n =<\/e:mo>\n 1<\/e:mn>\n <\/e:math>\n <\/jats:inline-formula>, 1-gram is the keyword) extraction models are generally carried out from two aspects, the feature extraction and the model design. By summarizing the advantages and disadvantages of existing models, we propose a novel key \n \n n<\/g:mi>\n <\/g:math>\n <\/jats:inline-formula>-gram extraction model \u201cattentive \n \n n<\/i:mi>\n <\/i:math>\n <\/jats:inline-formula>-gram network\u201d (ANN) based on the attention mechanism and multilayer perceptron, in which the attention mechanism scores each \n \n n<\/k:mi>\n <\/k:math>\n <\/jats:inline-formula>-gram in a sentence by mining the internal semantic relationship between words, and their importance is given by the scores. Experimental results on the real corpus show that the key \n \n n<\/m:mi>\n <\/m:math>\n <\/jats:inline-formula>-gram extracted from our model can distinguish a novel, news, and text book very well; the accuracy of our model is significantly higher than the baseline model. Also, we conduct experiments on key \n \n n<\/o:mi>\n <\/o:math>\n <\/jats:inline-formula>-grams extracted from these registers, which turned out to be well clustered. Furthermore, we make some statistical analyses of the results of key \n \n n<\/q:mi>\n <\/q:math>\n <\/jats:inline-formula>-gram extraction. We find that the key \n \n n<\/s:mi>\n <\/s:math>\n <\/jats:inline-formula>-grams extracted by our model are very explanatory in linguistics.<\/jats:p>","DOI":"10.1155\/2021\/5264090","type":"journal-article","created":{"date-parts":[[2021,5,18]],"date-time":"2021-05-18T17:51:43Z","timestamp":1621360303000},"page":"1-16","source":"Crossref","is-referenced-by-count":1,"title":["Key \n n<\/a:mi>\n <\/a:math>-Gram Extractions and Analyses of Different Registers Based on Attention Network"],"prefix":"10.1155","volume":"2021","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0722-3042","authenticated-orcid":true,"given":"Haiyan","family":"Wu","sequence":"first","affiliation":[{"name":"Zhejiang University of Finance and Economics, Hangzhou 310018, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1230-6395","authenticated-orcid":true,"given":"Ying","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Humanities, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1524-7132","authenticated-orcid":true,"given":"Shaoyun","family":"Shi","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Institute for Artificial Intelligence, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingfeng","family":"Wu","sequence":"additional","affiliation":[{"name":"Chengdu Polytechnic, Chengdu 610095, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8694-3717","authenticated-orcid":true,"given":"Yunlong","family":"Huang","sequence":"additional","affiliation":[{"name":"Beijing Normal University, Beijing 100875, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","reference":[{"issue":"2","key":"1","first-page":"7","article-title":"Russian register of patients with chronic myeloid leukemia","volume":"52","author":"A. G. Turkina","year":"2007","journal-title":"Gematologiya i transfuziologiya"},{"volume-title":"N-gram Based Text Categorization","year":"2005","author":"P. N\u00e1ther","key":"2"},{"first-page":"2241","article-title":"Keyword extraction from online product reviews based on bi-directional lstm recurrent neural network","author":"Y. Wang","key":"3"},{"first-page":"412","article-title":"Vietnamese keyword extraction using hybrid deep learning methods","author":"B. T. Hung","key":"4"},{"first-page":"2109","article-title":"Research on keyword extraction based on word2vec weighted textrank","author":"Y. Wen","key":"5"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2007.01.015"},{"issue":"11","key":"7","first-page":"2344","article-title":"Tag-textrank: a webpage keyword extraction method based on tags","volume":"49","author":"L. Peng","year":"2012","journal-title":"Journal of Computer Research and Development"},{"article-title":"Improved automatic keyword extraction given more linguistic knowledge","author":"A. Hulth","key":"8","doi-asserted-by":"crossref","DOI":"10.3115\/1119355.1119383"},{"issue":"1","key":"9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5120\/ijca2017913171","article-title":"Unsupervised key-phrase extraction using noun phrases","volume":"162","author":"S. S. Kathait","year":"2017","journal-title":"International Journal of Computer Applications"},{"key":"10","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.eswa.2017.12.025","article-title":"A graph based keyword extraction model using collective node weight","volume":"97","author":"S. K. Biswas","year":"2018","journal-title":"Expert Systems with Applications"},{"issue":"11","key":"11","doi-asserted-by":"crossref","DOI":"10.1177\/1550147718811107","article-title":"Keywords extraction in Chinese\u2013Vietnamese bilingual news based on hypergraph","volume":"14","author":"J. Zhai","year":"2018","journal-title":"International Journal of Distributed Sensor Networks"},{"key":"12","first-page":"43","article-title":"Corpus technology and application","volume":"5","author":"B. Chang","year":"2009","journal-title":"Language Study"},{"key":"13","first-page":"70","article-title":"Chinese linguistics research in the age of big data","volume":"5","author":"W. Zhan","year":"2013","journal-title":"Journal of Shanxi University"},{"volume-title":"Keyword Extraction using Naive Bayes","year":"2005","author":"Y. Uzun","key":"14"},{"key":"15","first-page":"85","article-title":"Keyword extraction using support vector machine","volume-title":"WAIM","author":"K. Zhang","year":"2006"},{"first-page":"34","article-title":"Keyword extraction based on sequential pattern mining","author":"J. Feng","key":"16"},{"issue":"3","key":"17","first-page":"1169","article-title":"Automatic keyword extraction from documents using conditional random fields","volume":"4","author":"C. Zhang","year":"2008","journal-title":"The Journal of Computer Information Systems"},{"author":"D. Bahdanau","key":"18","article-title":"Neural machine translation by jointly learning to align and translate"},{"author":"N. Pappas","key":"19","article-title":"Multilingual hierarchical attention networks for document classification"},{"first-page":"1150","article-title":"Visualizing and understanding neural machine translation","author":"Y. Ding","key":"20"},{"issue":"7553","key":"21","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"Y. LeCun","year":"2015","journal-title":"Nature"},{"first-page":"578","article-title":"Why tanh: choosing a sigmoidal function","author":"B. L. Kalman","key":"22"},{"key":"23","doi-asserted-by":"publisher","DOI":"10.1016\/s0893-6080(05)80131-5"},{"volume-title":"Deep Learning","year":"2016","author":"I. Goodfellow","key":"24"},{"volume-title":"Pattern Recognition and Machine Learning","year":"2006","author":"C. M. Bishop","key":"25"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1007\/s10479-005-5724-z"},{"author":"D. P. Kingma","key":"27","article-title":"Adam: a method for stochastic optimization"},{"key":"28","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3203.536"},{"volume-title":"A Corpus-Based Study of Lexical Patterns in Chinese-English Simultaneous Transmission","year":"2012","author":"D. Li","key":"29"},{"issue":"2","key":"30","first-page":"313","article-title":"Building a large annotated corpus of english: the penn treebank","volume":"19","author":"M. P. Marcus","year":"1993","journal-title":"Computational Linguistics"},{"key":"31","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1075\/hcp.37.15lan","article-title":"Linguistic manifestations of the space-time (dis) analogy","volume-title":"Space and Time in Languages and Cultures: Language, Culture, and Cognition","author":"R. W. Langacker","year":"2012"},{"article-title":"Clustering with t-sne, provably","author":"G. C. Linderman","key":"32","doi-asserted-by":"crossref","DOI":"10.1137\/18M1216134"}],"container-title":["Journal of Applied Mathematics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/jam\/2021\/5264090.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/jam\/2021\/5264090.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/jam\/2021\/5264090.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,18]],"date-time":"2021-05-18T17:52:15Z","timestamp":1621360335000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/jam\/2021\/5264090\/"}},"subtitle":[],"editor":[{"given":"Mariano","family":"Torrisi","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,5,17]]},"references-count":32,"alternative-id":["5264090","5264090"],"URL":"https:\/\/doi.org\/10.1155\/2021\/5264090","relation":{},"ISSN":["1687-0042","1110-757X"],"issn-type":[{"type":"electronic","value":"1687-0042"},{"type":"print","value":"1110-757X"}],"subject":[],"published":{"date-parts":[[2021,5,17]]}}}