{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,4,24]],"date-time":"2024-04-24T02:15:02Z","timestamp":1713924902049},"reference-count":40,"publisher":"World Scientific Pub Co Pte Ltd","issue":"04","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Semantic Computing"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:p> Developing semantic hierarchies from user-created hashtags in social media can provide useful organizational structure to large volumes of data. However, construction of these hierarchies is difficult using established ontologies (e.g. WordNet [C. Fellbaum (ed.), WordNet: An Electronic Lexical Database (MIT Press, Cambridge, MA, 1998)]) due to the differences in the semantic and pragmatic use of words versus hashtags in social media. While alternative construction methods based on hashtag frequency are relatively straightforward, these methods can be susceptible to the dynamic nature of social media, such as hashtags with brief surges in popularity. We drew inspiration from the ecologically based Shannon Diversity Index (SDI) [J. L. Wilhm, Use of biomass units in Shannon\u2019s formula, Ecology\u00a049(1) (1968) 153\u2013156] to create a more representative and resilient method of semantic hierarchy construction that relies upon network-based community detection and a novel, entropy-based ensemble diversity index (EDI) score. The EDI quantifies the contextual diversity of each hashtag, resulting in thousands of semantically related groups of hashtags organized along a general-to-specific spectrum. Through an application of EDI to social media data (Twitter and Parler) and a comparison of our results to prior approaches, we demonstrate our method\u2019s ability to create semantically consistent hierarchies that can be flexibly applied and adapted to a range of use cases. <\/jats:p>","DOI":"10.1142\/s1793351x22500052","type":"journal-article","created":{"date-parts":[[2022,7,9]],"date-time":"2022-07-09T03:28:15Z","timestamp":1657337295000},"page":"473-496","source":"Crossref","is-referenced-by-count":2,"title":["Automated Hashtag Hierarchy Generation Using Community Detection and the Shannon Diversity Index, with Applications to Twitter and Parler"],"prefix":"10.1142","volume":"16","author":[{"given":"Spencer","family":"Torene","sequence":"first","affiliation":[{"name":"Thomson Reuters Special Services, LLC, 1410 Spring Hill Road Suite 125, McLean, VA 22102, USA"}]},{"given":"Andrew","family":"Follmann","sequence":"additional","affiliation":[{"name":"Thomson Reuters Special Services, LLC, 1410 Spring Hill Road Suite 125, McLean, VA 22102, USA"}]},{"given":"Thomas","family":"Teague","sequence":"additional","affiliation":[{"name":"Thomson Reuters Special Services, LLC, 1410 Spring Hill Road Suite 125, McLean, VA 22102, USA"}]},{"given":"Peter","family":"Chang","sequence":"additional","affiliation":[{"name":"Thomson Reuters Special Services, LLC, 1410 Spring Hill Road Suite 125, McLean, VA 22102, USA"}]},{"given":"Blake","family":"Howald","sequence":"additional","affiliation":[{"name":"Thomson Reuters Special Services, LLC, 1410 Spring Hill Road Suite 125, McLean, VA 22102, USA"}]}],"member":"219","published-online":{"date-parts":[[2022,8,27]]},"reference":[{"key":"S1793351X22500052BIB001","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7287.001.0001"},{"key":"S1793351X22500052BIB002","doi-asserted-by":"publisher","DOI":"10.2307\/1933573"},{"key":"S1793351X22500052BIB003","first-page":"104","volume-title":"Proc. Int. Conf. Recent Advances in Natural Language Processing","author":"Declerck T.","year":"2015"},{"key":"S1793351X22500052BIB004","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1242"},{"key":"S1793351X22500052BIB005","first-page":"2981","volume-title":"Proc. Tenth Int. Conf. Language Resources and Evaluation","author":"\u00c7elebi A.","year":"2016"},{"key":"S1793351X22500052BIB006","doi-asserted-by":"publisher","DOI":"10.1145\/2063576.2063726"},{"key":"S1793351X22500052BIB007","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24282-8_21"},{"key":"S1793351X22500052BIB008","doi-asserted-by":"publisher","DOI":"10.26615\/978-954-452-049-6_038"},{"key":"S1793351X22500052BIB009","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1046"},{"key":"S1793351X22500052BIB010","first-page":"3019","volume-title":"Proc. COLING 2016, 26th Int. Conf. Computational Linguistics: Technical Papers","author":"Li Y.","year":"2016"},{"key":"S1793351X22500052BIB011","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240772"},{"key":"S1793351X22500052BIB012","volume-title":"Proc. VLDB 2012 Workshop on Online Social Systems","author":"Ozdikis O.","year":"2012"},{"key":"S1793351X22500052BIB013","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1067"},{"key":"S1793351X22500052BIB014","first-page":"321","volume-title":"Second Joint Conf. Lexical and Computational Semantics (*SEM), Proc. Seventh Int. Workshop on Semantic Evaluation","volume":"2","author":"Mohammad S.","year":"2013"},{"key":"S1793351X22500052BIB015","first-page":"1524","volume-title":"Proc. 2011 Conf. Empirical Methods in Natural Language Processing","author":"Ritter A.","year":"2011"},{"key":"S1793351X22500052BIB017","volume-title":"Proc. 2nd Web Science Conf.","author":"Benz D.","year":"2010"},{"issue":"2","key":"S1793351X22500052BIB019","series-title":"Lecture Notes in Computer Science (Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)","first-page":"360","volume-title":"The Semantic Web: Research and Applications","volume":"6643","author":"Benz D.","year":"2011"},{"key":"S1793351X22500052BIB020","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2012.09.003"},{"key":"S1793351X22500052BIB021","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-13734-6_7"},{"key":"S1793351X22500052BIB022","doi-asserted-by":"publisher","DOI":"10.1145\/2559157"},{"key":"S1793351X22500052BIB023","doi-asserted-by":"publisher","DOI":"10.1109\/ICSC52841.2022.00016"},{"key":"S1793351X22500052BIB024","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390425"},{"key":"S1793351X22500052BIB025","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816706"},{"key":"S1793351X22500052BIB027","first-page":"11","volume-title":"Proc. 7th Python in Science Conf.","author":"Hagberg A. A.","year":"2008"},{"key":"S1793351X22500052BIB028","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.76.036106"},{"key":"S1793351X22500052BIB029","volume-title":"Natural Language Processing with Python","author":"Bird S.","year":"2009"},{"key":"S1793351X22500052BIB030","first-page":"1736","volume":"32","author":"Liu X.","year":"2018","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"S1793351X22500052BIB032","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806533"},{"key":"S1793351X22500052BIB033","doi-asserted-by":"publisher","DOI":"10.1145\/2213836.2213891"},{"key":"S1793351X22500052BIB034","doi-asserted-by":"publisher","DOI":"10.3233\/SW-140134"},{"key":"S1793351X22500052BIB035","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2009.08.004"},{"key":"S1793351X22500052BIB036","doi-asserted-by":"publisher","DOI":"10.1016\/j.proeng.2011.11.2410"},{"key":"S1793351X22500052BIB037","doi-asserted-by":"publisher","DOI":"10.1007\/s11071-015-2595-y"},{"key":"S1793351X22500052BIB038","doi-asserted-by":"publisher","DOI":"10.1201\/9781315140919"},{"key":"S1793351X22500052BIB039","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-009-0203-5"},{"key":"S1793351X22500052BIB040","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2016.183"},{"key":"S1793351X22500052BIB041","doi-asserted-by":"publisher","DOI":"10.1088\/1742-5468\/2008\/10\/P10008"},{"key":"S1793351X22500052BIB042","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.70.066111"},{"key":"S1793351X22500052BIB046","doi-asserted-by":"publisher","DOI":"10.1145\/2309996.2310034"},{"key":"S1793351X22500052BIB047","doi-asserted-by":"publisher","DOI":"10.1038\/srep45380"}],"container-title":["International Journal of Semantic Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S1793351X22500052","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T09:30:19Z","timestamp":1665394219000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S1793351X22500052"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,27]]},"references-count":40,"journal-issue":{"issue":"04","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["10.1142\/S1793351X22500052"],"URL":"https:\/\/doi.org\/10.1142\/s1793351x22500052","relation":{},"ISSN":["1793-351X","1793-7108"],"issn-type":[{"value":"1793-351X","type":"print"},{"value":"1793-7108","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,27]]}}}