{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T18:36:36Z","timestamp":1781375796471,"version":"3.54.1"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,5,25]],"date-time":"2024-05-25T00:00:00Z","timestamp":1716595200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,25]],"date-time":"2024-05-25T00:00:00Z","timestamp":1716595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006302","name":"Universidad de Alcal\u00e1","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006302","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Lang Resources &amp; Evaluation"],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>The objective of this paper is to describe Cryptocurrency Linguo (CryptoLin), a novel corpus containing 2683 cryptocurrency-related news articles covering more than a three-year period. CryptoLin was human-annotated with discrete values representing negative, neutral, and positive news respectively. Eighty-three people participated in the annotation process; each news title was randomly assigned and blindly annotated by three human annotators, one in each different cohort, followed by a consensus mechanism using simple voting. The selection of the annotators was intentionally made using three cohorts with students from a very diverse set of nationalities and educational backgrounds to minimize bias as much as possible. In case one of the annotators was in total disagreement with the other two (e.g., one negative vs two positive or one positive vs two negative), we considered this minority report and defaulted the labeling to neutral. Fleiss\u2019s Kappa, Krippendorff\u2019s Alpha, and Gwet\u2019s AC1 inter-rater reliability coefficients demonstrate CryptoLin\u2019s acceptable quality of inter-annotator agreement. The dataset also includes a text span with the three manual label annotations for further auditing of the annotation mechanism. To further assess the quality of the labeling and the usefulness of CryptoLin dataset, it incorporates four pretrained Sentiment Analysis models: Vader, Textblob, Flair, and FinBERT. Vader and FinBERT demonstrate reasonable performance in the CryptoLin dataset, indicating that the data was not annotated randomly and is therefore useful for further research1. FinBERT (negative) presents the best performance, indicating an advantage of being trained with financial news. Both the CryptoLin dataset and the Jupyter Notebook with the analysis, for reproducibility, are available at the project\u2019s Github. Overall, CryptoLin aims to complement the current knowledge by providing a novel and publicly available Gadi and\u00a0\u00c1ngel Sicilia (Cryptolin dataset and python jupyter notebooks reproducibility codes, 2022) cryptocurrency sentiment corpus and fostering research on the topic of cryptocurrency sentiment analysis and potential applications in behavioral science. This can be useful for businesses and policymakers who want to understand how cryptocurrencies are being used and how they might be regulated. Finally, the rules for selecting and assigning annotators make CryptoLin unique and interesting for new research in annotator selection, assignment, and biases.<\/jats:p>","DOI":"10.1007\/s10579-024-09743-x","type":"journal-article","created":{"date-parts":[[2024,5,25]],"date-time":"2024-05-25T08:01:36Z","timestamp":1716624096000},"page":"871-889","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A sentiment corpus for the cryptocurrency financial domain: the CryptoLin corpus"],"prefix":"10.1007","volume":"59","author":[{"given":"Manoel Fernando Alonso","family":"Gadi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Miguel \u00c1ngel","family":"Sicilia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,5,25]]},"reference":[{"key":"9743_CR1","unstructured":"Abraham, J., Higdon, D.W., Nelson, J., & Ibarra, J. (2018). Cryptocurrency price prediction using tweet volumes and sentiment analysis."},{"key":"9743_CR2","unstructured":"Akbik, A. (2019). Flair nlp library. https:\/\/github.com\/flairNLP"},{"key":"9743_CR3","doi-asserted-by":"publisher","DOI":"10.1201\/9780429258589","volume-title":"Practical statistics for medical research","author":"DG Altman","year":"1990","unstructured":"Altman, D. G. (1990). Practical statistics for medical research. CRC Press."},{"key":"9743_CR4","volume":"126","author":"L Ante","year":"2021","unstructured":"Ante, L. (2021). How Elon Musk\u2019s twitter activity moves cryptocurrency markets. Advertising & Marketing Law eJournal, 126, 122112.","journal-title":"Advertising & Marketing Law eJournal"},{"key":"9743_CR5","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3778844","author":"L Ante","year":"2022","unstructured":"Ante, L. (2022). How Elon Musk\u2019s twitter activity moves cryptocurrency markets. SSRN Electronic Journal. https:\/\/doi.org\/10.2139\/ssrn.3778844","journal-title":"SSRN Electronic Journal"},{"key":"9743_CR6","doi-asserted-by":"crossref","unstructured":"Beck, J., Huang, R., Lindner, D., Guo, T., Zhang, C., Helbing, D., & Antulov-Fantulin, N. (2019). Sensing social media signals for cryptocurrency news. Preprint retrieved from https:\/\/arxiv.org\/abs\/1903.11451","DOI":"10.1145\/3308560.3316706"},{"key":"9743_CR7","unstructured":"CFI. (2023). Important dividend dates\u2014overview, key dates, examples, 2023. https:\/\/corporatefinanceinstitute.com\/resources\/knowledge\/finance\/important-dividend-dates\/"},{"key":"9743_CR8","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1037\/1040-3590.6.4.284","volume":"6","author":"DV Cicchetti","year":"1994","unstructured":"Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284\u2013290. https:\/\/doi.org\/10.1037\/1040-3590.6.4.284","journal-title":"Psychological Assessment"},{"key":"9743_CR9","unstructured":"CoinMarketCal. (2022). Coinmarketcal crypto news. https:\/\/coinmarketcal.com\/en\/news"},{"key":"9743_CR10","unstructured":"Daudert, T. (2020). A web-based collaborative annotation and consolidation tool. In Proceedings of the 12th language resources and evaluation conference (pp. 7053\u20137059). European Language Resources Association."},{"key":"9743_CR11","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-021-09555-3","author":"T Daudert","year":"2022","unstructured":"Daudert, T. (2022). A multi-source entity-level sentiment corpus for the financial domain: The finlin corpus. Language Resources and Evaluation. https:\/\/doi.org\/10.1007\/s10579-021-09555-3","journal-title":"Language Resources and Evaluation"},{"key":"9743_CR12","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1016\/j.frl.2018.01.005","volume":"26","author":"E Demir","year":"2018","unstructured":"Demir, E., Gozgor, G., Lau, C. K. M., & Vigne, S. A. (2018). Does economic policy uncertainty predict the bitcoin returns? An empirical investigation. Finance Research Letters, 26, 145\u2013149. https:\/\/doi.org\/10.1016\/j.frl.2018.01.005","journal-title":"Finance Research Letters"},{"key":"9743_CR14","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1037\/h0031619","volume":"76","author":"JL Fleiss","year":"1971","unstructured":"Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76, 378\u2013382. https:\/\/doi.org\/10.1037\/h0031619","journal-title":"Psychological Bulletin"},{"key":"9743_CR15","unstructured":"French, K.R. (2022). Fama french data set. https:\/\/mba.tuck.dartmouth.edu\/pages\/faculty\/ken.french\/ftp\/F-F_Research_Data_Factors_daily_CSV.zip"},{"key":"9743_CR16","unstructured":"Gadi, M.F.A., & \u00c1ngel Sicilia, M. (2022). Cryptolin dataset and python jupyter notebooks reproducibility codes. https:\/\/github.com\/manoelgadi\/cryptolin"},{"key":"9743_CR17","unstructured":"Go, A., Bhayani, R., & Huang, L. (2009). Twitter sentiment classification using distant supervision, Processing 1\u20136. http:\/\/www.stanford.edu\/~alecmgo\/papers\/TwitterDistantSupervision09.pdf."},{"key":"9743_CR18","doi-asserted-by":"publisher","first-page":"201","DOI":"10.22452\/MJES.vol56no2.2","volume":"56","author":"I Gurrib","year":"2019","unstructured":"Gurrib, I., Kweh, Q. L., Nourani, M., & Ting, I. W. K. (2019). Are cryptocurrencies affected by their asset class movements or news announcements? Malaysian Journal of Economic Studies, 56, 201\u2013225.","journal-title":"Malaysian Journal of Economic Studies"},{"key":"9743_CR19","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1348\/000711006x126600","volume":"61","author":"KL Gwet","year":"2008","unstructured":"Gwet, K. L. (2008). Computing inter-rater reliability and its variance in the presence of high agreement. British Journal of Mathematical and Statistical Psychology, 61, 29\u201348. https:\/\/doi.org\/10.1348\/000711006x126600","journal-title":"British Journal of Mathematical and Statistical Psychology"},{"issue":"25","key":"9743_CR20","doi-asserted-by":"publisher","first-page":"729","DOI":"10.21105\/joss.00729","volume":"3","author":"S Haghighi","year":"2018","unstructured":"Haghighi, S., Jasemi, M., & Hessabi, S. (2018). PyCM: Multiclass confusion matrix library in Python. Journal of Open Source Software, 3(25), 729.","journal-title":"Journal of Open Source Software"},{"key":"9743_CR21","unstructured":"Hutto, C., Gilbert, E. (2014). Vader-sentiment-analysis. https:\/\/github.com\/cjhutto\/vaderSentiment"},{"key":"9743_CR22","unstructured":"Ider, D. (2022). Cryptocurrency return prediction using investor sentiment extracted by bert-based classifiers from news articles, reddit posts and tweets. Preprint retrieved form http:\/\/arxiv.org\/abs\/2204.05781"},{"key":"9743_CR13","unstructured":"Investopedia. (2024). Fama and french three factor model definition: Formula and interpretation. Retrieved\u00a0January 29, 2024, from\u00a0https:\/\/www.investopedia.com\/terms\/f\/famaandfrenchthreefactormodel.asp"},{"key":"9743_CR23","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1007\/s10579-021-09562-4","volume":"56","author":"Gilles Jacobs","year":"2022","unstructured":"Jacobs, Gilles, & Veronique, Hoste. (2022). SENTiVENT\u202f: Enabling supervised information extraction of company-specific events in economic and financial news. Language Resources and Evaluation, 56, 225\u2013257. https:\/\/doi.org\/10.1007\/s10579-021-09562-4","journal-title":"Language Resources and Evaluation"},{"key":"9743_CR24","unstructured":"Khurshid, A. R. (2017). Cryptocurrency price prediction using sentiment analysis. In Proceedings of conference. Washington, DC, USA (Vol. 17)."},{"key":"9743_CR25","volume-title":"Cryptocurrency crashes: A dataset for measuring the effect of regulatory news in online media","author":"A Klein","year":"2019","unstructured":"Klein, A., Kirilov, L., & Riekert, M. (2019). Cryptocurrency crashes: A dataset for measuring the effect of regulatory news in online media. CEUR."},{"key":"9743_CR26","volume-title":"Crypto asset taxonomy classification and crypto news sentiment analysis","author":"O K\u00f6se","year":"2020","unstructured":"K\u00f6se, O. (2020). Crypto asset taxonomy classification and crypto news sentiment analysis. Middle East Technical University."},{"key":"9743_CR27","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-08974-9_54","volume-title":"Handling disagreement in hate speech modelling","author":"P Kralj Novak","year":"2022","unstructured":"Kralj Novak, P., Scantamburlo, T., Pelicon, A., Cinelli, M., Mozeti\u010d, I., & Zollo, F. (2022). Handling disagreement in hate speech modelling. Springer."},{"key":"9743_CR28","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1111\/j.1468-2958.2004.tb00738.x","volume":"30","author":"K Krippendorff","year":"2006","unstructured":"Krippendorff, K. (2006). Reliability in content analysis: Some common misconceptions and recommendations. Human Communication Research, 30, 411\u2013433. https:\/\/doi.org\/10.1111\/j.1468-2958.2004.tb00738.x","journal-title":"Human Communication Research"},{"key":"9743_CR29","first-page":"1","volume":"1","author":"C Lamon","year":"2017","unstructured":"Lamon, C., Nielsen, E., & Redondo, E. (2017). Cryptocurrency price prediction using news and social media sentiment. SMU Data Science Review, 1, 1\u201322.","journal-title":"SMU Data Science Review"},{"key":"9743_CR30","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159. https:\/\/doi.org\/10.2307\/2529310","journal-title":"Biometrics"},{"key":"9743_CR31","doi-asserted-by":"crossref","unstructured":"Liu, Z. (2020). Finbert: A pre-trained financial language representation model for financial text mining. https:\/\/www.researchgate.net\/profile\/Kei-Nakagawa-3\/publication","DOI":"10.24963\/ijcai.2020\/622"},{"key":"9743_CR32","doi-asserted-by":"publisher","DOI":"10.1016\/j.physa.2019.122952","volume":"538","author":"K Liu","year":"2020","unstructured":"Liu, K., Weng, T., Gu, C., & Yang, H. (2020). Visibility graph analysis of bitcoin price series. Physica A: Statistical Mechanics and its Applications, 538, 122952. https:\/\/doi.org\/10.1016\/j.physa.2019.122952","journal-title":"Physica A: Statistical Mechanics and its Applications"},{"key":"9743_CR33","unstructured":"Loria, S. (2013). Textblob sentiment analysis. https:\/\/github.com\/sloria\/TextBlob"},{"key":"9743_CR34","doi-asserted-by":"publisher","DOI":"10.1016\/j.jedc.2020.103980","volume":"119","author":"\u0160tefan Ly\u00f3csa","year":"2020","unstructured":"Ly\u00f3csa, \u0160tefan, Mon\u00e1r, P., Pl\u00edhal, T., & \u0160ira\u0148ov\u00e1, M. (2020). Impact of macroeconomic news, regulation and hacking exchange markets on the volatility of bitcoin. Journal of Economic Dynamics and Control, 119, 103980. https:\/\/doi.org\/10.1016\/j.jedc.2020.103980","journal-title":"Journal of Economic Dynamics and Control"},{"key":"9743_CR35","unstructured":"Maas, A., Daly, R. E., Pham, P. T., Huang, D., Ng, A. Y., & Potts, C. (2011). Learning word vectors for sentiment analysis. In Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies (pp. 142-150). Association for Computational Linguistics."},{"key":"9743_CR36","doi-asserted-by":"publisher","first-page":"1385","DOI":"10.1111\/acfi.12466","volume":"60","author":"T Marty","year":"2020","unstructured":"Marty, T., Vanstone, B., & Hahn, T. (2020). News media analytics in finance: A survey. Accounting and Finance, 60, 1385\u20131434.","journal-title":"Accounting and Finance"},{"key":"9743_CR37","doi-asserted-by":"crossref","unstructured":"Meireles, O.R., Rosman, G., Altieri, M.S., Carin, L., Hager, G., Madani, A., Padoy, N., Pugh, C.M., Sylla, P., Ward, T.M., Hashimoto, D.A., V.\u00a0A. t.S. (2021). for AI\u00a0Working\u00a0Groups, Sages consensus recommendations on an annotation framework for surgical video.","DOI":"10.1007\/s00464-021-08578-9"},{"key":"9743_CR38","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0155036","volume":"11","author":"I Mozeti\u010d","year":"2016","unstructured":"Mozeti\u010d, I., Gr\u010dar, M., & Smailovi\u0107, J. (2016). Multilingual twitter sentiment classification: The role of human annotators. PloS ONE, 11, e0155036.","journal-title":"PloS ONE"},{"key":"9743_CR39","unstructured":"Nakamoto, S. (2008). Bitcoin.org, Bitcoin: a peer-to-peer electronic cash system 9. https:\/\/bitcoin.org\/bitcoin.pdf."},{"key":"9743_CR40","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1016\/j.ribaf.2019.01.011","volume":"48","author":"TVH Nguyen","year":"2019","unstructured":"Nguyen, T. V. H., Nguyen, B. T., Nguyen, K. S., & Pham, H. (2019). Asymmetric monetary policy effects on cryptocurrency markets. Research in International Business and Finance, 48, 335\u2013339. https:\/\/doi.org\/10.1016\/j.ribaf.2019.01.011","journal-title":"Research in International Business and Finance"},{"key":"9743_CR41","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1108\/JFEP-10-2018-0147","volume":"11","author":"AHA Othman","year":"2019","unstructured":"Othman, A. H. A., Alhabshi, S. M., & Haron, R. (2019). The effect of symmetric and asymmetric information on volatility structure of crypto-currency markets. Journal of Financial Economic Policy, 11, 432\u2013450. https:\/\/doi.org\/10.1108\/JFEP-10-2018-0147","journal-title":"Journal of Financial Economic Policy"},{"key":"9743_CR42","first-page":"97","volume-title":"Annotated corpora and annotation tools","author":"M Poesio","year":"2016","unstructured":"Poesio, M., Pradhan, S., Recasens, M., Rodriguez, K., & Versley, Y. (2016). Annotated corpora and annotation tools (pp. 97\u2013140). Springer."},{"key":"9743_CR43","doi-asserted-by":"publisher","DOI":"10.3390\/informatics10010005","author":"A Pozzi","year":"2023","unstructured":"Pozzi, A., Barbierato, E., & Toti, D. (2023). Cryptoblend: An ai-powered tool for aggregation and summarization of cryptocurrency news. Informatics. https:\/\/doi.org\/10.3390\/informatics10010005","journal-title":"Informatics"},{"key":"9743_CR44","doi-asserted-by":"crossref","unstructured":"Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C.D., Ng, A., & Potts, C. (2013). Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the 2013 conference on empirical methods in natural language processing (pp. 1631\u20131642). Association for Computational Linguistics.","DOI":"10.18653\/v1\/D13-1170"},{"key":"9743_CR45","unstructured":"Teo, B.G. (2021). Estimating stock returns with Fama-French three-factor model in Python (English). https:\/\/medium.com\/the-handbook-of-coding-in-finance\/estimating-stock-returns-with-fama-french-three-factor-model-in-python-1a98e3936859"},{"key":"#cr-split#-9743_CR46.1","unstructured":"ZeeBiz WebTeam. (2023). Hindustan zinc dividend 2023: Stock trades ex-date today"},{"key":"#cr-split#-9743_CR46.2","unstructured":"shares gain, 2023. ZEE Business.https:\/\/www.zeebiz.com\/markets\/stocks\/news-hindustan-zinc-dividend-2023-stock-trades-ex-date-today-shares-gain-244154"}],"container-title":["Language Resources and Evaluation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-024-09743-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10579-024-09743-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-024-09743-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,18]],"date-time":"2025-05-18T15:02:45Z","timestamp":1747580565000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10579-024-09743-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,25]]},"references-count":47,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["9743"],"URL":"https:\/\/doi.org\/10.1007\/s10579-024-09743-x","relation":{},"ISSN":["1574-020X","1574-0218"],"issn-type":[{"value":"1574-020X","type":"print"},{"value":"1574-0218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,25]]},"assertion":[{"value":"16 April 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 May 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}