{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T00:55:28Z","timestamp":1768265728399,"version":"3.49.0"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Lang Resources & Evaluation"],"published-print":{"date-parts":[[2012,9]]},"DOI":"10.1007\/s10579-010-9135-7","type":"journal-article","created":{"date-parts":[[2010,12,11]],"date-time":"2010-12-11T01:29:16Z","timestamp":1292030956000},"page":"421-447","source":"Crossref","is-referenced-by-count":59,"title":["Annotating expressions of Appraisal in English"],"prefix":"10.1007","volume":"46","author":[{"given":"Jonathon","family":"Read","sequence":"first","affiliation":[]},{"given":"John","family":"Carroll","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2010,12,12]]},"reference":[{"key":"9135_CR1","unstructured":"Argamon, S., Bloom, K., Esuil, A., & Sebastiani, F. (2007). Automatically determining attitude type and force for sentiment analysis. In Proceedings of the 3rd language and technology conference (LTC\u201907), Poznan, PL (pp. 369\u2013373)."},{"issue":"1","key":"9135_CR2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/S1351324999002144","volume":"5","author":"R. Bruce","year":"1999","unstructured":"Bruce, R., & Wiebe, J. (1999). Recognizing subjectivity: A case study in manual tagging. Natural Language Engineering, 5(1), 1\u201316.","journal-title":"Natural Language Engineering"},{"issue":"2","key":"9135_CR3","first-page":"249","volume":"22","author":"J. Carletta","year":"1996","unstructured":"Carletta, J. (1996). Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics, 22(2), 249\u2013254.","journal-title":"Computational Linguistics"},{"key":"9135_CR4","unstructured":"Chinchor, N. (1998). MUC-7 test scores introduction. In Proceedings of the seventh message understanding conference"},{"key":"9135_CR5","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","volume":"20","author":"J. Cohen","year":"1960","unstructured":"Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measures, 20, 37\u201346.","journal-title":"Educational and Psychological Measures"},{"key":"9135_CR6","first-page":"265","volume":"2","author":"K. Crammer","year":"2001","unstructured":"Crammer, K., & Singer, Y. (2001). On the algorithmic implementation of multi-class svms. Journal of Machine Learning Research, 2, 265\u2013292.","journal-title":"Journal of Machine Learning Research"},{"key":"9135_CR7","unstructured":"Cunningham, H., Maynard, D., Bontcheva, K., & Tablan, V. (2002). GATE: A framework and graphical development environment for robust NLP tools and applications. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics, Philadelphia, PA, USA."},{"key":"9135_CR8","unstructured":"Day, D., McHenry, C., Kozierok, R., & Riek, L. (2004). Callisto: A configurable annotation workbench. In LREC 2004: Fourth international conference on language resources and evaluation, Lisbon, Portugal."},{"key":"9135_CR9","unstructured":"Di Marco, C., & Mercer, R.E. (2004). Using hedges to classify citations in scientific articles. In Computing attitude and affect in text: Theory and applications, Springer, Netherlands (pp. 247\u2013263)."},{"key":"9135_CR10","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1037\/0003-066X.48.4.384","volume":"48","author":"P. Ekman","year":"1993","unstructured":"Ekman, P. (1993). Facial expression of emotion. American Psychologist, 48, 384\u2013392.","journal-title":"American Psychologist"},{"key":"9135_CR11","unstructured":"Esuli, A., & Sebastiani, F. (2005). Determining the semantic orientation of terms through gloss analysis. In Proceedings of the 14th ACM international conference on information and knowledge management (CIKM\u201905), Bremen, DE."},{"issue":"5","key":"9135_CR12","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1037\/h0031619","volume":"76","author":"J. L. Fleiss","year":"1971","unstructured":"Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5), 378\u2013382.","journal-title":"Psychological Bulletin"},{"issue":"4","key":"9135_CR13","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.cogsys.2004.02.002","volume":"5","author":"J. Gratch","year":"2004","unstructured":"Gratch, J., & Marsella, S. (2004). A domain-independent framework for modeling emotion. Cognitive Systems Research, 5(4), 269\u2013306.","journal-title":"Cognitive Systems Research"},{"key":"9135_CR14","doi-asserted-by":"crossref","DOI":"10.1075\/pbns.54","volume-title":"Hedging in scientific research articles","author":"K. Hyland","year":"1998","unstructured":"Hyland K. (1998). Hedging in scientific research articles. Amsterdam\/Philadelphia: John Benjamins."},{"key":"9135_CR15","volume-title":"Disciplinary discourses: Social interactions in academic writing","author":"K. Hyland","year":"2000","unstructured":"Hyland, K. (2000). Disciplinary discourses: Social interactions in academic writing. Longman: London."},{"key":"9135_CR16","unstructured":"Labov, W. (1984). Intensity. In: D. Schiffrin (Ed.), Meaning, form, and use in context: Linguistic applications. Washington, D.C.: Georgetown University Press."},{"key":"9135_CR17","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"J.R. Landis","year":"1977","unstructured":"Landis, J. R., & Koch, G.G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159\u2013174.","journal-title":"Biometrics"},{"key":"9135_CR18","first-page":"1","volume":"28","author":"G. Leech","year":"1992","unstructured":"Leech, G. (1992). 100 million words of English: The British National Corpus. Language Research, 28, 1\u201313.","journal-title":"Language Research"},{"issue":"2\u20133","key":"9135_CR19","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1177\/0957926504041022","volume":"15","author":"J. R. Martin","year":"2004","unstructured":"Martin, J. R. (2004). Mourning: How we get\u00a0aligned. Discourse & Society, 15(2\u20133), 321\u2013344.","journal-title":"Discourse & Society"},{"key":"9135_CR20","doi-asserted-by":"crossref","DOI":"10.1057\/9780230511910","volume-title":"Language of evaluation: Appraisal in English","author":"J.R. Martin","year":"2005","unstructured":"Martin, J. R., & White, P. R. R. (2005). Language of evaluation: Appraisal in English. London: Palgrave Macmillan."},{"key":"9135_CR21","unstructured":"Mihalcea, R., & Chklovski, T. (2003). Open mind word expert: Creating large annotated data collections with web users\u2019 help. In Proceedings of the EACL 2003 workshop on linguistically annotated corpora (LINC 2003), Budapest, Hungary."},{"key":"9135_CR22","unstructured":"Moilanen, K., & Pulman, S. (2007). Sentiment composition. In Proceedings of recent advances in natural language processing (RANLP 2007), Borovets, Bulgaria (pp. 378\u2013382)."},{"key":"9135_CR23","unstructured":"Pang, B., Lee, L., & Vaithyanathan, S. (2002). Thumbs up? Sentiment classification using machine learning techniques. In Proceedings of the 2002 conference on empirical methods in natural language processing, Philadelphia, PA, USA."},{"key":"9135_CR24","doi-asserted-by":"crossref","unstructured":"Polanyi, L., & Zaenen, A. (2006). Contextual valence shifters. In Computing attitude and affect in text: Theory and applications (pp. 1\u201310). Springer.","DOI":"10.1007\/1-4020-4102-0_1"},{"key":"9135_CR25","unstructured":"Read, J. (2004). Recognising affect in text using pointwise mutual information. Master\u2019s thesis, University of Sussex."},{"key":"9135_CR26","doi-asserted-by":"crossref","unstructured":"Read, J. (2005). Using emoticons to reduce dependency in machine learning techniques for sentiment classification. In Proceedings of the ACL student research workshop, Ann Arbor, MI, USA.","DOI":"10.3115\/1628960.1628969"},{"key":"9135_CR27","volume-title":"Appraisal processes in emotion: Theory, methods, research","year":"2001","unstructured":"Scherer, K. R., Schoor, A., & Johnstone, T. (Eds.) (2001). Appraisal processes in emotion: Theory, methods, research. Canary, NC: Oxford University Press."},{"key":"9135_CR28","doi-asserted-by":"crossref","unstructured":"Strapparava, C., & Mihalcea, R. (2007). Sem Eval-2007 task 14: Affective text. In Proceedings of the 4th international workshop on semantic evaluations (SemEval 2007), Prague, Czech Republic.","DOI":"10.3115\/1621474.1621487"},{"issue":"4","key":"9135_CR29","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1109\/91.940962","volume":"9","author":"P. Subasic","year":"2001","unstructured":"Subasic, P., & Huettner, A. (2001). Affect analysis of text using fuzzy semantic typing. IEEE Transactions on Fuzzy Systems, 9(4), 483\u2013496.","journal-title":"IEEE Transactions on Fuzzy Systems"},{"key":"9135_CR30","unstructured":"Taboada, M., & Grieve, J. (2004). Analyzing appraisal automatically. In Spring symposium on exploring attitude and affect in text, American Association for Artificial Intelligence, Stanford, aAAI Technical Report SS-04-07."},{"key":"9135_CR31","unstructured":"Turney, P. D. (2002). Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics, Philadelphia, PA, USA."},{"key":"9135_CR32","first-page":"1","volume-title":"Handbook of Pragmatics.","author":"P. R. R. White","year":"2002","unstructured":"White, P. R. R. (2002). Appraisal\u2014The language of evaluation and stance. In J. Verschueren, J. O. \u00d6stman, J. Blommaert & C. Bulcaen (Eds.), Handbook of pragmatics (pp. 1\u201327). Amsterdam: John Benjamins."},{"key":"9135_CR33","doi-asserted-by":"crossref","unstructured":"Whitelaw, C., Garg, N., & Argamon, S. (2005). Using appraisal groups for sentiment analysis. In Proceedings of the conference on information and knowledge management (CIKM).","DOI":"10.1145\/1099554.1099714"},{"key":"9135_CR34","unstructured":"Wiebe, J., Breck, E., Buckley, C., Cardie, C., Davis, P., Fraser, B., et al. (2003). Recognizing and organizing opinions expressed in the world press. In Proceedings of the AAAI spring symposium on new directions in question answering."},{"issue":"3","key":"9135_CR35","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1162\/0891201041850885","volume":"30","author":"J. Wiebe","year":"2004","unstructured":"Wiebe, J., Wilson, T., Bruce, R., Bell, M., & Martin, M. (2004). Learning subjective language. Computational Linguistics, 30(3), 277\u2013308.","journal-title":"Computational Linguistics"},{"issue":"2\u20133","key":"9135_CR36","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s10579-005-7880-9","volume":"39","author":"J. Wiebe","year":"2005","unstructured":"Wiebe, J., Wilson, T., & Cardie, C. (2005). Annotating expressions of opinions and emotions in language. Language Resources and Evaluation, 39(2\u20133), 165\u2013210.","journal-title":"Language Resources and Evaluation"},{"key":"9135_CR37","doi-asserted-by":"crossref","unstructured":"Yang, C., Lin, K. H. Y., & Chen, H. H. (2007). Building emotion lexicon from weblog corpora. In Proceedings of the ACL 2007 demo and poster sessions, Prague, Czech Republic (pp. 133\u2013136).","DOI":"10.3115\/1557769.1557809"}],"container-title":["Language Resources and Evaluation"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.springerlink.com\/index\/pdf\/10.1007\/s10579-010-9135-7","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,3,6]],"date-time":"2019-03-06T13:15:58Z","timestamp":1551878158000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10579-010-9135-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,12,12]]},"references-count":37,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2012,9]]}},"alternative-id":["9135"],"URL":"https:\/\/doi.org\/10.1007\/s10579-010-9135-7","relation":{},"ISSN":["1574-020X","1574-0218"],"issn-type":[{"value":"1574-020X","type":"print"},{"value":"1574-0218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,12,12]]}}}