Computational Event Evaluation based on Appraisal Theories for Emotion Analysis (CEAT)
Emotion analysis in natural language processings aims at associating text with emotions, for instance with anger, fear, joy, surprise, disgust or sadness. This task extends sentiment analysis, which adds further qualitative value in applications, for instance in social media analysis, in the analysis of fictional stories or news articles.Existing research has so far mainly focused on the association of text with specific emotion models from psychological research. The development of methods for detecting phrases in text which denote the emotion experiencer (the character or person who feels the emotion), the emotion theme (the cause of the development of an emotion) as well as the modifiers of an emotion (intensifiers and diminishers) has been neglected.In this project, we aim at filling this gap. We will develop manually annotated corpora from different domains (news, novels, social media) in German and English. Based on these resources, we develop models which are able to automatically recognize and extract such information. We work on different levels: Firstly, we connect words with emotions (with distributional and lexical methods), including grammatical variants. Then, secondly, we analyze these mentions in context with modifiers, the feeler and the theme (cause) of the emotion. Thirdly, we model these information in context, i.e., beyond seperated mentions. All methods will be analyzed regarding their domain and language independence.
CEAT is a follow-up project to SEAT (Structured Emotion Analysis in Text), in which we modeled emotions as events. In contrast, we model the events in CEAT that lead to particular emotions.
The project SEAT started in 2018. CEAT started in 2021. It is funded by the German Research Foundation (DFG).
Related Publications
Troiano, Enrica et al. (2024): Dealing with Controversy: An Emotion and Coping Strategy Corpus Based on Role Playing. In: Findings of the Association for Computational Linguistics: EMNLP 2024. Miami, Florida: Association for Computational Linguistics. S. 1634–1658.
Wegge, Maximilian/Klinger, Roman (2024): Topic Bias in Emotion Classification. In: Proceedings of the Ninth Workshop on Noisy and User-generated Text (W-NUT 2024). San Ġiljan, Malta: Association for Computational Linguistics. S. 89–103.
Wemmer, Eileen/Labat, Sofie/Klinger, Roman (2024): EmoProgress: Cumulated Emotion Progression Analysis in Dreams and Customer Service Dialogues. In: Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024). Torino, Italia: ELRA and ICCL. S. 5660–5677.
Klinger, Roman (2023a): Where are We in Event-centric Emotion Analysis?: Bridging Emotion Role Labeling and Appraisal-based Approaches. In: Proceedings of the Big Picture Workshop. Singapore: Association for Computational Linguistics. S. 1–17.
Klinger, Roman (2023b): Emotionsklassifikation in Texten unter Berücksichtigung des Komponentenprozessmodells. In: Jaki, Sylvia/Steiger, Stefan (Hg.): Digitale Hate Speech: interdisziplinäre Perspektiven auf Erkennung, Beschreibung und Regulation. Berlin, Heidelberg: J.B. Metzler. S. 131–154.
Troiano, Enrica/Klinger, Roman/Padó, Sebastian (2023): On the Relationship between Frames and Emotionality in Text. In: Northern European Journal of Language Technology 9.
Troiano, Enrica/Oberländer, Laura/Klinger, Roman (2023): Dimensional Modeling of Emotions in Text with Appraisal Theories: Corpus Creation, Annotation Reliability, and Prediction. In: Computational linguistics 49, S. 1–72.
Wegge, Maximilian/Klinger, Roman (2023): Automatic Emotion Experiencer Recognition. In: Proceedings of the 3rd Workshop on Computational Linguistics for the Political and Social Sciences. Ingolstadt: Association for Computational Lingustics. S. 1–7.
Štajner, Sanja/Klinger, Roman (2023): Emotion Analysis from Texts. In: Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics: Tutorial Abstracts. Dubrovnik: Association for Computational Linguistics. S. 7–12.
Plaza-del-Arco, Flor Miriam/Martín-Valdivia, María-Teresa/Klinger, Roman (2022): Natural Language Inference Prompts for Zero-shot Emotion Classification in Text across Corpora. In: Proceedings of the 29th International Conference on Computational Linguistics. Gyeongju: International Committee on Computational Linguistics. S. 6805–6817.
Sabbatino, Valentino et al. (2022): “splink” is happy and “phrouth” is scary: Emotion Intensity Analysis for Nonsense Words. In: Proceedings of the 12th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis. Dublin: Association for Computational Linguistics. S. 37–50.
Troiano, Enrica et al. (2022): x-enVENT: A Corpus of Event Descriptions with Experiencer-specific Emotion and Appraisal Annotations. In: Proceedings of the Thirteenth Language Resources and Evaluation Conference. Marseille: European Language Resources Association. S. 1365–1375.
Wegge, Maximilian et al. (2022): Experiencer-Specific Emotion and Appraisal Prediction. In: Proceedings of the Fifth Workshop on Natural Language Processing and Computational Social Science (NLP+CSS). Abu Dhabi: Association for Computational Linguistics. S. 25–32.
Casel, Felix/Heindl, Amelie/Klinger, Roman (2021): Emotion Recognition under Consideration of the Emotion Component Process Model. In: Proceedings of the 17th Conference on Natural Language Processing (KONVENS 2021). KONVENS 2021 Organizers. S. 49–61.
Doan Dang, Bao Minh/Oberländer, Laura Ana Maria/Klinger, Roman (2021): Emotion Stimulus Detection in German News Headlines. In: Proceedings of the 17th Conference on Natural Language Processing (KONVENS 2021). KONVENS 2021 Organizers. S. 73–85.
Hofmann, Jan/Troiano, Enrica/Klinger, Roman (2021): Emotion-Aware, Emotion-Agnostic, or Automatic: Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations. In: Proceedings of the Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis. Association for Computational Linguistics. S. 160–170.
Troiano, Enrica/Padó, Sebastian/Klinger, Roman (2021): Emotion Ratings: How Intensity, Annotation Confidence and Agreements are Entangled. In: Proceedings of the Eleventh Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis. Association for Computational Linguistics. S. 40–49.
Bostan, Laura Ana Maria/Kim, Evgeny/Klinger, Roman (2020): GoodNewsEveryone: A Corpus of News Headlines Annotated with Emotions, Semantic Roles, and Reader Perception. In: LREC 2020 Marseille: Twelfth International Conference on Language Resources and Evaluation, May 11-16, 2020, Palais du Pharo, Marseille, France: conference proceedings. Paris: European Language Resources Association. S. 1554–1566.
Haider, Thomas et al. (2020): PO-EMO: Conceptualization, Annotation, and Modeling of Aesthetic Emotions in German and English Poetry. In: Proceedings of the Twelfth Language Resources and Evaluation Conference. S. 1652–1663.
Helbig, David/Troiano, Enrica/Klinger, Roman (2020): Challenges in Emotion Style Transfer: An Exploration with a Lexical Substitution Pipeline. In: Proceedings of the Eighth International Workshop on Natural Language Processing for Social Media. Association for Computational Linguistics. S. 41–50.
Hofmann, Jan et al. (2020): Appraisal Theories for Emotion Classification in Text. In: Proceedings of the 28th International Conference on Computational Linguistics. International Committee on Computational Linguistics. S. 125–138.
Klinger, Roman/Kim, Evgeny/Padó, Sebastian (2020): Emotion Analysis for Literary Studies. In: Reiter, Nils/Pichler, Axel/Kuhn, Jonas (Hg.): Reflektierte algorithmische Textanalyse: Interdisziplinäre(s) Arbeiten in der CRETA-Werkstatt. Berlin, Boston: De Gruyter. S. 237–268.
Oberländer, Laura Ana Maria/Klinger, Roman (2020): Token Sequence Labeling vs. Clause Classification for English Emotion Stimulus Detection. In: Proceedings of the Ninth Joint Conference on Lexical and Computational Semantics. Association for Computational Linguistics. S. 58–70.
Oberländer, Laura/Reich, Kevin/Klinger, Roman (2020): Experiencers, Stimuli, or Targets: Which Semantic Roles Enable Machine Learning to Infer the Emotions?. In: Proceedings of the Third Workshop on Computational Modeling of People’s Opinions, Personality, and Emotion’s in Social Media. Association for Computational Linguistics. S. 119–128.
Troiano, Enrica/Klinger, Roman/Padó, Sebastian (2020): Lost in Back-Translation: Emotion Preservation in Neural Machine Translation. In: Proceedings of the 28th International Conference on Computational Linguistics. International Committee on Computational Linguistics. S. 4340–4354.
Bostan, Laura/Klinger, Roman (2019): Exploring fine-tuned embeddings that model intensifiers for emotion analysis. In: Proceedings of the Tenth Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis. Minneapolis: Association for Computational Linguistics. S. 25–34.
Kim, Evgeny/Klinger, Roman (2019a): Frowning Frodo, Wincing Leia, and a Seriously Great Friendship: Learning to Classify Emotional Relationships of Fictional Characters. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics. S. 647–653.
Kim, Evgeny/Klinger, Roman (2019b): An Analysis of Emotion Communication Channels in Fan-Fiction: Towards Emotional Storytelling. In: Proceedings of the Second Workshop on Storytelling. Association for Computational Linguistics. S. 56–64.
Kim, Evgeny/Klinger, Roman (2019c): A Survey on Sentiment and Emotion Analysis for Computational Literary Studies. In: Zeitschrift für digitale Geisteswissenschaften, S. 1–23.
Troiano, Enrica/Padó, Sebastian/Klinger, Roman (2019): Crowdsourcing and Validating Event-focused Emotion Corpora for German and English. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics. S. 4005–4011.
Bostan, Laura Ana Maria/Klinger, Roman (2018): An Analysis of Annotated Corpora for Emotion Classification in Text. In: Proceedings of the 27th International Conference on Computational Linguistics. Santa Fe, New Mexico: Association for Computational Linguistics. S. 2104–2119.
Kim, Evgeny/Klinger, Roman (2018): Who Feels What and Why?: Annotation of a Literature Corpus with Semantic Roles of Emotions. In: Proceedings of the 27th International Conference on Computational Linguistics. Association for Computational Linguistics. S. 1345–1359.
Klinger, Roman et al. (2018): IEST: WASSA-2018 Implicit Emotions Shared Task. In: Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis. Brüssel: Association for Computational Linguistics. S. 31–42.
Strohm, Florian/Klinger, Roman (2018): An Empirical Analysis of the Role of Amplifiers, Downtoners, and Negations in Emotion Classification in Microblogs. In: 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA). Piscataway, NJ: IEEE.
Köper, Maximilian/Kim, Evgeny/Klinger, Roman (2017): IMS at EmoInt-2017: Emotion Intensity Prediction with Affective Norms, Automatically Extended Resources and Deep Learning. In: Proceedings of the 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis. Association for Computational Linguistics.
Schuff, Hendrik et al. (2017): Annotation, Modelling and Analysis of Fine-Grained Emotions on a Stance and Sentiment Detection Corpus. In: Proceedings of the 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis. Association for Computational Linguistics. S. 13–23.