This page contains the data for our NAACL'24 paper "Language Models (Mostly) Do Not Consider Emotion Triggers When Predicting Emotion"
Situations and events evoke emotions in humans, but to what extent do they inform the prediction of emotion detection models? This work investigates how well human-annotated emotion triggers correlate with features that models deemed salient in their prediction of emotions. First, we introduce a novel dataset EmoTrigger, consisting of 900 social media posts sourced from three different datasets; these were annotated by experts for emotion triggers with high agreement. Using EmoTrigger, we evaluate the ability of large language models (LLMs) to identify emotion triggers, and conduct a comparative analysis of the features considered important for these tasks between LLMs and fine-tuned models. Our analysis reveals that emotion triggers are largely not considered salient features for emotion prediction models, instead there is intricate interplay between various features and the task of emotion detection.
@inproceedings{singh-etal-2024-language,
title = "Language Models (Mostly) Do Not Consider Emotion Triggers When Predicting Emotion",
author = "Singh, Smriti and
Caragea, Cornelia and
Li, Junyi Jessy",
booktitle = "Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers)",
year = "2024",
url = "https://aclanthology.org/2024.naacl-short.51",
doi = "10.18653/v1/2024.naacl-short.51",
pages = "603--614",
}