Skip to content

Latest commit

 

History

History
47 lines (36 loc) · 2.91 KB

README.md

File metadata and controls

47 lines (36 loc) · 2.91 KB
Raw

Leveraging Multilingual Transformers for Hate Speech Detection

Hate Speech Detection Task and Subtasks for HASOC 2020

Links

Using the Processed Data

  • Refer to the ./data/2020_processed directories for train and test splits
  • One pickle file for each language
  • Each having a dictionary structure
  • Keys map you to lists containing the following:
    1. tweet_id: The provided tweet ID
    2. task_1: Label for Task 1
    3. task_2: Label for Task 2
    4. hasoc_id: Provided ID for the HASOC task
    5. full_tweet: The complete tweet as is
    6. tweet_raw_text: Pure tweet text without hashtags, smileys, ...
    7. hashtags: Hashtags
    8. smiley: Smileys
    9. emoji: Emojis
    10. url: URLs
    11. mentions: Mentions
    12. numerals: Numbers
    13. reserved_word: Reserved Words
    14. emotext: A textual description of all emojis
    15. segmented_hash: The hashtag text segmented into words

Models and Features

Description

Detecting and classifying instances of hate in social media text has been a problem of interest in Natural Language Processing in the recent years. Our work leverages state of the art Transformer language models to identify hate speech in a multilingual setting. Capturing the intent of a post or a comment on social media involves careful evaluation of the language style, semantic content and additional pointers such as hashtags and emojis. We look at the problem of identifying whether a Twitter post is hateful and offensive or not. We further discriminate the detected toxic content into one of the following three classes: (a) Hate Speech (HATE), (b) Offensive (OFFN) and (c) Profane (PRFN). With a pre-trained multilingual Transformer-based masked LM at the base, we are able to successfully identify and classify hate speech from multiple languages. On the provided testing corpora, we achieve Macro F1 scores of 90.29, 81.87 and 75.40 for English, German and Hindi respectively while performing hate speech detection and of 60.70, 53.28 and 49.74 during fine-grained classification. In our experiments, we show the efficacy of Perspective API features for hate speech classification, and the effects of exploiting a multilingual training scheme.