-
Notifications
You must be signed in to change notification settings - Fork 267
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Legal Opinion Sentiment Classification scenario #3286
base: main
Are you sure you want to change the base?
Conversation
I'm skeptical about the validity of some of the examples. Example negative example:
It's not clear to me why this is negative. |
Co-authored-by: Ryo Kawahara <[email protected]> Co-authored-by: Mikio Takeuchi <[email protected]>
34898bd
to
ba81538
Compare
Hi @ryokawajp and @mtake, please review this pull request. By approving, you acknowledge that:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm.
I realized that classification_* metrics do not appear in the web UI. However, those do exist in stats.json. So, I think that issue has nothing to do with this scenario.
I either do not know why this sample is negative. Most of the messages are highly domain-specific. |
This is a legal opinion sentiment classification task based on the paper Effective Approach to Develop a Sentiment Annotator For Legal Domain in a Low Resource Setting (Ratnayaka et al., 2020).