Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ADD] a more intuitive confidence value #6

Open
ruohoruotsi opened this issue Jun 24, 2019 · 0 comments
Open

[ADD] a more intuitive confidence value #6

ruohoruotsi opened this issue Jun 24, 2019 · 0 comments
Assignees
Labels
bug Something isn't working enhancement New feature or request

Comments

@ruohoruotsi
Copy link
Member

[ADD] a more intuitive confidence value to the results than just the PRED AVG SCORE i.e. the negative log-likelihood or the perplexity, aka exp(-PRED AVG SCORE).

It will help users understand the quality of the results better if they know and can understand the model's confidence. Perplexity is nice but perhaps not ideal for the lay technical person. Yet.

It also provides a better way to reason with developers who are using it to know when to discard and warn that the results are not worth much. 🤔

@ruohoruotsi ruohoruotsi added bug Something isn't working enhancement New feature or request labels Jun 24, 2019
@ruohoruotsi ruohoruotsi self-assigned this Jun 24, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant