New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Validate new code with the LK Perf Monitor #1

Open

4 of 5 tasks

mdekstrand opened this issue Jan 13, 2025 · 0 comments

Open

4 of 5 tasks

Validate new code with the LK Perf Monitor #1

mdekstrand opened this issue Jan 13, 2025 · 0 comments

Member

mdekstrand commented Jan 13, 2025 •

edited

Loading

With all of the changes and upgrades in LensKit 2025.1, we need to validate those changes in the performance monitor.

Update perf monitor code for LK 2025.1
Rerun perf for LK 2025.1
Review results
Identify why RMSE has degraded
Verify that rating measure change is reason for NDCG changes

mdekstrand added this to LensKit Overhaul

mdekstrand converted this from a draft issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment