Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Identify learners for binary and continuous outcomes #142

Open
ngreifer opened this issue Feb 23, 2022 · 2 comments
Open

Identify learners for binary and continuous outcomes #142

ngreifer opened this issue Feb 23, 2022 · 2 comments

Comments

@ngreifer
Copy link
Contributor

It would be nice if there was possibility of knowing which learners worked for binary vs. continuous outcomes. The only to find this out is to manually try them and receive an intimidating number of error messages if you guessed incorrectly. This could instead be stored as metadata for each learner and reported using listWrappers(), and if the user supplies an incompatible learner to SL.library, a single breaking error message could appear before running the full CV process.

@ecpolley
Copy link
Owner

Thanks for the suggestion. I think a table with some metadata on the included wrappers would be a nice addition, including

  • Type of outcomes
  • Allowed X variable input, matrix, data.frame, either, will a tibble break it?
  • Tuning parameters

Upfront checks are usually limited to only using the default wrappers, there is an internal function .check.SL.library that is called early in the code, but right now that only checks for the required package for the wrapper.

@ngreifer
Copy link
Contributor Author

Yes, I think that would be helpful. I think the second bullet you mention might not be so valuable to users since ideally whatever kind of input the user gives is preprocessed before being passed to the fitting function.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants