Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow summary functions for RFE variability estimation #1370

Open
DavorJ opened this issue Jul 20, 2024 · 0 comments
Open

Allow summary functions for RFE variability estimation #1370

DavorJ opened this issue Jul 20, 2024 · 0 comments

Comments

@DavorJ
Copy link

DavorJ commented Jul 20, 2024

Currently (v6.0-94), only internal MeanSD function is supported in RFE to compute the variability of the (repeated) CV metrics. As long as one assumes (repeated) CV samples coming from a normal distribution, this is perfectly fine. But in case this assumption is not taken, then reporting only the SD is very limiting.

A simple addition would be to allow the user to specify an e.g. "summarySD" function in caret::rfeControl(functions), which can point to MeanSD by default. A very quick and dirty implementation one can find here. This would allow much more flexibility for custom implementations of selectSize RFE functions since one could pass extra information and not only the SD.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant