Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

allow private code submissions #26

Open
mschrimpf opened this issue Mar 17, 2023 · 0 comments
Open

allow private code submissions #26

mschrimpf opened this issue Mar 17, 2023 · 0 comments
Assignees

Comments

@mschrimpf
Copy link
Member

There are quite a few users who prefer to not make their submitted model code public, e.g. because it's under active development. I would like to support that use case in the future too where users can e.g. submit a model before publication, include the results in their paper, and later opt to make it public. In other words, it should be possible to receive a score for a private model without making any of the code public.

One way to implement this (suggested by @kvfairchild) is to manage a separate private repository with private registries for internal scoring use only, that we can internally still score on and make the scores visible to the user (and potentially publicly if selected).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants