Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Organize Models in Categories #9

Open
mmccool opened this issue May 14, 2024 · 0 comments
Open

Organize Models in Categories #9

mmccool opened this issue May 14, 2024 · 0 comments

Comments

@mmccool
Copy link
Collaborator

mmccool commented May 14, 2024

We would like to be able to generalize models and organize them in sets:

  • Categories (e.g. "en-jp text translation", "instruct")
  • Versions (e.g. ">= 1.3.*")

Suggestion: support "tagging" models in the cache with a set of searchable string values, using a metadata index.

Caches could then be searched for models with certain tags. Searching should allow for comparisons/regexes so some tags can represent versions.

This is similar to how hashtags are used for github topics, tweets, etc. Each model could have zero or more tags.

May also want to consider extending this to support performance/cost metadata (e.g. number of parameters, quantization level, etc). This can also be used to support "friendly" names for models. Tags should be included in the hash to avoid using them for cross-site communication and protecting them from modification.

Assuming tagging was implemented, how could it be used? Are there other practices, conventions, or approaches we could follow to address this problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant