Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: Dynamic Model Workflow / CPLX Dynamic Profiles #26

Open
para-droid-ai opened this issue Oct 26, 2024 · 2 comments
Open
Assignees
Labels
enhancement New feature or request

Comments

@para-droid-ai
Copy link

para-droid-ai commented Oct 26, 2024

Feature Description

From:
sickn233 — Today at 5:12 PM
Hi, I don't know if my request is too ambitious, but would it be possible to implement an option that can automatically select the most suitable model depending on the type of request?

Use Case

Curious if we could have a "dynamic model selector" option or step in the workflow. But as things go, how does CPLX standarize on model use? seem like that would be most of the work for that, having a system dynamically routing requests to specific models.

I almost picture an entire CPLX Profile in place, for coding/long-form tasks/writing/etc. In this case, you'd setup your Profile with "preferences" for model use. That way it's less abstract, and still entirely user focused.

We would likely include default "profiles" but the idea is users can set it up to their needs, and then not worry about what model to use going forward, as it's being dynamically handled. You'd also be able to swap your CPLX Profile for different domain expert uses. This is heavily inspired from my testing of Highlight and how they manage dynamic output via user context.

Alternatives Considered

(used sickn233's OG comment, and my "thought-process" as Use Case. hoping this formatting works for the intent)

@para-droid-ai para-droid-ai added the enhancement New feature or request label Oct 26, 2024
@para-droid-ai
Copy link
Author

para-droid-ai commented Oct 26, 2024

Per Highlight Rewrite:

[Feature Request]:
Dynamic Model Workflow / CPLX Dynamic Profiles

Feature Description:
Proposing an automated model selection system that can intelligently choose the most appropriate model based on request type.

Use Case:
Implementation of a "dynamic model selector" workflow step to standardize model usage patterns. This would function like a CPLX Profile system, where users can configure profiles with preferences for different use cases. The system would include default profiles while allowing customization, automatically determining the optimal model for each request based on the configured profile settings.

The key benefits are:

  • Automated model selection based on request context
  • Customizable profiles for different domain uses
  • Ability to swap CPLX profiles for varying expert needs
  • Streamlined workflow integration

@pnd280 pnd280 mentioned this issue Nov 8, 2024
24 tasks
@pnd280 pnd280 self-assigned this Nov 8, 2024
@tytrate
Copy link

tytrate commented Nov 13, 2024

What do you think about this. it would not automatically determine which model is best. You could send to all of the models and then write prompts to consolidate the output with redundancy removed and contradictions called out.

#40

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants