-
Moonshot AI has a context caching feature that requires messages with a leading message |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
This is a custom feature - you'd need to write your own provider and use some provider extension (like w/ the anthropic provider cache feature). You can either clone the openai provider or use the mistral provider as a template (similar but simpler). |
Beta Was this translation helpful? Give feedback.
This is a custom feature - you'd need to write your own provider and use some provider extension (like w/ the anthropic provider cache feature). You can either clone the openai provider or use the mistral provider as a template (similar but simpler).