Gemini Flash support

[nischalj10]

heard a lotta good things about the model. we should try and add support for google as a provider.

[Taytay]

What would you think about using one of the wrapper libs (litellm, etc) to make it easier to swap LLMs out?

[nischalj10]

most of the LLMs don't support structured outputs like OpenAI's latest models - which leads to poor reliability of taking actions.

Also, we use http://python.useinstructor.com under the hood - but somehow it doesn't work well for models from providers like groq when proxied via litellm