Azure OpenAI Service Support

[hlyl]

Using the python module for ChatGPT, it is possible to use a "local" instance that is hosted on a Azure subscription, but we have not figured out how to connect that VS Code extension to a Azure hosted instance... these are the paramaters that are used in the python module:

Microsoft Azure Endpoints

In order to use the library with Microsoft Azure endpoints, you need to set the api_type, api_base and api_version in addition to the api_key. The api_type must be set to 'azure' and the others correspond to the properties of your endpoint. In addition, the deployment name must be passed as the engine parameter.
`import openai
openai.api_type = "azure"
openai.api_key = "..."
openai.api_base = "https://example-endpoint.openai.azure.com"
openai.api_version = "2022-12-01"

create a completion
completion = openai.Completion.create(engine="deployment-name", prompt="Hello world")

print the completion
print(completion.choices[0].text)`

How can we contribute to enable this feature ?

[jorgecarleitao]

The code in this comment seems to be from https://github.com/openai/openai-python/blob/75c90a71e88e4194ce22c71edeb3d2dee7f6ac93/openai/util.py#L21 that translates to variability in the header passed to the endpoint.

Specifically, azure does not use Bearer {api_key} and instead just {api_key}.

Is this configurable in the npm package chatgpt atm?

[gencay]

Thank you for bringing this up. That's correct, there are some differences between the two endpoints, and I am aware of them. This isn't supported at the moment. I'm curious what models you are more interested in using from your Azure OpenAI Service deployments? i.e. text-davinci, code-davinci or chatgpt?

I may consider updating my chatgpt api fork to support Azure OpenAI endpoints.

[hlyl]

Thanks a lot for the quick reply, and also for providing this awesome extension... so many great features.
We are are looking at using CharGPT, but on the model side both Davinci and Codex for code and text enhancements.
We are working in a environment where we are not allowed to share code outside do the OpenAI API is not a ideal setup
It would be really cool to have this support Azure OpenAI endpoints.
Please tell us if there is any way that we can help in bringing this...

[gencay]

@hlyl thank you 🙏. We are planning to keep this feature for future releases, however if you are interested in could you please send me an email about your use cases and your team and what you folks are working on and your interest in using Azure OpenAI within VS Code, I can sign you up on our early testers list and send you an alpha release to test out this new feature. You can reach us at [email protected]

[hlyl]

Mail sent where we report ready for duty as Alpha testers

[nullsimon]

wait for azure support 👍

[genieai-info]

This is now supported in Genie Test it out and let us know if you face any issues via our repo's Issues. @gencay could you transfer this as an issue over to us?