-
-
Notifications
You must be signed in to change notification settings - Fork 149
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add chunk size parameter to EmbeddingsRequest #111
Labels
enhancement
New feature or request
good first issue
Good for newcomers
help wanted
Extra attention is needed
Comments
StephenHodgson
added
help wanted
Extra attention is needed
good first issue
Good for newcomers
labels
Jun 5, 2023
Merged
Merged
This was
unlinked from
pull requests
Jun 17, 2023
Merged
A quick update: Microsoft now allows up to 16 items in the array, not only a single one.
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
enhancement
New feature or request
good first issue
Good for newcomers
help wanted
Extra attention is needed
Feature Request
Azure OpenAI only allows one single string to be part of an embeddings request. Other frameworks have a
chunk_size
orembed_batch_size
parameter for this.Describe the solution you'd like
I'd propose a
int? ChunkSize = null
parameter for theEmbeddingsRequest
. If it's> 0
, the there should be multiple requests being made withn
lines per requests.Describe alternatives you've considered
I did the chunking myself, but as other frameworks have this built-in, we might also want to add such a parameter here.
Additional context
Quote from MS docs about this limitation:
The text was updated successfully, but these errors were encountered: