Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature-request] For Neuron Container to be released in eu-west-2 (London Region) #3981

Open
3 of 5 tasks
mccartni-aws opened this issue Jun 3, 2024 · 0 comments
Open
3 of 5 tasks

Comments

@mccartni-aws
Copy link

mccartni-aws commented Jun 3, 2024

Checklist

Concise Description:
I am working with a customer who urgently needs a Neuron Container (for inference with inf2 instances) in the eu-west-2 region. As per the Available DLC Images site, there are no Neuron containers available in the eu-west-2 region.

DLC image/dockerfile:
763104351884.dkr.ecr.eu-west-1.amazonaws.com/huggingface-pytorch-tgi-inference:2.1.2-optimum0.0.22-neuronx-py310-ubuntu22.04
This is the eu-west-1 region version of the image, but we would like it in the eu-west-2 region.

Is your feature request related to a problem? Please describe.
It's frustrating that this container hasn't been released within the eu-west-2 region.

Describe the solution you'd like
We would like a Neuron container to be made available in the eu-west-2 region, in the same region that we're working in in the customer's account.
repository-name = huggingface-pytorch-tgi-inference
image-tag = 2.1.2-optimum0.0.22-neuronx-py310-ubuntu22.04

Describe alternatives you've considered

  1. Pull image from public ECR in the eu-west-1 region and then push to our private ECR repo in the eu-west-2 region.
  2. We start working in the eu-west-1 region for this use-case. Not really an option for the customer.
  3. We use Docker to pull from public ECR and then push our private Dockerhub. Not ideal for the customer.

Additional context
Add any other context or screenshots about the feature request here.

Screenshot 2024-06-03 at 09 58 44

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant