Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature] Add a deploy to cloud run component #11255

Open
stephenleo opened this issue Sep 27, 2024 · 2 comments
Open

[feature] Add a deploy to cloud run component #11255

stephenleo opened this issue Sep 27, 2024 · 2 comments

Comments

@stephenleo
Copy link

Feature Area

/area components

What feature would you like to see?

Google Cloud Run is a fantastic way to deploy containers in a serverless manner. Cloud Run recently introduced GPU support which makes it attractive for deploying ML models completely serverless. This feature is to create a new google-cloud-pipeline-component to deploy a trained ML model from Model Registry to Cloud Run.

I have built a custom component that I've been using for my personal projects that deploys a model from Model Registry to Cloud Run. I'd like to polish it up and submit a PR. The component is pretty self-contained and shouldn't impact any other aspect of the framework.
image

What is the use case or pain point?

  1. Cloud Run has all the benefits of serverless: Easy to manage, cheap, scale to zero
  2. Feature parity with Sagemaker: Sagemaker provides serverless endpoints while VertexAI doesn't natively support serverless endpoints. Cloud Run bridges the gap.

Is there a workaround currently?

None


Love this idea? Give it a 👍.

Copy link

@rimolive: The label(s) /label platform/gcp cannot be applied. These labels are supported: tide/merge-method-merge, tide/merge-method-rebase, tide/merge-method-squash, lifecycle/needs-triage. Is this label configured under labels -> additional_labels or labels -> restricted_labels in plugin.yaml?

In response to this:

/label platform/gcp

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@rimolive
Copy link
Member

rimolive commented Oct 3, 2024

/cc @kubeflow/google

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants