Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Containers that use cuda images in k8s do not have gpu resources, but the process id can be seen using nvidia-smi #954

Open
ZYWNB666 opened this issue Sep 12, 2024 · 2 comments
Open

Containers that use cuda images in k8s do not have gpu resources, but the process id can be seen using nvidia-smi #954

ZYWNB666 opened this issue Sep 12, 2024 · 2 comments

Comments

@ZYWNB666
Copy link

1、The container used is " tensorflow/tensorflow:2.16.1-gpu "
2、There is no configuration for the gpu application in the yaml file
Image

3、You can see the pod pid in the nvidia-smi command
It seems that this pod will be displayed on all free graphics cards, I don't use any gpu virtualization tools, I don't know if it takes up this video card
Image
@ZYWNB666 ZYWNB666 changed the title The cuda container does not apply for gpu resources, but the pid can be found using nvidia-smi Containers that use cuda images in k8s do not have gpu resources, but the process id can be seen using nvidia-smi Sep 12, 2024
@ZYWNB666
Copy link
Author

@klueska Dude, do you have time to look at my problem?

@ZYWNB666
Copy link
Author

@elezar Dude, do you have time to look at my problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ZYWNB666