Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory leak and how to train using a gpu ? #17

Open
AriouatI opened this issue Aug 24, 2020 · 3 comments
Open

Memory leak and how to train using a gpu ? #17

AriouatI opened this issue Aug 24, 2020 · 3 comments

Comments

@AriouatI
Copy link

AriouatI commented Aug 24, 2020

how can i enable gpu training cause i'm trying to train on colab but it always goes beyond the 12Gb RAM limit is it even normal ?
i'm using keras 2.0.6 and tensorflow 1.1.0 as advised but the training process is extremely long and only works with batch_size= 1 otherwise there's a RAM memory problem !

Thanks for your help.
@lim-anggun

@Akhilesh64
Copy link

Akhilesh64 commented Aug 26, 2020

@AriouatI. If you enable gpu runtime the scripts will automatically use gpu. Are you getting this error while extracting masks ???

@AriouatI
Copy link
Author

@Akhilesh64 thanks for your comment.

The gpu is enabled but unused (maybe due to tf version used in this code ?)
The RAM problem happens either :

  • during the model.fit() when the batch size > 1 (looks like a memory leak)
  • during the call to getData.

@lim-anggun

@AriouatI AriouatI changed the title how to train using a gpu ? Memory leak and how to train using a gpu ? Aug 27, 2020
@helenypzhang
Copy link

how can i enable gpu training cause i'm trying to train on colab but it always goes beyond the 12Gb RAM limit is it even normal ?
i'm using keras 2.0.6 and tensorflow 1.1.0 as advised but the training process is extremely long and only works with batch_size= 1 otherwise there's a RAM memory problem !

Thanks for your help.
@lim-anggun

Could you please tell me how to download tensorflow-gpu 1.1.0? Why can't I find it with conda command?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants