Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

An illegal memory access was encounteredan illegal memory access was encountered #49

Open
MnogoZnaet opened this issue Nov 5, 2018 · 4 comments

Comments

@MnogoZnaet
Copy link

MnogoZnaet commented Nov 5, 2018

Tensorflow 1.11.0
Cuda 9.0
Python 2.7.15
GTX 1060, 396 driver
Happens after run python demo. CPU version works well

an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredan illegal memory access was encounteredCuda kernel failed. Error: an illegal memory access was encounteredan illegal memory access was encountered2018-11-06 02:40:13.266582: E tensorflow/stream_executor/cuda/cuda_dnn.cc:353] Could not create cudnn handle: CUDNN_STATUS_INTERNAL_ERROR

@MnogoZnaet
Copy link
Author

I added this to run_demo.py before main function, and it starts work

import tensorflow as tf
from keras.backend.tensorflow_backend import set_session
config = tf.ConfigProto()
config.gpu_options.per_process_gpu_memory_fraction = 0.7
set_session(tf.Session(config=config))

@gyheart
Copy link

gyheart commented Dec 6, 2018

I added this to run_demo.py before main function, and it starts work

import tensorflow as tf
from keras.backend.tensorflow_backend import set_session
config = tf.ConfigProto()
config.gpu_options.per_process_gpu_memory_fraction = 0.7
set_session(tf.Session(config=config))

Did you train the CRF layer successfully? Would you share your training code?
My email is [email protected].
Thanks.

@cv-shiyanshi
Copy link

@gyheart Have you got the training code? I have trying to train it with caffe,but something wrong with it,and I am going to train it with tensorflow,could you give me some advice?

@gyheart
Copy link

gyheart commented Jan 14, 2019

@gyheart Have you got the training code? I have trying to train it with caffe,but something wrong with it,and I am going to train it with tensorflow,could you give me some advice?

No. I did't train it successfully in keras. If you get the code, please tell me. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants