H2O Driveless AI Helm - Error message - Tensorflow

[bmarolleau]

I got some errors at pod / dai-gpu container startup when running on a POWER8 w/ GPU and Cuda/Nvidia drivers installed. DAI is still functional though. Don't know if it is a normal behavior when running on ppc64le as it is related to the Tensorflow part. Please advise.

~/dai-gpu# kubectl logs daimop-dai-gpu-69dbf597d-mjbcd -c dai-gpu --namespace default
---------------------------------
Welcome to H2O.ai's Driverless AI
---------------------------------
     version: Unable to dynamically import either GPU or CPU version of tensorflow: expt_gpu=[Errno 2] No such file or directory: '/opt/h2oai/dai/cuda-9.0/lib/python3.6/site-packages/tensorflow_gpu/__init__.py' expt_cpu=[Errno 2] No such file or directory: '/opt/h2oai/dai/cuda-9.0/lib/python3.6/site-packages/tensorflow_cpu/__init__.py'

Could not import tensorflow

1.2.2

- Put data in the volume mounted at /data
- Logs are written to the volume mounted at /log
- Connect to Driverless AI on port 12345 inside the container
- Connect to Jupyter notebook on port 8888 inside the container
/opt/h2oai/dai/run-dai.sh: line 38:   146 Killed                  nohup ./dai-env.sh ./start-h2o.sh &>${RUN_DAI_LOG_DIR}/h2o.out

[brucesemple]

Let's pull Patrick (@[email protected]) into this discussion.

[CreatureDev]

I don't believe TF support was completed for 1.2.2
This will need to be fixed by updating the DAI version that the helm chart is using. I will add this as part of the ICP version 3 support