We recommend installing the following software packages to your local computer for your programming lab assignments. (All these are pre-installed in the cloud platform, but we still recommend installing them on your personal computer to be able to conduct these experiments beyond this course.)
(Anaconda ncludes Python, the Jupyter Notebook, and other commonly used packages for scientific computing and data science.)
Installation instructions are here https://docs.anaconda.com/anaconda/install/
conda create -n tensorflow python=3.5 #or python=2.7 etc.
or
(Use pip or pip3 version 8.1 or higher in order to install TensorFlow. This must be installed when you installed Anaconda)
pip install --upgrade tensorflow
or
pip3 install --upgrade tensorflow
C:> activate tensorflow
(tensorflow) C:>
$ source activate tensorflow
(tensorflow) $
Your prompt should change
To install the CPU-only version of TensorFlow, enter the following command:
(tensorflow) C:> pip install --ignore-installed --upgrade tensorflow
To install the GPU version of TensorFlow, enter the following command (on a single line):
(tensorflow) C:> pip install --ignore-installed --upgrade tensorflow-gpu
Further instructions are here https://www.tensorflow.org/install/
We will use openAI gym based environments for assignments. OpenAI gym provides test and simulation environments for many reinforcement learning problems, in particular, games and robotics. It is useful to try your algorithms on different environments available here, even those not used in the assignments.
Documentation: https://gym.openai.com/docs/
Install using the following commands:
git clone https://github.com/openai/gym
cd gym
pip install -e . # minimal install
In case you find it hard to to follow the installation guide for packages. Here is the script that you could run to install all dependencies. By following the steps below, you will create an environment called 'rl', the script is tested only under mac. The script is here install.sh.
- open your mac terminal
- navigate to the directory of the script, run command
chmod u+x install.sh && ./install.sh
- type y for all the questions you will be asked during the installation.
- if no error pops up, the installation succeeds.
Every time you code the lab, remember to run the following command before coding
source activate rl
To open the jupyter notebook, run
jupyter notebook