Docker images for dask-distributed.
- Base image to use for dask scheduler and workers
- Jupyter Notebook image to use as helper entrypoint
This images are built primarily for the dask-distributed Helm Chart but they should work for more use cases.
A helper docker-compose file is provided to test functionality.
docker-compose up
Open the notebook using the URL that is printed by the output so it has the token.
On a new notebook run:
from dask.distributed import Client
client = Client('scheduler:8786')
client.ncores()
It should output something like this:
{'tcp://172.23.0.4:41269': 4}
Docker compose provides an easy way to building all the images with the right context
docker-compose build
# Just build one image e.g. notebook
docker-compose build notebook