Skip to content
This repository has been archived by the owner on Mar 24, 2022. It is now read-only.

Latest commit

 

History

History

private-docker-registry

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 

Concourse and a Private Docker Registry

Concourse pipelines with a local Docker Registry

A typical question that surfaces from customers planning to adopt and deploy Concourse on their production environments is “How do I run Concourse tasks on a protected or internetless environment where no access to Docker Hub is available?”. The typical short answer from experts or from the Concourse documentation is “deploy your own private Docker registry and point your Concourse pipeline tasks to that registry’s images”.

However, before getting to that final milestone and deploying Concourse and a Docker registry to production, one may want to experiment with a local setup of such scenario. And that is what this article is about.

This article does not provide any recommendation on how to setup a private Docker repository for production (for that see article "Deploying a Private Docker Registry using Bosh") nor any analysis on which products are available for such purpose. My goal here is to share my experience while deploying Concourse and a private Docker registry on a local machine.

  1. Configure your Local Concourse instance

    Either follow the Concourse installation instructions to deploy it with Vagrant or follow this article to deploy it with Bosh-lite.

    Important: the minimum required version of Concourse for this experiment is v1.2.0. Any previous version of that CI tool will fail to download images from the private Docker registry returning a “manifest unknown” API error.

  2. Configure your local Docker registry

    After this setup is done, you should be able to check your local registry’s images with the following command:

    curl http://<your-machine-ip-address>:5000/v2/_catalog

    Hint: use your machine’s ip address instead of localhost or 127.0.0.0. Even though those two hostnames will work for the curl command, they will not work for the Concourse task setup, which requires your machine IP address or hostname for the registry to be found by a pipeline task.

    Here are a couple of other Docker Registry API end-points you can try. For example, using my machine’s IP address 192.168.99.100:

    curl 192.168.99.100:5000/v2/ubuntu/tags/list

    curl 192.168.99.100:5000/v2/ubuntu/manifests/latest

    Note: in case these curl commands fail, you could try to temporarily configure your local registry as insecure (assuming your are not exposing it to the outside world) as described in the documentation https://docs.docker.com/registry/insecure/

  3. Setup your Concourse pipeline and tasks to use the local Docker registry images

    Once your local Concourse and Docker registry are appropriately configured, it is time for you to setup a test pipeline with tasks that will run with an Docker image from your local registry.

    The following file inline-pipeline.yml provides a sample pipeline to test such scenario:

    https://github.com/pivotalservices/concourse-pipeline-samples/blob/master/private-docker-registry/inline-pipeline.yml

    Simply replace the four entries with your ip address value and then create the corresponding pipeline in Concourse. Example:

    fly -t <local-concourse-url> set-pipeline -p test-registry -c inline-pipeline.yml

    That sample pipeline will simply run two tasks that will respectively check the OS version and run a “ls” command in the Docker container in which they run after downloading it from the local Docker registry:

  ...
  type: docker-image
  source:
    repository: 192.168.99.100:5000/ubuntu
    tag: "latest"
    insecure_registries: [ "192.168.99.100:5000" ]
   ...

Access the Concourse web interface, unpause the pipeline you just configured and then run it to check if its tasks appropriately download the Docker image from your local registry.

References


Read more