Options to only create main part of internet.nl Batch API (Django)

[signorrayan]

I saw the deployment part of the documentation, and I also created containers based on that, but I want to know is there any options to run the main parts (Batch API for example) without Grafana and extra containers/services? There are many containers are running after deploying it.

[bwbroersma]

Fair point, monitoring (all exporters, prometheus and grafana) should be in a monitoring profile so it can be easily disabled in favor of a lightweight API instance.

This will have some impact for:

• the nginx config (although it's linked on a static IP address)
  

  Internet.nl/docker/webserver/nginx_templates/app.conf.template

  Lines 248 to 269 in 0e5a6d1

  	# monitoring, requires authentication, override headers, since CSP is too strict
  	location /grafana {
  	include http.headers;
  	include hsts.header;
  	auth_basic "Please enter your monitoring username and password";
  	auth_basic_user_file /etc/nginx/htpasswd/monitoring.htpasswd;
  	proxy_pass http://${IPV4_IP_GRAFANA_INTERNAL}:3000;
  	}
  	location /prometheus {
  	include http.headers;
  	include hsts.header;
  	auth_basic "Please enter your monitoring username and password";
  	auth_basic_user_file /etc/nginx/htpasswd/monitoring.htpasswd;
  	proxy_pass http://${IPV4_IP_PROMETHEUS_INTERNAL}:9090;
  	}
  	location /alertmanager {
  	include http.headers;
  	include hsts.header;
  	auth_basic "Please enter your monitoring username and password";
  	auth_basic_user_file /etc/nginx/htpasswd/monitoring.htpasswd;
  	proxy_pass http://${IPV4_IP_ALERTMANAGER_INTERNAL}:9093;
  	}

  
  Note that the presence of the authentication is tested:

  • Internet.nl/integration_tests/common/test_basic.py

    Lines 106 to 131 in 0e5a6d1

    	@pytest.mark.parametrize(
    	"path",
    	["/grafana", "/prometheus", "/prometheus/targets"],
    	)
    	def test_monitoring_auth(page, app_url, path):
    	"""Monitoring endpoints must be behind basic auth."""
    	response = requests.get(app_url + path, verify=False)
    	assert response.status_code == 401
    	# MONITORING_AUTH provided in docker/test.env
    	auth = ("test", "test")
    	response = requests.get(app_url + path, auth=auth, verify=False)
    	response.raise_for_status()
    	def test_monitoring_auth_raw(page, app_url):
    	"""Monitoring endpoints must be behind basic auth."""
    	path = "/grafana"
    	response = requests.get(app_url + path, verify=False)
    	assert response.status_code == 401
    	# MONITORING_AUTH_RAW provided in docker/test.env
    	auth = ("test_raw", "test_raw")

  • Internet.nl/documentation/images/integration_test_environment.py

    Line 87 in 0e5a6d1

    nginx >> Edge(minlen="2", label="/grafana,/prometheus", lhead="cluster_Monitoring") >> monitoring

The quick fix is just adding:

    profiles:
      - monitoring

to all monitoring services, and adding monitoring to:

Internet.nl/docker/defaults.env

Line 149 in 0e5a6d1

COMPOSE_PROFILES=connectiontest,cron,routinator