Cluster Returning Values from All Peers

[roberth05]

We have a Gravel Gateway setup in a 3 peer cluster and are pushing metrics via the Python Prometheus Client library. Specifically, we are using push_to_gateway method. This method requires a "job" parameter be set. The push is successful but Gravel is not writing values to the same instance on successive pushes. Over multiple pushes, we end up with 3 different values on the instances.

When scraping, the value returned seems randomly chosen out of the 3 instances.

Expectation: Based on the documentation, the metric should write to the same instance each time and be retrieved from that same instance, regardless of the instance that received the request.