Fake metrics endpoint to make ODF happy

[tumido]

Related to: operate-first/support#652

Cherrypicking from @larsks OCP-on-NERC/nerc-ocp-config#18

While the "monitoring-endpoint" configuration in OCS 4.8 was optional,
it appears to be required in 4.10, and ODF refuses to deploy if it
can't reach the endpoint.

This commit provides a fake metrics endpoint to make the ODF operator
happy.

[durandom]

thats funny. @redhat-et/storage any thoughts on this approach?
@guymguym / @cooktheryan not sure if ODF is also in your ballpark

lets
/approve
/lgtm
to make current ODF happy

[sesheta]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: durandom

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [durandom]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[yehudasa]

@oritwas @jdurgin maybe there should be a better way to override ODF?

[yehudasa]

@durandom @LarsK @tumido
According to @oritwas there are a couple of issues here. First, you're supposed to read the ceph-mgr export endpoint and use that one instead of the fake one that you provided.
The other issue, is that this should actually be optional according to the external mode docs. So will either need to fix the docs or fix the behavior. Can you open a jira ticket re this?

[tumido]

@yehudasa the problem here is that the external Ceph solution we use doesn't provide a metrics endpoint to users so we don't have access to it.

Is there a settings for StorageCluster where we can disable ODF contacting the metrics endpoint?

apps/cluster-scope/base/ocs.openshift.io/storageclusters/ocs-external-storagecluster/storagecluster.yaml

Lines 9 to 11 in e9bf61f

	spec:
	externalStorage:
	enable: true

ODF refuses to create the storage cluster unless it can contact metrics endpoint in the external mode.

[tumido]

@yehudasa Which project in Jira should I use for the ticket?

[durandom]

pinged @yehudasa via chat

[tumido]

@yehudasa I think it's not optional, however the docs are a bit confusing about this:

Anyways, opened a BZ here: https://bugzilla.redhat.com/show_bug.cgi?id=2129117