feat: dynamic matcher+template checks

Makefile

@@ -14,7 +14,7 @@ intermediate-docs:
 	@go run ./main.go -h > ./docs/_intermediate/help.txt
 	@go run ./main.go completion -h > ./docs/_intermediate/completion.txt
 	@go run ./main.go lint -h > ./docs/_intermediate/lint.txt
-	@go run ./main.go rules > ./docs/_intermediate/rules.txt
+	@go run ./main.go rules --experimental > ./docs/_intermediate/rules.txt
 	@echo "Can't automate everything, please replace the #Rules section of index.md with the contents of ./docs/_intermediate/rules.txt"
 
 embedmd:

docs/index.md

@@ -52,8 +52,10 @@ Usage:
 
 Flags:
   -c, --config string   path to a configuration file
+      --experimental    enable experimental rules
       --fix             automatically fix problems if possible
   -h, --help            help for lint
+      --stdin           read from stdin
       --strict          fail upon linting error or warning
       --verbose         show more information about linting
 ```
@@ -62,20 +64,32 @@ Flags:
 
 The linter implements the following rules:
 
-* [template-datasource-rule](./rules/template-datasource-rule.md) - Checks that the dashboard has a templated datasource.
-* [template-job-rule](./rules/template-job-rule.md) - Checks that the dashboard has a templated job.
-* [template-instance-rule](./rules/template-instance-rule.md) - Checks that the dashboard has a templated instance.
-* [template-label-promql-rule](./rules/template-label-promql-rule.md) - Checks that the dashboard templated labels have proper PromQL expressions.
-* [template-on-time-change-reload-rule](./rules/template-on-time-change-reload-rule.md) - Checks that the dashboard template variables are configured to reload on time change.
-* [panel-datasource-rule](./rules/panel-datasource-rule.md) - Checks that each panel uses the templated datasource.
-* [panel-title-description-rule](./rules/panel-title-description-rule.md) - Checks that each panel has a title and description.
-* [panel-units-rule](./rules/panel-units-rule.md) - Checks that each panel uses has valid units defined.
-* `panel-no-targets-rule` - Checks that each panel has at least one target.
-* [target-promql-rule](./rules/target-promql-rule.md) - Checks that each target uses a valid PromQL query.
-* [target-rate-interval-rule](./rules/target-rate-interval-rule.md) - Checks that each target uses $__rate_interval.
-* [target-job-rule](./rules/target-job-rule.md) - Checks that every PromQL query has a job matcher.
-* [target-instance-rule](./rules/target-instance-rule.md) - Checks that every PromQL query has a instance matcher.
-* `target-counter-agg-rule` - Checks that any counter metric (ending in _total) is aggregated with rate, irate, or increase.
+* [template-datasource-rule](./rules/template-datasource-rule) - ``stable`` - Checks that the dashboard has a templated datasource.
+* [template-job-rule](./rules/template-job-rule) - `stable` - Checks that the dashboard has a templated job.
+* [template-instance-rule](./rules/template-instance-rule) - `stable` - Checks that the dashboard has a templated instance.
+* [template-label-promql-rule](./rules/template-label-promql-rule) - `stable` - Checks that the dashboard templated labels have proper PromQL expressions.
+* [template-on-time-change-reload-rule](./rules/template-on-time-change-reload-rule) - `stable` - Checks that the dashboard template variables are configured to reload on time change.
+* [panel-datasource-rule](./rules/panel-datasource-rule) - `stable` - Checks that each panel uses the templated datasource.
+* [panel-title-description-rule](./rules/panel-title-description-rule) - `stable` - Checks that each panel has a title and description.
+* [panel-units-rule](./rules/panel-units-rule) - `stable` - Checks that each panel uses has valid units defined.
+* [panel-no-targets-rule](./rules/panel-no-targets-rule) - `stable` - Checks that each panel has at least one target.
+* [target-promql-rule](./rules/target-promql-rule) - `stable` - Checks that each target uses a valid PromQL query.
+* [target-rate-interval-rule](./rules/target-rate-interval-rule) - `stable` - Checks that each target uses $__rate_interval.
+* [target-job-rule](./rules/target-job-rule) - `stable` - Checks that every PromQL query has a job matcher.
+* [target-instance-rule](./rules/target-instance-rule) - `stable` - Checks that every PromQL query has a instance matcher.
+* [target-counter-agg-rule](./rules/target-counter-agg-rule) - `stable` - Checks that any counter metric (ending in _total) is aggregated with rate, irate, or increase.
+* [uneditable-dashboard-rule](./rules/uneditable-dashboard-rule) - `stable` - Checks that the dashboard is not editable.
+* [target-required-matchers-rule](./rules/target-required-matchers-rule) - `experimental` - Checks that target PromQL query has the required matchers
+* [template-required-variables-rule](./rules/template-required-variables-rule) - `experimental` - Checks that the dashboard has a template variable for required variables or matchers that use variables
+
+## Rule stability
+- **Stable** rules have gone through testing and been widely adopted.
+
+- **Experimental** rules are for new and experimental features.
+  These rules are not enabled by default, but can be enabled by providing the `experimental` flag.
+  Allowing early adopters to gain confidence with new features.
+
+- **Deprecated** rules may be removed or replaced when they are marked as deprecated.
 
 ## Related Rules
 

docs/rules/target-required-matchers-rule.md

@@ -0,0 +1,20 @@
+# target-required-matchers-rule
+Checks that each PromQL query has a the matchers specified in rule settings. This rule is experimental and is designed to work with Prometheus datasources.
+
+## Rule Settings
+
+```yaml
+settings:
+  target-required-matchers-rule:
+    matchers:
+      - cluster=~"$cluster"
+      - someLabel="someValue"
+```
+Legacy config example for job and instance
+```yaml
+settings:
+  target-required-matchers-rule:
+    matchers:
+      - job
+      - instance
+```

docs/rules/template-required-variables-rule.md

@@ -0,0 +1,31 @@
+# template-required-variables-rule
+Checks that each dashboard has a templated variable based on provided rule settings and detected variable usage for the target-required-matchers-rule.
+
+# Best Practice
+The rule ensures all of the following conditions.
+
+* The dashboard template exists.
+* The dashboard template is named `xxx`.
+* The dashboard template is labeled `xxx`.
+* The dashboard template uses a templated datasource, specifically named `$datasource`.
+* The dashboard template uses a Prometheus query to find available matching instances.
+* The dashboard template is multi select
+* The dashboard template has an allValue of `.+`
+
+## Rule Settings
+
+```yaml
+settings:
+  template-required-variables-rule:
+    variables:
+      - cluster
+      - namespace
+```
+Legacy config example for job and instance
+```yaml
+settings:
+  template-required-variables-rule:
+    variables:
+      - job
+      - instance
+```

go.mod

@@ -14,6 +14,14 @@ require (
 	gopkg.in/yaml.v3 v3.0.1
 )
 
+require (
+	github.com/aws/aws-sdk-go v1.53.16 // indirect
+	github.com/jmespath/go-jmespath v0.4.0 // indirect
+	github.com/jpillora/backoff v1.0.0 // indirect
+	github.com/mwitkow/go-conntrack v0.0.0-20190716064945-2f068394615f // indirect
+	github.com/prometheus/common/sigv4 v0.1.0 // indirect
+)
+
 require (
 	cloud.google.com/go v0.114.0 // indirect
 	cloud.google.com/go/auth v0.5.1 // indirect
@@ -46,6 +54,7 @@ require (
 	github.com/mitchellh/mapstructure v1.5.0 // indirect
 	github.com/pelletier/go-toml/v2 v2.2.2 // indirect
 	github.com/pmezard/go-difflib v1.0.1-0.20181226105442-5d4384ee4fb2 // indirect
+	github.com/prometheus/alertmanager v0.27.0
 	github.com/prometheus/client_golang v1.19.1 // indirect
 	github.com/prometheus/client_model v0.6.1 // indirect
 	github.com/prometheus/common v0.54.0 // indirect