[Task Manager] Don't reset number of skipped runs as long as there is a validation error

[ersin-erdal]

resolves: #172325

[elasticmachine]

Pinging @elastic/response-ops (Team:ResponseOps)

[kibana-ci]

💛 Build succeeded, but was flaky

• Buildkite Build
• Commit: f105988

Failed CI Steps

• Defend Workflows Cypress Tests #2

Metrics [docs]

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @ersin-erdal

[ymao1]

I think we should discuss whether this is the right approach or whether we should be ensuring that the task is validating using the "indirect params" when running, meaning if task manager validates the "indirect params" 100 times and skips due to validation error, on the 101st run, task manager should run the task and the task itself should be throwing an error (resulting in a failed task run) based solely on the fact that the indirect params didn't validate (whether or not the rest of the task would have succeeded).

cc @mikecote

[ymao1]

Verified this works as described. For a recurring task, it skips it the MAX_SKIP_ATTEMPTS due to validation error, then runs it. If the run is successful, it does not reset the skip attempts so the next run (at the regularly scheduled interval), the task will not get unnecessarily skipped again.