Cache Kubernetes ApiClient

[kevingrismore]

Closes #102

Uses cached Kubernetes ApiClients to prevent the buildup of open sockets. Previously, one socket per flow run would remain in a CLOSE_WAIT state.

Example

Tracking open sockets
Before:

~$ cat /proc/net/tcp | wc -l
4

Run a deployment 5 times:

~$ cat /proc/net/tcp | wc -l
9

Run a deployment 4 more times:

~$ cat /proc/net/tcp | wc -l
13

After:

~$ cat /proc/net/tcp | wc -l
4

Run a deployment 5 times:

~$ cat /proc/net/tcp | wc -l
4

Run a deployment 4 more times:

~$ cat /proc/net/tcp | wc -l
4

Screenshots

Checklist

• References any related issue by including "Closes #" or "Closes ".
  • If no issue exists and your change is not a small fix, please create an issue first.
• Includes tests or only affects documentation.
• Passes pre-commit checks.
  • Run pre-commit install && pre-commit run --all locally for formatting and linting.
• Includes screenshots of documentation updates.
  • Run mkdocs serve view documentation locally.
• Summarizes PR's changes in CHANGELOG.md

[kevingrismore]

Implementation isn't pretty and needs tests, but this solution seems effective in practice when comparing two workers running in an AKS cluster.