Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Discovery Performance #134

Open
kadaan opened this issue Jun 25, 2022 · 3 comments
Open

Discovery Performance #134

kadaan opened this issue Jun 25, 2022 · 3 comments

Comments

@kadaan
Copy link
Contributor

kadaan commented Jun 25, 2022

The performance of discovery is pretty slow as it is a serial process for all available resources.

The improvements I see are:

  1. Parallelize discovery by type
  2. Initial filtering of discovered resources. If all data for filtering exists on the resources then apply the filter and take the result.
    If all data for filtering is not available then include the result for later processing.
  3. Parallelize updating of resource state by using a worker pool which handles resources after 2.
  4. Final filtering of discovered resources, this time with state
  5. Collect all results from 4. and return them as the result from List()
@kadaan
Copy link
Contributor Author

kadaan commented Jun 25, 2022

@jckuester Feedback?

@kadaan
Copy link
Contributor Author

kadaan commented Jun 25, 2022

@jckuester
Copy link
Owner

I'll have a look 🙂

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants