Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Child Issue] Scale Testing OSB's Search Clients #507

Closed
3 tasks
IanHoang opened this issue Apr 4, 2024 · 1 comment
Closed
3 tasks

[Child Issue] Scale Testing OSB's Search Clients #507

IanHoang opened this issue Apr 4, 2024 · 1 comment
Assignees
Labels
Child Issue enhancement New feature or request

Comments

@IanHoang
Copy link
Collaborator

IanHoang commented Apr 4, 2024

This is a subtask for Distributed Workload Generation Analysis and Scale Testing. For more details on this subtask, see this meta issue.

We will be focusing on using the search_clients in OSB and determining their impact on service time and latency.

Prerequisites

  1. Select a fast query (such as Term Query)
  2. Set up a large cluster (15+ nodes)

Test Plan

  • 1. Run with OSB's built-in search clients: Running tests with the following 1, 16, 128 search_clients
  • 2. Simulate OSB's search clients manually: Running tests with autoscaling group of EC2 instances. Start at 1 EC2 instance and scale up to 16 and then 128 EC2 instances.
  • 3. Compare results between OSB's built-in search clients and simulated search clients: Compare results and determine the impact on service time and latency
@IanHoang IanHoang added the enhancement New feature or request label Apr 4, 2024
@IanHoang IanHoang self-assigned this Apr 4, 2024
@IanHoang IanHoang changed the title [Child Issue] Scale Testing: How Does OSB Scale [Child Issue] Scale Testing OSB's Search Clients Apr 5, 2024
@gkamat gkamat moved this from Todo to In Progress in Performance Roadmap May 15, 2024
@gkamat gkamat moved this from Backlog to In Progress in OpenSearch Engineering Effectiveness Jun 4, 2024
@IanHoang
Copy link
Collaborator Author

Closing this issue as it's outdated. Will create a new child issue for scale testing with the updated list of experiments

@github-project-automation github-project-automation bot moved this from In Progress to Done in Performance Roadmap Jun 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Child Issue enhancement New feature or request
Projects
Status: Done
Development

No branches or pull requests

1 participant