Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: Upload FCMetrics with reduced dimensions #4405

Merged
merged 2 commits into from
Jan 26, 2024
Merged

chore: Upload FCMetrics with reduced dimensions #4405

merged 2 commits into from
Jan 26, 2024

Conversation

wearyzen
Copy link
Contributor

@wearyzen wearyzen commented Jan 24, 2024

FC metrics were uploaded to CW with the same dimensions as the test to make it easy to map the metrics with the test in CW. However, each test has a huge number of dimensions which when multiplied with the number of FC metrics we upload add upto too many datapoints stored in CW.
This makes CW slow hard to monitor the dashboard and also has a significant increase in billing.
So limit the dimensions to (cpu-host_version-guest_version) so that we can monitor the dashboard properly and reduce the billing. To map the datapoints with the test that emitted them we'll have to use the datapoint timestamp with some CW query.

License Acceptance

By submitting this pull request, I confirm that my contribution is made under
the terms of the Apache 2.0 license. For more information on following
Developer Certificate of Origin and signing off your commits, please check
CONTRIBUTING.md.

PR Checklist

  • If a specific issue led to this PR, this PR closes the issue.
  • The description of changes is clear and encompassing.
  • Any required documentation changes (code and docs) are included in this PR.
  • API changes follow the Runbook for Firecracker API changes.
  • User-facing changes are mentioned in CHANGELOG.md.
  • All added/changed functionality is tested.
  • New TODOs link to an issue.
  • Commits meet contribution quality standards.

  • This functionality cannot be added in rust-vmm.

@wearyzen wearyzen self-assigned this Jan 24, 2024
Copy link

codecov bot commented Jan 24, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (c910e44) 81.53% compared to head (b5e4444) 81.53%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #4405   +/-   ##
=======================================
  Coverage   81.53%   81.53%           
=======================================
  Files         241      241           
  Lines       29332    29332           
=======================================
  Hits        23916    23916           
  Misses       5416     5416           
Flag Coverage Δ
4.14-c7g.metal 76.92% <ø> (ø)
4.14-m5d.metal 78.84% <ø> (-0.02%) ⬇️
4.14-m6a.metal 77.97% <ø> (ø)
4.14-m6g.metal 76.92% <ø> (ø)
4.14-m6i.metal 78.84% <ø> (ø)
5.10-c7g.metal 79.82% <ø> (ø)
5.10-m5d.metal 81.51% <ø> (+0.01%) ⬆️
5.10-m6a.metal 80.72% <ø> (ø)
5.10-m6g.metal 79.82% <ø> (ø)
5.10-m6i.metal 81.50% <ø> (ø)
6.1-c7g.metal 79.82% <ø> (ø)
6.1-m5d.metal 81.50% <ø> (-0.03%) ⬇️
6.1-m6a.metal 80.72% <ø> (ø)
6.1-m6g.metal 79.82% <ø> (ø)
6.1-m6i.metal 81.50% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@wearyzen wearyzen marked this pull request as ready for review January 25, 2024 18:20
Sudan Landge added 2 commits January 25, 2024 18:21
FC metrics were uploaded to CW with the same dimensions
as the test to make it easy to map the metrics with the test
in CW. However, each test has a huge number of dimensions which
when multiplied with the number of FC metrics we upload add upto
too many datapoints stored in CW.
This makes CW slow hard to monitor the dashboard and also has
a significant increase in billing.
So limit the dimensions to (cpu-host_version-guest_version) so
that we can monitor the dashboard properly and reduce the billing.
To map the datapoints with the test that emitted them we'll have
to use the datapoint timestamp with some CW query.

Signed-off-by: Sudan Landge <[email protected]>
FCMetricsMonitor class relies on `microvm` having a valid
`kernel_file` to set guest kernel dimensions.
sample_latency test restores microvm from snapshot so it
didn't need to have a guest kernel passed while building
microvm object.
Passing guest kernel shouldn't affect the restore test
but it will help FCMetricsMonitor to get the right guest
kernel version so, update `sample_latency` to pass guest
kernel while building the microvm.

Signed-off-by: Sudan Landge <[email protected]>
@wearyzen wearyzen added the Status: Awaiting review Indicates that a pull request is ready to be reviewed label Jan 26, 2024
@wearyzen wearyzen merged commit 49db07b into firecracker-microvm:main Jan 26, 2024
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: Awaiting review Indicates that a pull request is ready to be reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants