Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[testing-on-gke part 6.9] Export output to a gsheet #2524

Open
wants to merge 3 commits into
base: garnitin/add-gke-load-testing/add-gsheet-utility
Choose a base branch
from

Conversation

gargnitingoogle
Copy link
Collaborator

@gargnitingoogle gargnitingoogle commented Sep 20, 2024

Description

This is on top of #2528 and is followed up in #2538 .

Link to the issue in case of a bug fix.

NA

Testing details

  1. Manual - NA
  2. Unit tests - NA
  3. Integration tests - NA

@gargnitingoogle gargnitingoogle changed the title Garnitin/add gke load testing/upload outputs to gsheet [testing-on-gke part 7.0] Add export to gsheet Sep 20, 2024
@gargnitingoogle gargnitingoogle changed the title [testing-on-gke part 7.0] Add export to gsheet [testing-on-gke part 6.8] Export output to a gsheet Sep 23, 2024
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/improvements-in-run-script branch from 169a527 to b927c1b Compare September 23, 2024 11:17
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 427c67b to 2cb51c3 Compare September 23, 2024 11:17
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/improvements-in-run-script branch from b927c1b to edb8dc3 Compare September 24, 2024 05:19
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch 2 times, most recently from 5264bbf to 09294ec Compare September 24, 2024 09:09

exportToCsvFile(output_file_path=args.output_file, header=_HEADER, rows=rows)

def exportToGsheet(
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move this function to parse_logs_common

f" '{args.output_worksheet_name}' in {url(args.output_gsheet_id)}"
)

exportToGsheet(
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move this function to parse_logs_common


exportToCsvFile(output_file_path=args.output_file, header=_HEADER, rows=rows)

def exportToGsheet(
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move this function to parse_logs_common

f" '{args.output_worksheet_name}' in {url(args.output_gsheet_id)}"
)

exportToGsheet(
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Move this function to parse_logs_common

@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 09294ec to 3bac14d Compare September 24, 2024 12:03
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/improvements-in-run-script branch from edb8dc3 to 8e19d51 Compare September 24, 2024 12:03
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch 2 times, most recently from a94bc19 to 5dc2ea9 Compare September 24, 2024 15:45
@gargnitingoogle gargnitingoogle changed the base branch from garnitin/add-gke-load-testing/improvements-in-run-script to garnitin/add-gke-load-testing/add-gsheet-utility September 24, 2024 15:48
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 3a6f7ab to 172032d Compare September 25, 2024 07:21
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 5dc2ea9 to 6f9e067 Compare September 25, 2024 07:21
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 172032d to 390fe46 Compare September 25, 2024 12:33
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 6f9e067 to a73f23a Compare September 25, 2024 12:33
@gargnitingoogle gargnitingoogle marked this pull request as ready for review September 25, 2024 13:07
@gargnitingoogle gargnitingoogle requested review from sethiay and removed request for a team September 25, 2024 13:07
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 390fe46 to b081112 Compare September 25, 2024 13:45
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from a73f23a to 06ab8c9 Compare September 25, 2024 13:45
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from b081112 to 3ed138f Compare September 25, 2024 14:14
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 06ab8c9 to f908de4 Compare September 25, 2024 14:14
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 3ed138f to 9d14972 Compare September 27, 2024 04:59
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 2bf79fa to eb09af2 Compare September 27, 2024 09:31
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 417e02f to a1a2dc1 Compare September 27, 2024 09:31
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from eb09af2 to 78240a9 Compare September 27, 2024 09:44
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from a1a2dc1 to ea6eefa Compare September 27, 2024 09:45
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 78240a9 to 18c2f27 Compare September 27, 2024 12:45
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from ea6eefa to 4d51a48 Compare September 27, 2024 12:45
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 18c2f27 to 1a38752 Compare September 27, 2024 13:37
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 4d51a48 to 79cf9be Compare September 27, 2024 13:37
@gargnitingoogle gargnitingoogle changed the title [testing-on-gke part 6.8] Export output to a gsheet [testing-on-gke part 6.9] Export output to a gsheet Sep 27, 2024
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 1a38752 to f524114 Compare September 27, 2024 14:59
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 79cf9be to 780519d Compare September 27, 2024 14:59
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from f524114 to e2ff044 Compare September 30, 2024 04:42
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 780519d to f50caca Compare September 30, 2024 04:42
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from e2ff044 to 3af14bf Compare September 30, 2024 05:05
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from f50caca to 0018699 Compare September 30, 2024 05:05
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 3af14bf to 3d46fbd Compare October 2, 2024 23:35
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 0018699 to a296868 Compare October 2, 2024 23:35
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 3d46fbd to 2dde58b Compare October 3, 2024 00:13
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from a296868 to 773695f Compare October 3, 2024 00:13
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 2dde58b to 6b4bfa1 Compare October 3, 2024 04:08
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 773695f to 5bf8515 Compare October 3, 2024 04:08
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 6b4bfa1 to b1f82bc Compare October 3, 2024 04:56
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from 5bf8515 to a998865 Compare October 3, 2024 04:56
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from b1f82bc to 89a9ada Compare October 3, 2024 17:47
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from a998865 to ed56ec3 Compare October 3, 2024 17:47
add generic utility to append to a gsheet

Add utility for gsheet

improve gsheet utility

export fio output to gsheet

encapsulate cpu/memory calculation in fio

disable repeat operations for quick testing

add dlio output export to gsheet

fix a bug in dlio output parsing

fix a column-name in fio csv output

Revert "disable repeat operations for quick testing"

This reverts commit 04bf834.

add log of successful addition to gsheet

clean-up code changes

added some error-checking

wip

wip

fix calls to download_gcs_objects

support key-file on gcs in gsheet

put back cpu/memory metrics

fix couple of logs

fix couple of help messages

put back accidentally deleted command
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/add-gsheet-utility branch from 89a9ada to 1fcf030 Compare October 4, 2024 05:37
@gargnitingoogle gargnitingoogle force-pushed the garnitin/add-gke-load-testing/upload-outputs-to-gsheet branch from d50d8d8 to e6a68ea Compare October 4, 2024 05:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant