-
Notifications
You must be signed in to change notification settings - Fork 386
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Github runner add benchmark #1599
base: main
Are you sure you want to change the base?
Conversation
Assassin718
commented
Jul 10, 2024
- add ilogtail file-to-blackhole performance test
b17ae40
to
5d85ef1
Compare
5d85ef1
to
c690141
Compare
c690141
to
88ebf59
Compare
09dc837
to
73af851
Compare
73af851
to
6078a37
Compare
f269180
to
cb5545d
Compare
cb5545d
to
49812f9
Compare
新增
|
3b212b8
to
c545ad9
Compare
Given {docker-compose} environment | ||
Given docker-compose type {benchmark} | ||
When start docker-compose {performance_file_to_blackhole_filebeat} | ||
When start monitor {e2e-filebeat-1} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这块可以不填具体的容器名吗?比如填个正则,匹配一个容器
…feature to monitor on service name
test/benchmark/test_cases/performance_file_to_blackhole_filebeat/filebeat.yml
Show resolved
Hide resolved
test/engine/trigger/file.go
Outdated
|
||
import ( | ||
"context" | ||
"fmt" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@Abingcbc 这个生成测试文件的方法没有通用的?还需要新建一个?
@@ -0,0 +1,24 @@ | |||
#!/bin/bash | |||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
增加下文档说明吧
1、如何使用
2、效果怎么看
4828481
to
72180b5
Compare
72180b5
to
9dfd2db
Compare
6edfc68
to
8e2a268
Compare
- `@e2e-performance @docker-compose`: 表示测试场景为e2e-performance,测试场景由本地docker-compose运行 | ||
- `Given {docker-compose} environment`: 配置启动测试环境,以docker-compose环境启动测试 | ||
- `Given docker-compose type {benchmark}`: 配置docker-compose启动模式,以benchmark模式启动docker-compose,`{}`中参数有两种选项,`e2e`/`benchmark`。以`e2e`模式启动会默认启动ilogtail、goc-server容器,用作e2e测试;以`benchmark`模式启动会默认启动cadvisor容器,用于监控容器运行过程中的资源占用;若在配置文件中不配置该参数,则默认以上一个scenario的启动模式启动。 | ||
- `When start docker-compose {scenario directory}`: `{}`中参数为当前scenario的文件夹名,该行动作会读取`scenario director`文件夹下的docker-compose.yaml文件,通过docker-compose命令启动所有容器 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
directory
- transform_json | ||
condition: | ||
type: "vrl" | ||
source: ."usr-agent" == "no-agent" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
user-agent?
mu.Lock() | ||
defer mu.Unlock() | ||
instance = NewComposeBooter() | ||
switch loadType { | ||
case "e2e": |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
抽取为常量
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
文件名用下划线吧
# Combine the statistic and records files from each benchmark run into a single file | ||
|
||
# Define the input files and the output file | ||
input_statistic_files=($(find test/benchmark/report -type f -name '*ilogtail_statistic.json')) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
*_statistic.json?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这里主要是因为其他agent也会生成文件名以{agentname}_statistic.json为后缀的测试统计结果,而benchmark action只需要关注文件名以ilogtail_statistic.json为后缀的测试统计结果
424a7fb
to
c0505be
Compare