test cloud results

Signed-off-by: Sahil Yeole <[email protected]>
tailcallhq · Jul 4, 2024 · f2c11e9 · f2c11e9 · github-actions · Jul 4, 2024
1 parent 3aaf778
commit f2c11e9
Show file tree

Hide file tree

Showing 2 changed files with 11 additions and 2 deletions.
diff --git a/.github/workflows/bench.yml b/.github/workflows/bench.yml
@@ -24,6 +24,9 @@ jobs:
         with:
           token: ${{ secrets.GITHUB_TOKEN }}
           ref: ${{ github.event_name == 'pull_request_target' && github.event.pull_request.head.sha || github.sha }}
+      - name: Set IS_PUSH environment variable
+        if: github.ref == 'refs/heads/main'
+        run: echo "IS_PUSH=true" >> $GITHUB_ENV
 
       - name: Build devcontainer
         uses: devcontainers/[email protected]
@@ -35,7 +38,10 @@ jobs:
         uses: grafana/setup-k6-action@v1
 
       - name: Run benchmarks
+        env:
+          IS_PUSH: ${{ env.IS_PUSH }}
         run: |
+          echo "IS_PUSH is set to $IS_PUSH"
           bash ./setup.sh
           bash ./run_benchmarks.sh
 

diff --git a/k6/bench.sh b/k6/bench.sh
@@ -1,5 +1,8 @@
 test_name=$1
 benchmark=$2
 
-# k6 run k6/bench.js --quiet --out cloud --env TEST_NAME=$test_name --env BENCHMARK=$benchmark
-k6 run k6/bench.js --quiet --env TEST_NAME=$test_name --env BENCHMARK=$benchmark
+if [ "$IS_PUSH" = "true" ]; then
+  k6 run k6/bench.js --quiet --out cloud --env TEST_NAME=$test_name --env BENCHMARK=$benchmark
+else
+    k6 run k6/bench.js --quiet --env TEST_NAME=$test_name --env BENCHMARK=$benchmark
+fi
Server	Requests/sec	Latency (ms)
[Tailcall]	`-nan`	`-nan`
[Netflix DGS]	`-nan`	`-nan`
[Gqlgen]	`-nan`	`-nan`
[Caliban]	`-nan`	`-nan`
[async-graphql]	`-nan`	`-nan`
[Apollo GraphQL]	`-nan`	`-nan`