Skip to content

Commit

Permalink
updated workflow
Browse files Browse the repository at this point in the history
  • Loading branch information
@daveads
daveads committed Jul 24, 2024
1 parent 04f4fcf commit a441d16
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion .github/workflows/bench.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ jobs:
push: never
runCmd: |
bash ./graphql/${{ matrix.service }}/setup.sh
bash run_benchmarks.sh ${{ matrix.service }}
node run_benchmarks.js ${{ matrix.service }}
- name: List benchmark files
run: |
Expand Down

3 comments on commit a441d16

@github-actions
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Query Server Requests/sec Latency (ms) Relative
1 { posts { id userId title user { id name email }}}
[Tailcall] 29,421.00 3.39 210.15x
[async-graphql] 1,925.12 52.13 13.75x
[Caliban] 1,698.81 58.48 12.13x
[GraphQL JIT] 1,334.89 74.57 9.53x
[Gqlgen] 754.42 131.45 5.39x
[Netflix DGS] 362.34 178.04 2.59x
[Apollo GraphQL] 270.28 363.34 1.93x
[Hasura] 140.00 469.60 1.00x
2 { posts { title }}
[Tailcall] 57,688.20 1.73 66.88x
[async-graphql] 9,657.02 10.40 11.20x
[Caliban] 9,483.84 10.93 10.99x
[Gqlgen] 2,116.91 48.91 2.45x
[Apollo GraphQL] 1,790.33 55.80 2.08x
[Netflix DGS] 1,591.93 69.90 1.85x
[GraphQL JIT] 1,372.64 72.74 1.59x
[Hasura] 862.61 115.68 1.00x
3 { greet }
[Caliban] 65,813.40 1.15 25.14x
[Tailcall] 59,757.10 1.68 22.83x
[async-graphql] 47,019.90 2.18 17.96x
[Gqlgen] 46,490.30 5.24 17.76x
[Apollo GraphQL] 8,193.03 12.35 3.13x
[Netflix DGS] 8,106.42 14.80 3.10x
[GraphQL JIT] 5,232.97 19.08 2.00x
[Hasura] 2,617.67 38.12 1.00x

@github-actions
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Query Server Requests/sec Latency (ms) Relative
1 { posts { id userId title user { id name email }}}
[Tailcall] 29,261.50 3.40 168.32x
[async-graphql] 1,992.47 50.39 11.46x
[Caliban] 1,665.24 59.95 9.58x
[GraphQL JIT] 1,288.74 77.25 7.41x
[Gqlgen] 794.37 124.94 4.57x
[Netflix DGS] 372.14 167.00 2.14x
[Apollo GraphQL] 264.10 371.81 1.52x
[Hasura] 173.84 552.30 1.00x
2 { posts { title }}
[Tailcall] 58,892.40 1.69 71.81x
[async-graphql] 9,802.87 10.45 11.95x
[Caliban] 9,566.65 10.82 11.66x
[Gqlgen] 2,203.76 46.92 2.69x
[Apollo GraphQL] 1,732.82 57.61 2.11x
[Netflix DGS] 1,621.63 69.58 1.98x
[GraphQL JIT] 1,333.73 74.86 1.63x
[Hasura] 820.14 121.65 1.00x
3 { greet }
[Caliban] 68,531.80 1.04 27.87x
[Tailcall] 59,718.20 1.69 24.29x
[async-graphql] 48,158.30 2.14 19.59x
[Gqlgen] 48,008.10 5.09 19.52x
[Netflix DGS] 8,336.01 14.44 3.39x
[Apollo GraphQL] 7,958.54 12.76 3.24x
[GraphQL JIT] 5,096.08 19.60 2.07x
[Hasura] 2,458.84 40.57 1.00x

@github-actions
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Query Server Requests/sec Latency (ms) Relative
1 { posts { id userId title user { id name email }}}
[Tailcall] 30,073.50 3.31 364.13x
[async-graphql] 2,017.05 49.71 24.42x
[Caliban] 1,744.73 57.01 21.13x
[GraphQL JIT] 1,322.42 75.28 16.01x
[Gqlgen] 807.26 122.92 9.77x
[Netflix DGS] 365.44 195.13 4.42x
[Apollo GraphQL] 270.33 363.23 3.27x
[Hasura] 82.59 382.55 1.00x
2 { posts { title }}
[Tailcall] 59,709.20 1.67 67.72x
[async-graphql] 9,865.39 10.36 11.19x
[Caliban] 9,707.09 10.65 11.01x
[Gqlgen] 2,211.75 46.86 2.51x
[Apollo GraphQL] 1,776.12 56.24 2.01x
[Netflix DGS] 1,605.78 69.82 1.82x
[GraphQL JIT] 1,360.79 73.38 1.54x
[Hasura] 881.77 113.17 1.00x
3 { greet }
[Caliban] 68,522.20 1.02 25.69x
[Tailcall] 60,478.80 1.67 22.67x
[async-graphql] 48,046.90 2.08 18.01x
[Gqlgen] 47,393.20 5.19 17.77x
[Netflix DGS] 8,292.05 14.60 3.11x
[Apollo GraphQL] 8,035.24 12.67 3.01x
[GraphQL JIT] 5,059.81 19.73 1.90x
[Hasura] 2,667.60 37.42 1.00x

Please sign in to comment.