Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

wrappers for common usage of test_frame_writer #2159

Merged
merged 1 commit into from
Oct 8, 2024

Conversation

martinthomson
Copy link
Member

This reduces boilerplate and encapsulates a good pattern of usage. I wasn't able to make test_frame_writer private, but this is close enough.

This reduces boilerplate and encapsulates a good pattern of usage.
I wasn't able to make `test_frame_writer` private, but this is close
enough.
Copy link

codecov bot commented Oct 8, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.38%. Comparing base (9d12a1f) to head (a2fcb05).
Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2159      +/-   ##
==========================================
- Coverage   95.39%   95.38%   -0.01%     
==========================================
  Files         112      112              
  Lines       36364    36373       +9     
==========================================
+ Hits        34688    34696       +8     
- Misses       1676     1677       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Collaborator

@mxinden mxinden left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Neat.

More generally, I wasn't aware of Connection::test_frame_writer. Great for #2150!

@larseggert larseggert added this pull request to the merge queue Oct 8, 2024
Copy link

github-actions bot commented Oct 8, 2024

Failed Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

All results

Succeeded Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Unsupported Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Merged via the queue into mozilla:main with commit e11528d Oct 8, 2024
62 checks passed
Copy link

github-actions bot commented Oct 8, 2024

Benchmark results

Performance differences relative to 9d12a1f.

coalesce_acked_from_zero 1+1 entries: 💔 Performance has regressed.
       time:   [129.50 ns 129.85 ns 130.20 ns]
       change: [+30.564% +31.203% +31.830%] (p = 0.00 < 0.05)

Found 16 outliers among 100 measurements (16.00%)
6 (6.00%) high mild
10 (10.00%) high severe

coalesce_acked_from_zero 3+1 entries: 💔 Performance has regressed.
       time:   [168.56 ns 169.04 ns 169.55 ns]
       change: [+43.940% +44.577% +45.149%] (p = 0.00 < 0.05)

Found 16 outliers among 100 measurements (16.00%)
3 (3.00%) high mild
13 (13.00%) high severe

coalesce_acked_from_zero 10+1 entries: 💔 Performance has regressed.
       time:   [165.72 ns 166.25 ns 166.90 ns]
       change: [+42.734% +43.382% +44.024%] (p = 0.00 < 0.05)

Found 12 outliers among 100 measurements (12.00%)
2 (2.00%) high mild
10 (10.00%) high severe

coalesce_acked_from_zero 1000+1 entries: 💔 Performance has regressed.
       time:   [134.52 ns 134.87 ns 135.26 ns]
       change: [+37.097% +38.484% +39.683%] (p = 0.00 < 0.05)

Found 7 outliers among 100 measurements (7.00%)
3 (3.00%) high mild
4 (4.00%) high severe

RxStreamOrderer::inbound_frame(): No change in performance detected.
       time:   [111.01 ms 111.07 ms 111.12 ms]
       change: [-0.0744% +0.0012% +0.0754%] (p = 0.98 > 0.05)

Found 11 outliers among 100 measurements (11.00%)
8 (8.00%) low mild
3 (3.00%) high mild

transfer/pacing-false/varying-seeds: No change in performance detected.
       time:   [26.373 ms 27.489 ms 28.604 ms]
       change: [-3.2191% +2.6600% +8.7712%] (p = 0.38 > 0.05)
transfer/pacing-true/varying-seeds: Change within noise threshold.
       time:   [32.886 ms 34.551 ms 36.200 ms]
       change: [-13.873% -7.9117% -1.5853%] (p = 0.02 < 0.05)

Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) low mild

transfer/pacing-false/same-seed: No change in performance detected.
       time:   [25.524 ms 26.263 ms 26.999 ms]
       change: [-4.0952% -0.1179% +3.9947%] (p = 0.95 > 0.05)

Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) low mild

transfer/pacing-true/same-seed: No change in performance detected.
       time:   [40.993 ms 43.076 ms 45.195 ms]
       change: [-2.7810% +4.3778% +11.841%] (p = 0.21 > 0.05)
1-conn/1-100mb-resp (aka. Download)/client: Change within noise threshold.
       time:   [112.72 ms 113.24 ms 113.71 ms]
       thrpt:  [879.43 MiB/s 883.12 MiB/s 887.12 MiB/s]
change:
       time:   [-1.8685% -1.3054% -0.7594%] (p = 0.00 < 0.05)
       thrpt:  [+0.7652% +1.3227% +1.9040%]

Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) low mild

1-conn/10_000-parallel-1b-resp (aka. RPS)/client: No change in performance detected.
       time:   [310.29 ms 313.87 ms 317.37 ms]
       thrpt:  [31.509 Kelem/s 31.861 Kelem/s 32.227 Kelem/s]
change:
       time:   [-2.7113% -1.1398% +0.6215%] (p = 0.17 > 0.05)
       thrpt:  [-0.6177% +1.1530% +2.7869%]
1-conn/1-1b-resp (aka. HPS)/client: No change in performance detected.
       time:   [33.956 ms 34.184 ms 34.430 ms]
       thrpt:  [29.045  elem/s 29.254  elem/s 29.450  elem/s]
change:
       time:   [-0.4136% +0.4710% +1.4149%] (p = 0.29 > 0.05)
       thrpt:  [-1.3952% -0.4688% +0.4153%]

Found 10 outliers among 100 measurements (10.00%)
1 (1.00%) low mild
7 (7.00%) high mild
2 (2.00%) high severe

Client/server transfer results

Transfer of 33554432 bytes over loopback.

Client Server CC Pacing Mean [ms] Min [ms] Max [ms] Relative
msquic msquic 204.4 ± 110.5 101.4 353.2 1.00
neqo msquic reno on 215.9 ± 11.1 202.9 241.6 1.00
neqo msquic reno 241.8 ± 66.5 211.4 450.6 1.00
neqo msquic cubic on 250.9 ± 68.0 209.6 423.0 1.00
neqo msquic cubic 274.8 ± 97.3 212.3 468.9 1.00
msquic neqo reno on 111.6 ± 56.5 82.1 321.0 1.00
msquic neqo reno 147.4 ± 86.3 81.0 323.4 1.00
msquic neqo cubic on 160.3 ± 113.9 84.5 507.5 1.00
msquic neqo cubic 110.7 ± 61.3 81.5 324.9 1.00
neqo neqo reno on 188.6 ± 77.9 125.5 425.2 1.00
neqo neqo reno 276.2 ± 158.9 137.7 678.5 1.00
neqo neqo cubic on 159.2 ± 50.9 113.9 316.9 1.00
neqo neqo cubic 257.3 ± 166.7 145.9 644.8 1.00

⬇️ Download logs

Copy link

github-actions bot commented Oct 8, 2024

Firefox builds for this PR

The following builds are available for testing. Crossed-out builds did not succeed.

@martinthomson martinthomson deleted the test-writer-wrapper branch October 8, 2024 21:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants