Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test(releases): comprehensive testing on release nav #7840

Merged
merged 1 commit into from
Nov 19, 2024

Conversation

jordanl17
Copy link
Member

Description

What to review

Testing

Notes for release

Copy link

vercel bot commented Nov 19, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
page-building-studio ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 19, 2024 4:53am
performance-studio ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 19, 2024 4:53am
test-compiled-studio ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 19, 2024 4:53am
test-next-studio ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 19, 2024 4:53am
test-studio ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 19, 2024 4:53am
1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
studio-workshop ⬜️ Ignored (Inspect) Nov 19, 2024 4:53am

Copy link
Contributor

No changes to documentation

Copy link
Contributor

Component Testing Report Updated Nov 19, 2024 4:50 AM (UTC)

✅ All Tests Passed -- expand for details
File Status Duration Passed Skipped Failed
comments/CommentInput.spec.tsx ✅ Passed (Inspect) 1m 8s 15 0 0
formBuilder/ArrayInput.spec.tsx ✅ Passed (Inspect) 13s 3 0 0
formBuilder/inputs/PortableText/Annotations.spec.tsx ✅ Passed (Inspect) 40s 6 0 0
formBuilder/inputs/PortableText/copyPaste/CopyPaste.spec.tsx ✅ Passed (Inspect) 53s 11 7 0
formBuilder/inputs/PortableText/copyPaste/CopyPasteFields.spec.tsx ✅ Passed (Inspect) 0s 0 12 0
formBuilder/inputs/PortableText/Decorators.spec.tsx ✅ Passed (Inspect) 27s 6 0 0
formBuilder/inputs/PortableText/DisableFocusAndUnset.spec.tsx ✅ Passed (Inspect) 15s 3 0 0
formBuilder/inputs/PortableText/DragAndDrop.spec.tsx ✅ Passed (Inspect) 2m 33s 1 0 0
formBuilder/inputs/PortableText/FocusTracking.spec.tsx ✅ Passed (Inspect) 1m 7s 15 0 0
formBuilder/inputs/PortableText/Input.spec.tsx ✅ Passed (Inspect) 2m 38s 21 0 0
formBuilder/inputs/PortableText/ObjectBlock.spec.tsx ✅ Passed (Inspect) 1m 45s 18 0 0
formBuilder/inputs/PortableText/PresenceCursors.spec.tsx ✅ Passed (Inspect) 13s 3 9 0
formBuilder/inputs/PortableText/RangeDecoration.spec.tsx ✅ Passed (Inspect) 38s 9 0 0
formBuilder/inputs/PortableText/Styles.spec.tsx ✅ Passed (Inspect) 27s 6 0 0
formBuilder/inputs/PortableText/Toolbar.spec.tsx ✅ Passed (Inspect) 54s 12 0 0
formBuilder/tree-editing/TreeEditing.spec.tsx ✅ Passed (Inspect) 0s 0 3 0
formBuilder/tree-editing/TreeEditingNestedObjects.spec.tsx ✅ Passed (Inspect) 0s 0 3 0

Copy link
Contributor

⚡️ Editor Performance Report

Updated Tue, 19 Nov 2024 04:52:32 GMT

Benchmark reference
latency of sanity@latest
experiment
latency of this branch
Δ (%)
latency difference
article (title) 18.5 efps (54ms) 13.5 efps (74ms) +20ms (+37.0%) 🔴
article (body) 59.9 efps (17ms) 63.3 efps (16ms) -1ms (-5.4%)
article (string inside object) 19.2 efps (52ms) 13.7 efps (73ms) +21ms (+40.4%) 🔴
article (string inside array) 16.3 efps (62ms) 11.1 efps (90ms) +29ms (+46.3%) 🔴
recipe (name) 29.4 efps (34ms) 18.9 efps (53ms) +19ms (+55.9%) 🔴
recipe (description) 32.3 efps (31ms) 20.4 efps (49ms) +18ms (+58.1%) 🔴
recipe (instructions) 99.9+ efps (6ms) 99.9+ efps (7ms) +1ms (-/-%)
synthetic (title) 15.9 efps (63ms) 6.0 efps (168ms) +105ms (+166.7%) 🔴
synthetic (string inside object) 14.6 efps (69ms) 6.2 efps (162ms) +94ms (+136.5%) 🔴

efps — editor "frames per second". The number of updates assumed to be possible within a second.

Derived from input latency. efps = 1000 / input_latency

Detailed information

🏠 Reference result

The performance result of sanity@latest

Benchmark latency p75 p90 p99 blocking time test duration
article (title) 54ms 60ms 73ms 229ms 384ms 14.0s
article (body) 17ms 19ms 23ms 177ms 320ms 5.8s
article (string inside object) 52ms 54ms 62ms 343ms 276ms 8.4s
article (string inside array) 62ms 65ms 71ms 215ms 680ms 8.8s
recipe (name) 34ms 37ms 47ms 80ms 0ms 9.2s
recipe (description) 31ms 33ms 40ms 67ms 12ms 6.1s
recipe (instructions) 6ms 8ms 10ms 19ms 3ms 3.4s
synthetic (title) 63ms 67ms 71ms 435ms 1437ms 15.6s
synthetic (string inside object) 69ms 76ms 90ms 156ms 1148ms 9.3s

🧪 Experiment result

The performance result of this branch

Benchmark latency p75 p90 p99 blocking time test duration
article (title) 74ms 80ms 90ms 306ms 2549ms 17.4s
article (body) 16ms 18ms 25ms 226ms 506ms 6.3s
article (string inside object) 73ms 78ms 86ms 248ms 2505ms 11.0s
article (string inside array) 90ms 93ms 99ms 277ms 3078ms 11.9s
recipe (name) 53ms 55ms 63ms 134ms 1020ms 12.1s
recipe (description) 49ms 51ms 59ms 92ms 908ms 8.2s
recipe (instructions) 7ms 8ms 9ms 43ms 34ms 3.5s
synthetic (title) 168ms 178ms 326ms 595ms 9533ms 26.5s
synthetic (string inside object) 162ms 174ms 191ms 783ms 8947ms 19.6s

📚 Glossary

column definitions

  • benchmark — the name of the test, e.g. "article", followed by the label of the field being measured, e.g. "(title)".
  • latency — the time between when a key was pressed and when it was rendered. derived from a set of samples. the median (p50) is shown to show the most common latency.
  • p75 — the 75th percentile of the input latency in the test run. 75% of the sampled inputs in this benchmark were processed faster than this value. this provides insight into the upper range of typical performance.
  • p90 — the 90th percentile of the input latency in the test run. 90% of the sampled inputs were faster than this. this metric helps identify slower interactions that occurred less frequently during the benchmark.
  • p99 — the 99th percentile of the input latency in the test run. only 1% of sampled inputs were slower than this. this represents the worst-case scenarios encountered during the benchmark, useful for identifying potential performance outliers.
  • blocking time — the total time during which the main thread was blocked, preventing user input and UI updates. this metric helps identify performance bottlenecks that may cause the interface to feel unresponsive.
  • test duration — how long the test run took to complete.

@jordanl17 jordanl17 marked this pull request as ready for review November 19, 2024 05:26
@jordanl17 jordanl17 requested a review from a team as a code owner November 19, 2024 05:26
@jordanl17 jordanl17 requested review from rexxars and removed request for a team November 19, 2024 05:26
@jordanl17 jordanl17 merged commit ca2bf71 into corel Nov 19, 2024
59 checks passed
@jordanl17 jordanl17 deleted the corel-release-nav-tests-comprehensive branch November 19, 2024 05:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant