Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test each backend for relocatability #4288

Open
wants to merge 9 commits into
base: master
Choose a base branch
from
Open

Conversation

jkrumbiegel
Copy link
Member

No description provided.

@jkrumbiegel jkrumbiegel added the skip-changelog Skips changelog enforcer label Aug 30, 2024
@MakieBot
Copy link
Collaborator

MakieBot commented Aug 30, 2024

Compile Times benchmark

Note, that these numbers may fluctuate on the CI servers, so take them with a grain of salt. All benchmark results are based on the mean time and negative percent mean faster than the base branch. Note, that GLMakie + WGLMakie run on an emulated GPU, so the runtime benchmark is much slower. Results are from running:

using_time = @ctime using Backend
# Compile time
create_time = @ctime fig = scatter(1:4; color=1:4, colormap=:turbo, markersize=20, visible=true)
display_time = @ctime Makie.colorbuffer(display(fig))
# Runtime
create_time = @benchmark fig = scatter(1:4; color=1:4, colormap=:turbo, markersize=20, visible=true)
display_time = @benchmark Makie.colorbuffer(fig)
using create display create display
GLMakie 5.25s (5.08, 5.36) 0.09+- 116.07ms (110.69, 122.94) 4.14+- 466.25ms (417.92, 510.51) 36.45+- 9.41ms (8.65, 10.09) 0.56+- 26.28ms (25.85, 26.67) 0.37+-
master 5.28s (5.20, 5.48) 0.10+- 117.10ms (111.97, 133.13) 7.56+- 436.90ms (417.66, 482.66) 21.92+- 9.89ms (9.58, 10.59) 0.36+- 26.50ms (26.05, 26.92) 0.34+-
evaluation 1.01x invariant, -0.03s (-0.32d, 0.56p, 0.09std) 1.01x invariant, -1.03ms (-0.17d, 0.76p, 5.85std) 0.94x noisy🤷‍♀️, 29.35ms (0.98d, 0.10p, 29.19std) 1.05x noisy🤷‍♀️, -0.48ms (-1.02d, 0.08p, 0.46std) 1.01x invariant, -0.22ms (-0.62d, 0.27p, 0.35std)
CairoMakie 4.93s (4.80, 5.09) 0.10+- 112.61ms (108.21, 117.61) 3.24+- 172.02ms (163.74, 184.76) 6.55+- 9.26ms (9.13, 9.38) 0.09+- 1.22ms (1.17, 1.26) 0.04+-
master 4.95s (4.82, 5.13) 0.10+- 111.46ms (109.55, 113.91) 1.62+- 169.54ms (165.83, 173.84) 3.69+- 9.39ms (9.19, 9.68) 0.18+- 1.20ms (1.16, 1.25) 0.04+-
evaluation 1.00x invariant, -0.02s (-0.20d, 0.71p, 0.10std) 0.99x invariant, 1.16ms (0.45d, 0.42p, 2.43std) 0.99x invariant, 2.48ms (0.47d, 0.41p, 5.12std) 1.01x invariant, -0.13ms (-0.90d, 0.13p, 0.13std) 0.98x invariant, 0.02ms (0.64d, 0.26p, 0.04std)
WGLMakie 5.33s (5.25, 5.39) 0.05+- 110.12ms (107.90, 111.71) 1.49+- 5.39s (5.32, 5.45) 0.05+- 11.82ms (11.35, 12.91) 0.53+- 118.72ms (116.30, 122.15) 2.12+-
master 5.47s (5.39, 5.53) 0.06+- 109.73ms (107.26, 112.46) 1.71+- 4.95s (4.89, 5.01) 0.05+- 11.90ms (11.51, 12.69) 0.44+- 125.27ms (116.55, 166.83) 18.43+-
evaluation 1.03x faster ✓, -0.15s (-2.79d, 0.00p, 0.05std) 1.00x invariant, 0.4ms (0.25d, 0.65p, 1.60std) 0.92x slower❌, 0.45s (9.05d, 0.00p, 0.05std) 1.01x invariant, -0.08ms (-0.17d, 0.76p, 0.48std) 1.06x noisy🤷‍♀️, -6.55ms (-0.50d, 0.39p, 10.27std)

@SimonDanisch
Copy link
Member

This needs: davidanthoff/Electron.jl#130

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
skip-changelog Skips changelog enforcer
Projects
Status: Work in progress
Development

Successfully merging this pull request may close these issues.

3 participants