`[[2ʲ, 2ʲ - 2j - 2, 4]]` Gottesman code #282

Fe-r-oz · 2024-05-25T23:25:20Z

I found a small quantum code, aka a Distance 4 code from Gottesman 1997 thesis. This class of [[2ʲ, 2ʲ - j - 2, 3]]` Gottesman codes is derived from [[2ʲ, 2ʲ - 2j - 2, 4]] Gottesman codes . The method is taken from the his thesis:

The first two generators are the Pauli-X and Pauli-Z operators acting on all qubits, represented by Mₓ and Mz, respectively.
The next j generators correspond to M₁ through Mⱼ, which are directly inherited from the [[2ʲ, 2ʲ - j - 2, 3]] Gottesman code's stabilizers. This inclusion ensures that S retains the inherent distance-three property of the original Gottesman code.

So, this is Gottesman(4) that we have in the library

The final j generators are defined as Nᵢ = RMᵢR, where i ranges from 1 to j. Here, R signifies a Hadamard Rotation operation applied to all 2ʲ qubits, and Mᵢ refers to one of the existing generators from the second set (M₁ to Mⱼ).

Finally, Hadamard transform turns X operator to Z and Z operator to X, so for 1 to j Rows of (M₁ to Mⱼ)

github-actions · 2024-05-25T23:51:59Z

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Time of benchmarks:

Target: 25 May 2024 - 23:44
Baseline: 25 May 2024 - 23:51

Package commits:

Target: 43425f
Baseline: 44f618

Julia commits:

Target: d8f37c
Baseline: d8f37c

Julia command flags:

Target: None
Baseline: None

Environment variables:

Target: None
Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["ecc", "evaluate_decoder", "shor_bp_shorsyn"]`	0.95 (5%) ✅	0.99 (1%) ✅
`["ecc", "evaluate_decoder", "toric8_bp_comm"]`	1.03 (5%)	0.98 (1%) ✅
`["ecc", "evaluate_decoder", "toric8_bp_shorsyn"]`	0.99 (5%)	0.97 (1%) ✅
`["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"]`	0.94 (5%) ✅	1.00 (1%)
`["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"]`	0.92 (5%) ✅	1.00 (1%)
`["stabilizer", "canon", "diag_rref500"]`	1.08 (5%) ❌	1.00 (1%)
`["stabilizer", "tensor", "diag_pow5_20"]`	1.12 (5%) ❌	1.00 (1%)
`["stabilizer", "tensor", "pow5_20"]`	1.08 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["circuitsim", "compactification"]
["circuitsim", "mctrajectories"]
["circuitsim", "mctrajectories_sumtype"]
["circuitsim", "mctrajectories_union"]
["circuitsim", "pftrajectories"]
["circuitsim", "pftrajectories_sumtype"]
["circuitsim", "pftrajectories_union"]
["clifford", "dense"]
["clifford", "symbolic"]
["ecc", "evaluate_decoder"]
["pauli", "mul"]
["stabilizer", "canon"]
["stabilizer", "project"]
["stabilizer", "tensor"]
["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 1983 s 0 s 188 s 8203 s 0 s
 #2 0 MHz 2029 s 0 s 184 s 8147 s 0 s
 #3 0 MHz 2190 s 0 s 161 s 8027 s 0 s
 #4 0 MHz 3111 s 0 s 179 s 7065 s 0 s
 Memory: 15.606502532958984 GB (13284.55859375 MB free)
 Uptime: 1042.99 sec
 Load Avg: 1.03 1.02 0.74
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3580 s 0 s 238 s 10960 s 0 s
 #2 0 MHz 3604 s 0 s 227 s 10933 s 0 s
 #3 0 MHz 2857 s 0 s 214 s 11708 s 0 s
 #4 0 MHz 3697 s 0 s 234 s 10826 s 0 s
 Memory: 15.606502532958984 GB (13304.78515625 MB free)
 Uptime: 1484.06 sec
 Load Avg: 1.0 1.01 0.86
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Time of benchmark: 25 May 2024 - 23:44
Package commit: 43425f
Julia commit: d8f37c
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["circuitsim", "compactification", "compact"]`	7.140 ms (5%)
`["circuitsim", "compactification", "no_compact"]`	7.338 ms (5%)		281.25 KiB (1%)	6000
`["circuitsim", "mctrajectories", "q1001_r1"]`	15.269 ms (5%)		500.77 KiB (1%)	18019
`["circuitsim", "mctrajectories", "q101_r1"]`	170.339 μs (5%)		50.53 KiB (1%)	1818
`["circuitsim", "mctrajectories_sumtype", "q1001_r1"]`	13.536 ms (5%)		496 bytes (1%)	9
`["circuitsim", "mctrajectories_sumtype", "q101_r1"]`	121.216 μs (5%)		256 bytes (1%)	8
`["circuitsim", "mctrajectories_union", "q1001_r1"]`	13.393 ms (5%)		496 bytes (1%)	9
`["circuitsim", "mctrajectories_union", "q101_r1"]`	119.604 μs (5%)		256 bytes (1%)	8
`["circuitsim", "pftrajectories", "q1001_r1"]`	59.752 μs (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q1001_r100"]`	171.120 μs (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q1001_r10000"]`	1.098 ms (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q101_r1"]`	6.021 μs (5%)		9.42 KiB (1%)	201
`["circuitsim", "pftrajectories_sumtype", "q1001_r1"]`	42.370 μs (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r100"]`	149.660 μs (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r10000"]`	1.079 ms (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"]`	5.856 ms (5%)
`["circuitsim", "pftrajectories_sumtype", "q101_r1"]`	4.277 μs (5%)
`["circuitsim", "pftrajectories_union", "q1001_r1"]`	22.612 μs (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q1001_r100"]`	131.776 μs (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q1001_r10000"]`	1.054 ms (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q101_r1"]`	2.334 μs (5%)		96 bytes (1%)	2
`["clifford", "dense", "cnot250_on_dense500_destab"]`	11.369 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_dense500_stab"]`	5.685 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_diag500_destab"]`	1.119 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_diag500_stab"]`	560.065 μs (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot_on_dense500_destab"]`	48.821 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_dense500_stab"]`	22.663 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_diag500_destab"]`	25.818 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_diag500_stab"]`	12.914 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "dense500_on_dense500_destab"]`	11.362 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_dense500_stab"]`	5.688 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_diag500_destab"]`	966.749 μs (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_diag500_stab"]`	560.078 μs (5%)		512 bytes (1%)	8
`["clifford", "symbolic", "cnot250_on_dense500_destab"]`	1.480 ms (5%)
`["clifford", "symbolic", "cnot250_on_dense500_stab"]`	702.125 μs (5%)
`["clifford", "symbolic", "cnot250_on_diag500_destab"]`	1.200 ms (5%)
`["clifford", "symbolic", "cnot250_on_diag500_stab"]`	584.754 μs (5%)
`["clifford", "symbolic", "cnot_on_dense500_destab"]`	4.849 μs (5%)
`["clifford", "symbolic", "cnot_on_dense500_stab"]`	2.374 μs (5%)
`["clifford", "symbolic", "cnot_on_diag500_destab"]`	4.809 μs (5%)
`["clifford", "symbolic", "cnot_on_diag500_stab"]`	2.364 μs (5%)
`["ecc", "evaluate_decoder", "shor_bp_comm"]`	1.817 ms (5%)		1.77 MiB (1%)	42625
`["ecc", "evaluate_decoder", "shor_bp_naivesyn"]`	4.282 ms (5%)		3.63 MiB (1%)	81915
`["ecc", "evaluate_decoder", "shor_bp_shorsyn"]`	4.724 ms (5%)		3.72 MiB (1%)	83095
`["ecc", "evaluate_decoder", "shor_pybp_comm"]`	25.565 ms (5%)		3.97 MiB (1%)	116084
`["ecc", "evaluate_decoder", "shor_pybp_naivesyn"]`	51.600 ms (5%)		7.99 MiB (1%)	228133
`["ecc", "evaluate_decoder", "shor_pybp_shorsyn"]`	51.874 ms (5%)		8.07 MiB (1%)	229131
`["ecc", "evaluate_decoder", "shor_table_comm"]`	257.863 μs (5%)		241.48 KiB (1%)	4595
`["ecc", "evaluate_decoder", "shor_table_naivesyn"]`	1.090 ms (5%)		350.88 KiB (1%)	5155
`["ecc", "evaluate_decoder", "shor_table_shorsyn"]`	1.513 ms (5%)		440.22 KiB (1%)	6153
`["ecc", "evaluate_decoder", "toric8_bp_comm"]`	691.429 ms (5%)	11.656 ms	168.48 MiB (1%)	1010665
`["ecc", "evaluate_decoder", "toric8_bp_naivesyn"]`	1.390 s (5%)	26.587 ms	351.34 MiB (1%)	2138899
`["ecc", "evaluate_decoder", "toric8_bp_shorsyn"]`	1.411 s (5%)	32.453 ms	349.55 MiB (1%)	2147748
`["ecc", "evaluate_decoder", "toric8_pybp_comm"]`	401.131 ms (5%)		7.31 MiB (1%)	135575
`["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"]`	802.326 ms (5%)		16.90 MiB (1%)	317606
`["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"]`	812.386 ms (5%)		19.38 MiB (1%)	351522
`["ecc", "evaluate_decoder", "toric8_pymatch_comm"]`	4.211 ms (5%)		1.95 MiB (1%)	23180
`["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"]`	16.951 ms (5%)		6.03 MiB (1%)	92823
`["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"]`	25.985 ms (5%)		8.50 MiB (1%)	126739
`["ecc", "evaluate_decoder", "toric8_table_comm"]`	2.670 ms (5%)		1.64 MiB (1%)	23086
`["ecc", "evaluate_decoder", "toric8_table_naivesyn"]`	14.756 ms (5%)		5.38 MiB (1%)	92628
`["ecc", "evaluate_decoder", "toric8_table_shorsyn"]`	23.822 ms (5%)		7.86 MiB (1%)	126544
`["pauli", "mul", "100"]`	14.195 ns (5%)
`["pauli", "mul", "1000"]`	17.907 ns (5%)
`["pauli", "mul", "100000"]`	713.589 ns (5%)
`["pauli", "mul", "20000000"]`	190.577 μs (5%)
`["stabilizer", "canon", "cano500"]`	3.025 ms (5%)
`["stabilizer", "canon", "diag_cano500"]`	636.811 μs (5%)
`["stabilizer", "canon", "diag_gott500"]`	4.137 ms (5%)		5.19 MiB (1%)	34521
`["stabilizer", "canon", "diag_rref500"]`	731.700 μs (5%)
`["stabilizer", "canon", "gott500"]`	6.574 ms (5%)		5.19 MiB (1%)	34531
`["stabilizer", "canon", "md_cano500"]`	1.540 ms (5%)
`["stabilizer", "canon", "md_rref500"]`	1.563 ms (5%)
`["stabilizer", "canon", "rref500"]`	3.138 ms (5%)
`["stabilizer", "project", "destabilizer"]`	17.943 μs (5%)		288 bytes (1%)	5
`["stabilizer", "project", "stabilizer"]`	8.806 μs (5%)		80 bytes (1%)	2
`["stabilizer", "tensor", "diag_pow5_20"]`	1.407 ms (5%)		23.97 MiB (1%)	34
`["stabilizer", "tensor", "pow5_20"]`	2.597 μs (5%)		6.44 KiB (1%)	31
`["stabilizer", "trace", "destabilizer"]`	31.459 μs (5%)		80 bytes (1%)	2
`["stabilizer", "trace", "stabilizer"]`	24.435 μs (5%)		112 bytes (1%)	3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["circuitsim", "compactification"]
["circuitsim", "mctrajectories"]
["circuitsim", "mctrajectories_sumtype"]
["circuitsim", "mctrajectories_union"]
["circuitsim", "pftrajectories"]
["circuitsim", "pftrajectories_sumtype"]
["circuitsim", "pftrajectories_union"]
["clifford", "dense"]
["clifford", "symbolic"]
["ecc", "evaluate_decoder"]
["pauli", "mul"]
["stabilizer", "canon"]
["stabilizer", "project"]
["stabilizer", "tensor"]
["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 1983 s 0 s 188 s 8203 s 0 s
 #2 0 MHz 2029 s 0 s 184 s 8147 s 0 s
 #3 0 MHz 2190 s 0 s 161 s 8027 s 0 s
 #4 0 MHz 3111 s 0 s 179 s 7065 s 0 s
 Memory: 15.606502532958984 GB (13284.55859375 MB free)
 Uptime: 1042.99 sec
 Load Avg: 1.03 1.02 0.74
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Time of benchmark: 25 May 2024 - 23:51
Package commit: 44f618
Julia commit: d8f37c
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["circuitsim", "compactification", "compact"]`	7.219 ms (5%)
`["circuitsim", "compactification", "no_compact"]`	7.383 ms (5%)		281.25 KiB (1%)	6000
`["circuitsim", "mctrajectories", "q1001_r1"]`	15.296 ms (5%)		500.77 KiB (1%)	18019
`["circuitsim", "mctrajectories", "q101_r1"]`	172.693 μs (5%)		50.53 KiB (1%)	1818
`["circuitsim", "mctrajectories_sumtype", "q1001_r1"]`	13.444 ms (5%)		496 bytes (1%)	9
`["circuitsim", "mctrajectories_sumtype", "q101_r1"]`	121.728 μs (5%)		256 bytes (1%)	8
`["circuitsim", "mctrajectories_union", "q1001_r1"]`	13.178 ms (5%)		496 bytes (1%)	9
`["circuitsim", "mctrajectories_union", "q101_r1"]`	120.666 μs (5%)		256 bytes (1%)	8
`["circuitsim", "pftrajectories", "q1001_r1"]`	61.004 μs (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q1001_r100"]`	172.072 μs (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q1001_r10000"]`	1.098 ms (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q101_r1"]`	6.121 μs (5%)		9.42 KiB (1%)	201
`["circuitsim", "pftrajectories_sumtype", "q1001_r1"]`	43.511 μs (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r100"]`	149.450 μs (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r10000"]`	1.080 ms (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"]`	5.808 ms (5%)
`["circuitsim", "pftrajectories_sumtype", "q101_r1"]`	4.388 μs (5%)
`["circuitsim", "pftrajectories_union", "q1001_r1"]`	22.912 μs (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q1001_r100"]`	132.247 μs (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q1001_r10000"]`	1.052 ms (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q101_r1"]`	2.364 μs (5%)		96 bytes (1%)	2
`["clifford", "dense", "cnot250_on_dense500_destab"]`	11.418 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_dense500_stab"]`	5.799 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_diag500_destab"]`	1.119 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_diag500_stab"]`	558.866 μs (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot_on_dense500_destab"]`	48.561 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_dense500_stab"]`	22.592 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_diag500_destab"]`	26.179 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_diag500_stab"]`	12.704 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "dense500_on_dense500_destab"]`	11.432 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_dense500_stab"]`	5.721 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_diag500_destab"]`	966.809 μs (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_diag500_stab"]`	558.836 μs (5%)		512 bytes (1%)	8
`["clifford", "symbolic", "cnot250_on_dense500_destab"]`	1.478 ms (5%)
`["clifford", "symbolic", "cnot250_on_dense500_stab"]`	702.013 μs (5%)
`["clifford", "symbolic", "cnot250_on_diag500_destab"]`	1.197 ms (5%)
`["clifford", "symbolic", "cnot250_on_diag500_stab"]`	584.894 μs (5%)
`["clifford", "symbolic", "cnot_on_dense500_destab"]`	4.849 μs (5%)
`["clifford", "symbolic", "cnot_on_dense500_stab"]`	2.364 μs (5%)
`["clifford", "symbolic", "cnot_on_diag500_destab"]`	4.799 μs (5%)
`["clifford", "symbolic", "cnot_on_diag500_stab"]`	2.365 μs (5%)
`["ecc", "evaluate_decoder", "shor_bp_comm"]`	1.820 ms (5%)		1.78 MiB (1%)	42751
`["ecc", "evaluate_decoder", "shor_bp_naivesyn"]`	4.301 ms (5%)		3.63 MiB (1%)	81971
`["ecc", "evaluate_decoder", "shor_bp_shorsyn"]`	4.993 ms (5%)		3.77 MiB (1%)	84173
`["ecc", "evaluate_decoder", "shor_pybp_comm"]`	24.426 ms (5%)		3.97 MiB (1%)	116084
`["ecc", "evaluate_decoder", "shor_pybp_naivesyn"]`	50.433 ms (5%)		7.99 MiB (1%)	228133
`["ecc", "evaluate_decoder", "shor_pybp_shorsyn"]`	50.183 ms (5%)		8.07 MiB (1%)	229131
`["ecc", "evaluate_decoder", "shor_table_comm"]`	258.804 μs (5%)		241.48 KiB (1%)	4595
`["ecc", "evaluate_decoder", "shor_table_naivesyn"]`	1.085 ms (5%)		350.88 KiB (1%)	5155
`["ecc", "evaluate_decoder", "shor_table_shorsyn"]`	1.506 ms (5%)		440.22 KiB (1%)	6153
`["ecc", "evaluate_decoder", "toric8_bp_comm"]`	668.651 ms (5%)	11.201 ms	171.95 MiB (1%)	1031070
`["ecc", "evaluate_decoder", "toric8_bp_naivesyn"]`	1.398 s (5%)	21.304 ms	350.12 MiB (1%)	2131731
`["ecc", "evaluate_decoder", "toric8_bp_shorsyn"]`	1.427 s (5%)	25.510 ms	359.84 MiB (1%)	2208270
`["ecc", "evaluate_decoder", "toric8_pybp_comm"]`	396.626 ms (5%)		7.31 MiB (1%)	135575
`["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"]`	849.945 ms (5%)		16.90 MiB (1%)	317606
`["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"]`	878.426 ms (5%)		19.38 MiB (1%)	351522
`["ecc", "evaluate_decoder", "toric8_pymatch_comm"]`	4.129 ms (5%)		1.95 MiB (1%)	23180
`["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"]`	16.789 ms (5%)		6.03 MiB (1%)	92823
`["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"]`	25.607 ms (5%)		8.50 MiB (1%)	126739
`["ecc", "evaluate_decoder", "toric8_table_comm"]`	2.574 ms (5%)		1.64 MiB (1%)	23086
`["ecc", "evaluate_decoder", "toric8_table_naivesyn"]`	14.538 ms (5%)		5.38 MiB (1%)	92628
`["ecc", "evaluate_decoder", "toric8_table_shorsyn"]`	23.694 ms (5%)		7.86 MiB (1%)	126544
`["pauli", "mul", "100"]`	14.406 ns (5%)
`["pauli", "mul", "1000"]`	18.209 ns (5%)
`["pauli", "mul", "100000"]`	727.178 ns (5%)
`["pauli", "mul", "20000000"]`	194.684 μs (5%)
`["stabilizer", "canon", "cano500"]`	3.015 ms (5%)
`["stabilizer", "canon", "diag_cano500"]`	620.000 μs (5%)
`["stabilizer", "canon", "diag_gott500"]`	4.053 ms (5%)		5.19 MiB (1%)	34521
`["stabilizer", "canon", "diag_rref500"]`	674.712 μs (5%)
`["stabilizer", "canon", "gott500"]`	6.507 ms (5%)		5.19 MiB (1%)	34531
`["stabilizer", "canon", "md_cano500"]`	1.613 ms (5%)
`["stabilizer", "canon", "md_rref500"]`	1.601 ms (5%)
`["stabilizer", "canon", "rref500"]`	3.136 ms (5%)
`["stabilizer", "project", "destabilizer"]`	17.914 μs (5%)		288 bytes (1%)	5
`["stabilizer", "project", "stabilizer"]`	8.886 μs (5%)		80 bytes (1%)	2
`["stabilizer", "tensor", "diag_pow5_20"]`	1.254 ms (5%)		23.97 MiB (1%)	34
`["stabilizer", "tensor", "pow5_20"]`	2.396 μs (5%)		6.44 KiB (1%)	31
`["stabilizer", "trace", "destabilizer"]`	31.298 μs (5%)		80 bytes (1%)	2
`["stabilizer", "trace", "stabilizer"]`	24.426 μs (5%)		112 bytes (1%)	3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["circuitsim", "compactification"]
["circuitsim", "mctrajectories"]
["circuitsim", "mctrajectories_sumtype"]
["circuitsim", "mctrajectories_union"]
["circuitsim", "pftrajectories"]
["circuitsim", "pftrajectories_sumtype"]
["circuitsim", "pftrajectories_union"]
["clifford", "dense"]
["clifford", "symbolic"]
["ecc", "evaluate_decoder"]
["pauli", "mul"]
["stabilizer", "canon"]
["stabilizer", "project"]
["stabilizer", "tensor"]
["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3580 s 0 s 238 s 10960 s 0 s
 #2 0 MHz 3604 s 0 s 227 s 10933 s 0 s
 #3 0 MHz 2857 s 0 s 214 s 11708 s 0 s
 #4 0 MHz 3697 s 0 s 234 s 10826 s 0 s
 Memory: 15.606502532958984 GB (13304.78515625 MB free)
 Uptime: 1484.06 sec
 Load Avg: 1.0 1.01 0.86
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`lbt`
`Sys.CPU_THREADS`	4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property	Value
Brand	AMD EPYC 7763 64-Core Processor
Vendor	:AMD
Architecture	:Unknown
Model	Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores	16 physical cores, 16 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 512, 32768) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 48 bits physical
SIMD	256 bit = 32 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Time of benchmarks:

Target: 25 May 2024 - 23:53
Baseline: 26 May 2024 - 00:00

Package commits:

Target: 457fe2
Baseline: 44f618

Julia commits:

Target: d8f37c
Baseline: d8f37c

Julia command flags:

Target: None
Baseline: None

Environment variables:

Target: None
Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID	time ratio	memory ratio
`["circuitsim", "pftrajectories", "q1001_r1"]`	0.93 (5%) ✅	1.00 (1%)
`["ecc", "evaluate_decoder", "shor_bp_shorsyn"]`	0.91 (5%) ✅	0.98 (1%) ✅
`["ecc", "evaluate_decoder", "toric8_bp_naivesyn"]`	1.02 (5%)	0.99 (1%) ✅
`["pauli", "mul", "20000000"]`	1.05 (5%) ❌	1.00 (1%)
`["stabilizer", "canon", "md_cano500"]`	1.10 (5%) ❌	1.00 (1%)
`["stabilizer", "canon", "md_rref500"]`	1.05 (5%) ❌	1.00 (1%)
`["stabilizer", "tensor", "diag_pow5_20"]`	1.09 (5%) ❌	1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["circuitsim", "compactification"]
["circuitsim", "mctrajectories"]
["circuitsim", "mctrajectories_sumtype"]
["circuitsim", "mctrajectories_union"]
["circuitsim", "pftrajectories"]
["circuitsim", "pftrajectories_sumtype"]
["circuitsim", "pftrajectories_union"]
["clifford", "dense"]
["clifford", "symbolic"]
["ecc", "evaluate_decoder"]
["pauli", "mul"]
["stabilizer", "canon"]
["stabilizer", "project"]
["stabilizer", "tensor"]
["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2622 s 0 s 161 s 6735 s 0 s
 #2 0 MHz 2233 s 0 s 190 s 7095 s 0 s
 #3 0 MHz 2160 s 0 s 174 s 7174 s 0 s
 #4 0 MHz 2240 s 0 s 178 s 7098 s 0 s
 Memory: 15.606502532958984 GB (13310.4140625 MB free)
 Uptime: 955.3 sec
 Load Avg: 1.07 1.05 0.75
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3998 s 0 s 212 s 9709 s 0 s
 #2 0 MHz 2985 s 0 s 239 s 10695 s 0 s
 #3 0 MHz 3341 s 0 s 223 s 10346 s 0 s
 #4 0 MHz 3356 s 0 s 234 s 10328 s 0 s
 Memory: 15.606502532958984 GB (13304.7421875 MB free)
 Uptime: 1396.24 sec
 Load Avg: 1.07 1.05 0.88
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Time of benchmark: 25 May 2024 - 23:53
Package commit: 457fe2
Julia commit: d8f37c
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["circuitsim", "compactification", "compact"]`	7.065 ms (5%)
`["circuitsim", "compactification", "no_compact"]`	7.260 ms (5%)		281.25 KiB (1%)	6000
`["circuitsim", "mctrajectories", "q1001_r1"]`	15.486 ms (5%)		500.77 KiB (1%)	18019
`["circuitsim", "mctrajectories", "q101_r1"]`	173.145 μs (5%)		50.53 KiB (1%)	1818
`["circuitsim", "mctrajectories_sumtype", "q1001_r1"]`	13.464 ms (5%)		496 bytes (1%)	9
`["circuitsim", "mctrajectories_sumtype", "q101_r1"]`	121.698 μs (5%)		256 bytes (1%)	8
`["circuitsim", "mctrajectories_union", "q1001_r1"]`	13.462 ms (5%)		496 bytes (1%)	9
`["circuitsim", "mctrajectories_union", "q101_r1"]`	120.676 μs (5%)		256 bytes (1%)	8
`["circuitsim", "pftrajectories", "q1001_r1"]`	59.341 μs (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q1001_r100"]`	174.537 μs (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q1001_r10000"]`	1.143 ms (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q101_r1"]`	5.971 μs (5%)		9.42 KiB (1%)	201
`["circuitsim", "pftrajectories_sumtype", "q1001_r1"]`	42.740 μs (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r100"]`	153.769 μs (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r10000"]`	1.126 ms (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"]`	5.868 ms (5%)
`["circuitsim", "pftrajectories_sumtype", "q101_r1"]`	4.328 μs (5%)
`["circuitsim", "pftrajectories_union", "q1001_r1"]`	22.612 μs (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q1001_r100"]`	136.705 μs (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q1001_r10000"]`	1.100 ms (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q101_r1"]`	2.334 μs (5%)		96 bytes (1%)	2
`["clifford", "dense", "cnot250_on_dense500_destab"]`	11.516 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_dense500_stab"]`	5.853 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_diag500_destab"]`	1.118 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_diag500_stab"]`	559.198 μs (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot_on_dense500_destab"]`	49.473 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_dense500_stab"]`	22.702 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_diag500_destab"]`	25.499 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_diag500_stab"]`	12.784 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "dense500_on_dense500_destab"]`	11.517 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_dense500_stab"]`	5.853 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_diag500_destab"]`	968.676 μs (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_diag500_stab"]`	559.228 μs (5%)		512 bytes (1%)	8
`["clifford", "symbolic", "cnot250_on_dense500_destab"]`	1.474 ms (5%)
`["clifford", "symbolic", "cnot250_on_dense500_stab"]`	696.436 μs (5%)
`["clifford", "symbolic", "cnot250_on_diag500_destab"]`	1.200 ms (5%)
`["clifford", "symbolic", "cnot250_on_diag500_stab"]`	579.788 μs (5%)
`["clifford", "symbolic", "cnot_on_dense500_destab"]`	4.829 μs (5%)
`["clifford", "symbolic", "cnot_on_dense500_stab"]`	2.354 μs (5%)
`["clifford", "symbolic", "cnot_on_diag500_destab"]`	4.799 μs (5%)
`["clifford", "symbolic", "cnot_on_diag500_stab"]`	2.354 μs (5%)
`["ecc", "evaluate_decoder", "shor_bp_comm"]`	1.808 ms (5%)		1.78 MiB (1%)	42709
`["ecc", "evaluate_decoder", "shor_bp_naivesyn"]`	4.300 ms (5%)		3.64 MiB (1%)	82125
`["ecc", "evaluate_decoder", "shor_bp_shorsyn"]`	4.712 ms (5%)		3.71 MiB (1%)	82815
`["ecc", "evaluate_decoder", "shor_pybp_comm"]`	24.812 ms (5%)		3.97 MiB (1%)	116084
`["ecc", "evaluate_decoder", "shor_pybp_naivesyn"]`	50.163 ms (5%)		7.99 MiB (1%)	228133
`["ecc", "evaluate_decoder", "shor_pybp_shorsyn"]`	50.767 ms (5%)		8.07 MiB (1%)	229131
`["ecc", "evaluate_decoder", "shor_table_comm"]`	261.860 μs (5%)		241.48 KiB (1%)	4595
`["ecc", "evaluate_decoder", "shor_table_naivesyn"]`	1.089 ms (5%)		350.88 KiB (1%)	5155
`["ecc", "evaluate_decoder", "shor_table_shorsyn"]`	1.516 ms (5%)		440.22 KiB (1%)	6153
`["ecc", "evaluate_decoder", "toric8_bp_comm"]`	689.237 ms (5%)	12.945 ms	172.09 MiB (1%)	1031875
`["ecc", "evaluate_decoder", "toric8_bp_naivesyn"]`	1.422 s (5%)	32.067 ms	352.54 MiB (1%)	2145976
`["ecc", "evaluate_decoder", "toric8_bp_shorsyn"]`	1.381 s (5%)	25.659 ms	350.18 MiB (1%)	2151472
`["ecc", "evaluate_decoder", "toric8_pybp_comm"]`	389.107 ms (5%)		7.31 MiB (1%)	135575
`["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"]`	807.105 ms (5%)		16.90 MiB (1%)	317606
`["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"]`	805.732 ms (5%)		19.38 MiB (1%)	351522
`["ecc", "evaluate_decoder", "toric8_pymatch_comm"]`	4.211 ms (5%)		1.95 MiB (1%)	23180
`["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"]`	17.074 ms (5%)		6.03 MiB (1%)	92823
`["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"]`	26.168 ms (5%)		8.50 MiB (1%)	126739
`["ecc", "evaluate_decoder", "toric8_table_comm"]`	2.661 ms (5%)		1.64 MiB (1%)	23086
`["ecc", "evaluate_decoder", "toric8_table_naivesyn"]`	14.800 ms (5%)		5.38 MiB (1%)	92628
`["ecc", "evaluate_decoder", "toric8_table_shorsyn"]`	23.906 ms (5%)		7.86 MiB (1%)	126544
`["pauli", "mul", "100"]`	14.928 ns (5%)
`["pauli", "mul", "1000"]`	17.910 ns (5%)
`["pauli", "mul", "100000"]`	719.346 ns (5%)
`["pauli", "mul", "20000000"]`	203.472 μs (5%)
`["stabilizer", "canon", "cano500"]`	3.040 ms (5%)
`["stabilizer", "canon", "diag_cano500"]`	619.211 μs (5%)
`["stabilizer", "canon", "diag_gott500"]`	4.100 ms (5%)		5.19 MiB (1%)	34521
`["stabilizer", "canon", "diag_rref500"]`	655.549 μs (5%)
`["stabilizer", "canon", "gott500"]`	6.612 ms (5%)		5.19 MiB (1%)	34531
`["stabilizer", "canon", "md_cano500"]`	1.711 ms (5%)
`["stabilizer", "canon", "md_rref500"]`	1.655 ms (5%)
`["stabilizer", "canon", "rref500"]`	3.164 ms (5%)
`["stabilizer", "project", "destabilizer"]`	17.894 μs (5%)		288 bytes (1%)	5
`["stabilizer", "project", "stabilizer"]`	8.976 μs (5%)		80 bytes (1%)	2
`["stabilizer", "tensor", "diag_pow5_20"]`	1.388 ms (5%)		23.97 MiB (1%)	34
`["stabilizer", "tensor", "pow5_20"]`	2.579 μs (5%)		6.44 KiB (1%)	31
`["stabilizer", "trace", "destabilizer"]`	31.249 μs (5%)		80 bytes (1%)	2
`["stabilizer", "trace", "stabilizer"]`	24.846 μs (5%)		112 bytes (1%)	3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["circuitsim", "compactification"]
["circuitsim", "mctrajectories"]
["circuitsim", "mctrajectories_sumtype"]
["circuitsim", "mctrajectories_union"]
["circuitsim", "pftrajectories"]
["circuitsim", "pftrajectories_sumtype"]
["circuitsim", "pftrajectories_union"]
["clifford", "dense"]
["clifford", "symbolic"]
["ecc", "evaluate_decoder"]
["pauli", "mul"]
["stabilizer", "canon"]
["stabilizer", "project"]
["stabilizer", "tensor"]
["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2622 s 0 s 161 s 6735 s 0 s
 #2 0 MHz 2233 s 0 s 190 s 7095 s 0 s
 #3 0 MHz 2160 s 0 s 174 s 7174 s 0 s
 #4 0 MHz 2240 s 0 s 178 s 7098 s 0 s
 Memory: 15.606502532958984 GB (13310.4140625 MB free)
 Uptime: 955.3 sec
 Load Avg: 1.07 1.05 0.75
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Time of benchmark: 26 May 2024 - 0:0
Package commit: 44f618
Julia commit: d8f37c
Julia command flags: None
Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID	time	GC time	memory	allocations
`["circuitsim", "compactification", "compact"]`	6.945 ms (5%)
`["circuitsim", "compactification", "no_compact"]`	7.124 ms (5%)		281.25 KiB (1%)	6000
`["circuitsim", "mctrajectories", "q1001_r1"]`	15.698 ms (5%)		500.77 KiB (1%)	18019
`["circuitsim", "mctrajectories", "q101_r1"]`	173.384 μs (5%)		50.53 KiB (1%)	1818
`["circuitsim", "mctrajectories_sumtype", "q1001_r1"]`	13.397 ms (5%)		496 bytes (1%)	9
`["circuitsim", "mctrajectories_sumtype", "q101_r1"]`	121.217 μs (5%)		256 bytes (1%)	8
`["circuitsim", "mctrajectories_union", "q1001_r1"]`	13.424 ms (5%)		496 bytes (1%)	9
`["circuitsim", "mctrajectories_union", "q101_r1"]`	120.385 μs (5%)		256 bytes (1%)	8
`["circuitsim", "pftrajectories", "q1001_r1"]`	63.709 μs (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q1001_r100"]`	182.822 μs (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q1001_r10000"]`	1.154 ms (5%)		93.80 KiB (1%)	2001
`["circuitsim", "pftrajectories", "q101_r1"]`	6.161 μs (5%)		9.42 KiB (1%)	201
`["circuitsim", "pftrajectories_sumtype", "q1001_r1"]`	42.870 μs (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r100"]`	153.848 μs (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r10000"]`	1.128 ms (5%)
`["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"]`	5.830 ms (5%)
`["circuitsim", "pftrajectories_sumtype", "q101_r1"]`	4.328 μs (5%)
`["circuitsim", "pftrajectories_union", "q1001_r1"]`	22.612 μs (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q1001_r100"]`	136.736 μs (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q1001_r10000"]`	1.102 ms (5%)		96 bytes (1%)	2
`["circuitsim", "pftrajectories_union", "q101_r1"]`	2.354 μs (5%)		96 bytes (1%)	2
`["clifford", "dense", "cnot250_on_dense500_destab"]`	11.398 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_dense500_stab"]`	5.698 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_diag500_destab"]`	1.120 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot250_on_diag500_stab"]`	560.119 μs (5%)		512 bytes (1%)	8
`["clifford", "dense", "cnot_on_dense500_destab"]`	49.964 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_dense500_stab"]`	23.895 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_diag500_destab"]`	25.427 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "cnot_on_diag500_stab"]`	13.205 μs (5%)		368 bytes (1%)	10
`["clifford", "dense", "dense500_on_dense500_destab"]`	11.373 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_dense500_stab"]`	5.684 ms (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_diag500_destab"]`	968.585 μs (5%)		512 bytes (1%)	8
`["clifford", "dense", "dense500_on_diag500_stab"]`	560.089 μs (5%)		512 bytes (1%)	8
`["clifford", "symbolic", "cnot250_on_dense500_destab"]`	1.476 ms (5%)
`["clifford", "symbolic", "cnot250_on_dense500_stab"]`	697.036 μs (5%)
`["clifford", "symbolic", "cnot250_on_diag500_destab"]`	1.195 ms (5%)
`["clifford", "symbolic", "cnot250_on_diag500_stab"]`	580.237 μs (5%)
`["clifford", "symbolic", "cnot_on_dense500_destab"]`	4.849 μs (5%)
`["clifford", "symbolic", "cnot_on_dense500_stab"]`	2.354 μs (5%)
`["clifford", "symbolic", "cnot_on_diag500_destab"]`	4.799 μs (5%)
`["clifford", "symbolic", "cnot_on_diag500_stab"]`	2.354 μs (5%)
`["ecc", "evaluate_decoder", "shor_bp_comm"]`	1.830 ms (5%)		1.78 MiB (1%)	42681
`["ecc", "evaluate_decoder", "shor_bp_naivesyn"]`	4.317 ms (5%)		3.62 MiB (1%)	81859
`["ecc", "evaluate_decoder", "shor_bp_shorsyn"]`	5.206 ms (5%)		3.79 MiB (1%)	84691
`["ecc", "evaluate_decoder", "shor_pybp_comm"]`	24.610 ms (5%)		3.97 MiB (1%)	116084
`["ecc", "evaluate_decoder", "shor_pybp_naivesyn"]`	50.101 ms (5%)		7.99 MiB (1%)	228133
`["ecc", "evaluate_decoder", "shor_pybp_shorsyn"]`	50.310 ms (5%)		8.07 MiB (1%)	229131
`["ecc", "evaluate_decoder", "shor_table_comm"]`	258.054 μs (5%)		241.48 KiB (1%)	4595
`["ecc", "evaluate_decoder", "shor_table_naivesyn"]`	1.086 ms (5%)		350.88 KiB (1%)	5155
`["ecc", "evaluate_decoder", "shor_table_shorsyn"]`	1.512 ms (5%)		440.22 KiB (1%)	6153
`["ecc", "evaluate_decoder", "toric8_bp_comm"]`	702.941 ms (5%)	13.137 ms	172.09 MiB (1%)	1031882
`["ecc", "evaluate_decoder", "toric8_bp_naivesyn"]`	1.398 s (5%)	22.592 ms	357.05 MiB (1%)	2172478
`["ecc", "evaluate_decoder", "toric8_bp_shorsyn"]`	1.381 s (5%)	22.968 ms	351.51 MiB (1%)	2159263
`["ecc", "evaluate_decoder", "toric8_pybp_comm"]`	386.634 ms (5%)		7.31 MiB (1%)	135575
`["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"]`	803.244 ms (5%)		16.90 MiB (1%)	317606
`["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"]`	801.306 ms (5%)		19.38 MiB (1%)	351522
`["ecc", "evaluate_decoder", "toric8_pymatch_comm"]`	4.231 ms (5%)		1.95 MiB (1%)	23180
`["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"]`	16.931 ms (5%)		6.03 MiB (1%)	92823
`["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"]`	25.992 ms (5%)		8.50 MiB (1%)	126739
`["ecc", "evaluate_decoder", "toric8_table_comm"]`	2.708 ms (5%)		1.64 MiB (1%)	23086
`["ecc", "evaluate_decoder", "toric8_table_naivesyn"]`	14.640 ms (5%)		5.38 MiB (1%)	92628
`["ecc", "evaluate_decoder", "toric8_table_shorsyn"]`	23.662 ms (5%)		7.86 MiB (1%)	126544
`["pauli", "mul", "100"]`	14.295 ns (5%)
`["pauli", "mul", "1000"]`	18.391 ns (5%)
`["pauli", "mul", "100000"]`	730.138 ns (5%)
`["pauli", "mul", "20000000"]`	193.733 μs (5%)
`["stabilizer", "canon", "cano500"]`	3.078 ms (5%)
`["stabilizer", "canon", "diag_cano500"]`	600.394 μs (5%)
`["stabilizer", "canon", "diag_gott500"]`	4.070 ms (5%)		5.19 MiB (1%)	34521
`["stabilizer", "canon", "diag_rref500"]`	655.258 μs (5%)
`["stabilizer", "canon", "gott500"]`	6.552 ms (5%)		5.19 MiB (1%)	34531
`["stabilizer", "canon", "md_cano500"]`	1.561 ms (5%)
`["stabilizer", "canon", "md_rref500"]`	1.576 ms (5%)
`["stabilizer", "canon", "rref500"]`	3.118 ms (5%)
`["stabilizer", "project", "destabilizer"]`	17.693 μs (5%)		288 bytes (1%)	5
`["stabilizer", "project", "stabilizer"]`	8.756 μs (5%)		80 bytes (1%)	2
`["stabilizer", "tensor", "diag_pow5_20"]`	1.276 ms (5%)		23.97 MiB (1%)	34
`["stabilizer", "tensor", "pow5_20"]`	2.548 μs (5%)		6.44 KiB (1%)	31
`["stabilizer", "trace", "destabilizer"]`	31.729 μs (5%)		80 bytes (1%)	2
`["stabilizer", "trace", "stabilizer"]`	24.596 μs (5%)		112 bytes (1%)	3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

["circuitsim", "compactification"]
["circuitsim", "mctrajectories"]
["circuitsim", "mctrajectories_sumtype"]
["circuitsim", "mctrajectories_union"]
["circuitsim", "pftrajectories"]
["circuitsim", "pftrajectories_sumtype"]
["circuitsim", "pftrajectories_union"]
["clifford", "dense"]
["clifford", "symbolic"]
["ecc", "evaluate_decoder"]
["pauli", "mul"]
["stabilizer", "canon"]
["stabilizer", "project"]
["stabilizer", "tensor"]
["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.603
Commit d8f37c9920a (2024-05-25 21:46 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3998 s 0 s 212 s 9709 s 0 s
 #2 0 MHz 2985 s 0 s 239 s 10695 s 0 s
 #3 0 MHz 3341 s 0 s 223 s 10346 s 0 s
 #4 0 MHz 3356 s 0 s 234 s 10328 s 0 s
 Memory: 15.606502532958984 GB (13304.7421875 MB free)
 Uptime: 1396.24 sec
 Load Avg: 1.07 1.05 0.88
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads	2
`BLAS.vendor()`	`lbt`
`Sys.CPU_THREADS`	4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.85
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property	Value
Brand	AMD EPYC 7763 64-Core Processor
Vendor	:AMD
Architecture	:Unknown
Model	Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores	16 physical cores, 16 logical cores (on executing CPU)
	No Hyperthreading hardware capability detected
Clock Frequencies	Not supported by CPU
Data Cache	Level 1:3 : (32, 512, 32768) kbytes
	64 byte cache line size
Address Size	48 bits virtual, 48 bits physical
SIMD	256 bit = 32 byte max. SIMD vector size
Time Stamp Counter	TSC is accessible via `rdtsc`
	TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring	Performance Monitoring Counters (PMC) are not supported
Hypervisor	Yes, Microsoft

codecov · 2024-05-26T00:08:23Z

Codecov Report

Attention: Patch coverage is 92.85714% with 1 line in your changes missing coverage. Please review.

Project coverage is 82.43%. Comparing base (44f618a) to head (2b95282).
Report is 38 commits behind head on master.

Files with missing lines	Patch %	Lines
src/ecc/codes/gottesman4.jl	92.85%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #282      +/-   ##
==========================================
+ Coverage   82.20%   82.43%   +0.22%     
==========================================
  Files          59       60       +1     
  Lines        3940     3945       +5     
==========================================
+ Hits         3239     3252      +13     
+ Misses        701      693       -8

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Fe-r-oz · 2024-06-14T06:14:45Z

Thanks, @Krastanov, for providing clarification in #287!

Gottesman applies H to the state to get Family of Distance 4 codes.

Previously, I was using

 for rows in 1:c.j
       for cols in 1:2^c.j
             if Hⱼ[rows][cols] == (true, false) # X
                  Hⱼ[rows, cols] = (false, true) # X -> Z
             elseif Hⱼ[rows][cols] == (false, true) # Z
                  Hⱼ[rows, cols] = (true, false) # Z -> X
             end 
         end
     end

which can now be changed

    for qᵢ in 1:nqubits(Hⱼ)
        apply!(Hⱼ, sHadamard(qᵢ))
    end

Fe-r-oz · 2024-06-14T12:44:33Z

Fe-r-oz added 3 commits May 26, 2024 04:12

Adding [[2ʲ, 2ʲ - 2j - 2, 4]] Gottesman codes to the ECC module

2ab189d

minor cleanup

8d8a0bd

minor cleanup

18f0e5a

Fe-r-oz marked this pull request as draft June 5, 2024 17:45

Polishing up

2b95282

Fe-r-oz marked this pull request as ready for review June 14, 2024 06:35

Fe-r-oz mentioned this pull request Jul 10, 2024

Quantum codes from their classical counterparts and beyond #311

Open

Fe-r-oz changed the title ~~Adding [[2ʲ, 2ʲ - 2j - 2, 4]] Gottesman codes to the ECC module~~ [[2ʲ, 2ʲ - 2j - 2, 4]] Gottesman code Jul 22, 2024

Krastanov added the ECC Having to do with the ECC submodule label Aug 3, 2024

Fe-r-oz marked this pull request as draft August 4, 2024 15:15

Krastanov added the needs rebase A PR that is nearly done, but a merge conflict needs to be fixed. label Sep 27, 2024

Fe-r-oz added 2 commits September 27, 2024 20:16

Merge branch 'master' into GottesmanDistance4code

ef3f04e

misc cleanup

8c126a0

[[2ʲ, 2ʲ - 2j - 2, 4]] Gottesman code #282

Are you sure you want to change the base?

[[2ʲ, 2ʲ - 2j - 2, 4]] Gottesman code #282

Conversation

Fe-r-oz commented May 25, 2024

github-actions bot commented May 25, 2024 • edited Loading

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Target

Baseline

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

Results

Benchmark Group List

Julia versioninfo

Runtime information

codecov bot commented May 26, 2024 • edited Loading

Codecov Report

Fe-r-oz commented Jun 14, 2024

Fe-r-oz commented Jun 14, 2024

`[[2ʲ, 2ʲ - 2j - 2, 4]]` Gottesman code #282

`[[2ʲ, 2ʲ - 2j - 2, 4]]` Gottesman code #282

github-actions bot commented May 25, 2024 •

edited

Loading

codecov bot commented May 26, 2024 •

edited

Loading