Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Compatibility with matrix observations #81

Closed
wants to merge 5 commits into from
Closed

Compatibility with matrix observations #81

wants to merge 5 commits into from

Conversation

gdalle
Copy link
Owner

@gdalle gdalle commented Feb 2, 2024 •
edited
Loading

  • Allow obs_seq and control_seq to be AbstractVecOrMat
  • Update Distributions extension and benchmarks
  • Document new behavior

@gdalle gdalle added the run benchmark Benchmarks are run by CI label Feb 2, 2024
@codecov Codecov
Copy link

codecov bot commented Feb 2, 2024 •
edited
Loading

Codecov Report

Attention: 2 lines in your changes are missing coverage. Please review.

Comparison is base (8bf278a) 92.19% compared to head (5c5b759) 92.26%.

Files Patch % Lines
ext/HiddenMarkovModelsDistributionsExt.jl 50.00% 2 Missing ⚠️
Additional details and impacted files 
@@            Coverage Diff             @@
##             main      #81      +/-   ##
==========================================
+ Coverage   92.19%   92.26%   +0.06%     
==========================================
  Files          18       19       +1     
  Lines         474      491      +17     
==========================================
+ Hits          437      453      +16     
- Misses         37       38       +1

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 2, 2024

Benchmark result

Judge result

Benchmark Report for /home/runner/work/HiddenMarkovModels.jl/HiddenMarkovModels.jl

Job Properties

  • Time of benchmarks:
    • Target: 2 Feb 2024 - 23:55
    • Baseline: 2 Feb 2024 - 23:56
  • Package commits:
    • Target: 9fef71
    • Baseline: 8bf278
  • Julia commits:
    • Target: 312098
    • Baseline: 312098
  • Julia command flags:
    • Target: None
    • Baseline: None
  • Environment variables:
    • Target: OPENBLAS_NUM_THREADS => 1 JULIA_NUM_THREADS => auto
    • Baseline: OPENBLAS_NUM_THREADS => 1 JULIA_NUM_THREADS => auto

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 0.94 (5%) ✅ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 0.94 (5%) ✅ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 0.94 (5%) ✅ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 0.95 (5%) ✅ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 0.92 (5%) ✅ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 0.92 (5%) ✅ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 0.92 (5%) ✅ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 1.06 (5%) ❌ 0.64 (1%) ✅
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 0.91 (5%) ✅ 0.75 (1%) ✅
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 1.26 (5%) ❌ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 1.26 (5%) ❌ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 1.25 (5%) ❌ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 1.28 (5%) ❌ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 0.94 (5%) ✅ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 0.94 (5%) ✅ 1.00 (1%)
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 0.94 (5%) ✅ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]

Julia versioninfo

Target

Julia Version 1.10.0
Commit 3120989f39b (2023-12-25 18:01 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.3 LTS
  uname: Linux 6.2.0-1019-azure #19~22.04.1-Ubuntu SMP Wed Jan 10 22:57:03 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1081 s          0 s         94 s       3480 s          0 s
       #2  3242 MHz       1146 s          0 s         87 s       3424 s          0 s
       #3  2656 MHz       1153 s          0 s        118 s       3392 s          0 s
       #4  2445 MHz        999 s          0 s        106 s       3556 s          0 s
  Memory: 15.60690689086914 GB (14100.3125 MB free)
  Uptime: 468.52 sec
  Load Avg:  2.69  1.34  0.54
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
  Threads: 5 on 4 virtual cores

Baseline

Julia Version 1.10.0
Commit 3120989f39b (2023-12-25 18:01 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.3 LTS
  uname: Linux 6.2.0-1019-azure #19~22.04.1-Ubuntu SMP Wed Jan 10 22:57:03 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2604 MHz       1594 s          0 s        110 s       3716 s          0 s
       #2  2445 MHz       1554 s          0 s        101 s       3766 s          0 s
       #3  3242 MHz       1536 s          0 s        128 s       3762 s          0 s
       #4  2625 MHz       1399 s          0 s        117 s       3909 s          0 s
  Memory: 15.60690689086914 GB (13910.2265625 MB free)
  Uptime: 545.14 sec
  Load Avg:  1.81  1.38  0.62
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
  Threads: 5 on 4 virtual cores

Target result

Benchmark Report for /home/runner/work/HiddenMarkovModels.jl/HiddenMarkovModels.jl

Job Properties

  • Time of benchmark: 2 Feb 2024 - 23:55
  • Package commit: 9fef71
  • Julia commit: 312098
  • Julia command flags: None
  • Environment variables: OPENBLAS_NUM_THREADS => 1 JULIA_NUM_THREADS => auto

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 750.831 μs (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 1.040 ms (5%) 5.41 MiB (1%) 2066
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 337.720 μs (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 340.385 μs (5%) 518.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 593.086 μs (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 437.567 μs (5%) 1.26 MiB (1%) 35
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 340.235 μs (5%) 518.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 56.004 μs (5%) 38.95 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 1.667 ms (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 1.670 ms (5%) 768.56 KiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 1.705 ms (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 1.896 ms (5%) 18.36 MiB (1%) 2066
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 606.562 μs (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 610.790 μs (5%) 1018.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 1.220 ms (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 800.905 μs (5%) 2.48 MiB (1%) 35
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 606.561 μs (5%) 1018.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 79.478 μs (5%) 41.77 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 6.254 ms (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 6.257 ms (5%) 1.48 MiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 303.797 μs (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 402.691 μs (5%) 725.38 KiB (1%) 2066
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 141.254 μs (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 143.458 μs (5%) 143.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 257.089 μs (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 216.774 μs (5%) 347.22 KiB (1%) 35
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 142.846 μs (5%) 143.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 31.699 μs (5%) 37.08 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 159.086 μs (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 161.381 μs (5%) 206.06 KiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 936.297 μs (5%) 1.10 MiB (1%) 8050
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 861.237 μs (5%) 1.81 MiB (1%) 10107
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 661.394 μs (5%) 1.10 MiB (1%) 8021
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 662.677 μs (5%) 1.24 MiB (1%) 8028
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 758.595 μs (5%) 1.10 MiB (1%) 8021
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 741.864 μs (5%) 1.44 MiB (1%) 8036
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 664.680 μs (5%) 1.24 MiB (1%) 8028
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 213.678 μs (5%) 318.33 KiB (1%) 2061
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 667.956 μs (5%) 1.10 MiB (1%) 8021
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 673.025 μs (5%) 1.30 MiB (1%) 8030
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "baum_welch!"] 490.034 μs (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "baum_welch"] 553.432 μs (5%) 727.66 KiB (1%) 2090
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "forward!"] 204.551 μs (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "forward"] 206.475 μs (5%) 143.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "forward_backward!"] 314.607 μs (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "forward_backward"] 273.971 μs (5%) 347.22 KiB (1%) 35
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "logdensity"] 206.284 μs (5%) 143.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "rand"] 201.716 μs (5%) 599.58 KiB (1%) 4061
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "viterbi!"] 214.952 μs (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "viterbi"] 217.847 μs (5%) 206.06 KiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 6.007 ms (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 6.735 ms (5%) 67.57 MiB (1%) 4068
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 1.254 ms (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 1.255 ms (5%) 1.97 MiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 3.871 ms (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 1.785 ms (5%) 4.95 MiB (1%) 36
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 1.256 ms (5%) 1.97 MiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 122.739 μs (5%) 46.45 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 24.009 ms (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 24.036 ms (5%) 2.95 MiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "baum_welch!"] 3.458 ms (5%) 5.44 MiB (1%) 10002
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "baum_welch"] 4.094 ms (5%) 15.67 MiB (1%) 16034
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "forward!"] 1.075 ms (5%) 95.33 KiB (1%) 2001
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "forward"] 1.080 ms (5%) 2.06 MiB (1%) 2007
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "forward_backward!"] 1.810 ms (5%) 188.33 KiB (1%) 3981
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "forward_backward"] 1.424 ms (5%) 5.16 MiB (1%) 3998
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "logdensity"] 1.087 ms (5%) 2.06 MiB (1%) 2007
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "rand"] 165.499 μs (5%) 46.45 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "viterbi!"] 21.248 ms (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "viterbi"] 21.260 ms (5%) 2.95 MiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 436.474 μs (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 549.585 μs (5%) 1.75 MiB (1%) 2066
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 205.814 μs (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 207.487 μs (5%) 268.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 355.092 μs (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 289.440 μs (5%) 660.09 KiB (1%) 35
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 207.948 μs (5%) 268.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 43.091 μs (5%) 37.70 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 482.260 μs (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 484.974 μs (5%) 393.56 KiB (1%) 29

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]

Julia versioninfo

Julia Version 1.10.0
Commit 3120989f39b (2023-12-25 18:01 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.3 LTS
  uname: Linux 6.2.0-1019-azure #19~22.04.1-Ubuntu SMP Wed Jan 10 22:57:03 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2445 MHz       1081 s          0 s         94 s       3480 s          0 s
       #2  3242 MHz       1146 s          0 s         87 s       3424 s          0 s
       #3  2656 MHz       1153 s          0 s        118 s       3392 s          0 s
       #4  2445 MHz        999 s          0 s        106 s       3556 s          0 s
  Memory: 15.60690689086914 GB (14100.3125 MB free)
  Uptime: 468.52 sec
  Load Avg:  2.69  1.34  0.54
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
  Threads: 5 on 4 virtual cores

Baseline result

Benchmark Report for /home/runner/work/HiddenMarkovModels.jl/HiddenMarkovModels.jl

Job Properties

  • Time of benchmark: 2 Feb 2024 - 23:56
  • Package commit: 8bf278
  • Julia commit: 312098
  • Julia command flags: None
  • Environment variables: OPENBLAS_NUM_THREADS => 1 JULIA_NUM_THREADS => auto

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 758.275 μs (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 1.060 ms (5%) 5.41 MiB (1%) 2066
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 360.242 μs (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 361.945 μs (5%) 518.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 581.966 μs (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 438.629 μs (5%) 1.26 MiB (1%) 35
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 360.904 μs (5%) 518.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 56.265 μs (5%) 38.95 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 1.667 ms (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 1.671 ms (5%) 768.56 KiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 1.804 ms (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 1.988 ms (5%) 18.36 MiB (1%) 2066
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 657.707 μs (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 665.732 μs (5%) 1018.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 1.283 ms (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 796.266 μs (5%) 2.48 MiB (1%) 35
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 661.224 μs (5%) 1018.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 79.428 μs (5%) 41.77 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 6.266 ms (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 6.279 ms (5%) 1.48 MiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 302.795 μs (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 396.741 μs (5%) 725.38 KiB (1%) 2066
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 147.425 μs (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 148.898 μs (5%) 143.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 260.095 μs (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 217.495 μs (5%) 347.22 KiB (1%) 35
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 149.098 μs (5%) 143.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 32.030 μs (5%) 37.08 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 156.853 μs (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 159.437 μs (5%) 206.06 KiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 882.506 μs (5%) 1.71 MiB (1%) 8058
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 951.244 μs (5%) 2.42 MiB (1%) 10115
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 524.228 μs (5%) 1.10 MiB (1%) 8021
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 524.478 μs (5%) 1.24 MiB (1%) 8028
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 751.372 μs (5%) 1.10 MiB (1%) 8021
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 591.644 μs (5%) 1.44 MiB (1%) 8036
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 517.826 μs (5%) 1.24 MiB (1%) 8028
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 219.379 μs (5%) 318.33 KiB (1%) 2061
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 655.202 μs (5%) 1.10 MiB (1%) 8021
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 656.535 μs (5%) 1.30 MiB (1%) 8030
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "baum_welch!"] 490.665 μs (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "baum_welch"] 554.845 μs (5%) 727.66 KiB (1%) 2090
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "forward!"] 199.933 μs (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "forward"] 202.959 μs (5%) 143.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "forward_backward!"] 313.565 μs (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "forward_backward"] 274.672 μs (5%) 347.22 KiB (1%) 35
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "logdensity"] 202.368 μs (5%) 143.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "rand"] 204.361 μs (5%) 599.58 KiB (1%) 4061
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "viterbi!"] 213.098 μs (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1", "viterbi"] 214.981 μs (5%) 206.06 KiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 5.860 ms (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 6.742 ms (5%) 67.57 MiB (1%) 4068
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 1.315 ms (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 1.317 ms (5%) 1.97 MiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 3.792 ms (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 1.793 ms (5%) 4.95 MiB (1%) 36
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 1.312 ms (5%) 1.97 MiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 122.669 μs (5%) 46.45 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 24.036 ms (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 24.053 ms (5%) 2.95 MiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "baum_welch!"] 3.416 ms (5%) 5.44 MiB (1%) 10002
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "baum_welch"] 4.028 ms (5%) 15.67 MiB (1%) 16034
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "forward!"] 1.095 ms (5%) 95.33 KiB (1%) 2001
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "forward"] 1.099 ms (5%) 2.06 MiB (1%) 2007
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "forward_backward!"] 1.806 ms (5%) 188.33 KiB (1%) 3981
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "forward_backward"] 1.411 ms (5%) 5.16 MiB (1%) 3998
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "logdensity"] 1.099 ms (5%) 2.06 MiB (1%) 2007
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "rand"] 165.819 μs (5%) 46.45 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "viterbi!"] 20.630 ms (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0", "viterbi"] 20.571 ms (5%) 2.95 MiB (1%) 29
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch!"] 438.609 μs (5%) 4.72 KiB (1%) 42
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "baum_welch"] 546.851 μs (5%) 1.75 MiB (1%) 2066
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward!"] 217.946 μs (5%) 2.39 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward"] 220.622 μs (5%) 268.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward!"] 358.088 μs (5%) 2.58 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "forward_backward"] 291.224 μs (5%) 660.09 KiB (1%) 35
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "logdensity"] 220.070 μs (5%) 268.45 KiB (1%) 27
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "rand"] 42.790 μs (5%) 37.70 KiB (1%) 61
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi!"] 480.407 μs (5%) 2.45 KiB (1%) 21
["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0", "viterbi"] 483.622 μs (5%) 393.56 KiB (1%) 29

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 16 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 32 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 4 obs_dim 10 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 1"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 64 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 1 custom_dist 0"]
  • ["HMMBenchmark.HiddenMarkovModels", "nb_states 8 obs_dim 1 seq_length 100 nb_seqs 20 bw_iter 1 sparse 0 custom_dist 0"]

Julia versioninfo

Julia Version 1.10.0
Commit 3120989f39b (2023-12-25 18:01 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
      Ubuntu 22.04.3 LTS
  uname: Linux 6.2.0-1019-azure #19~22.04.1-Ubuntu SMP Wed Jan 10 22:57:03 UTC 2024 x86_64 x86_64
  CPU: AMD EPYC 7763 64-Core Processor: 
              speed         user         nice          sys         idle          irq
       #1  2604 MHz       1594 s          0 s        110 s       3716 s          0 s
       #2  2445 MHz       1554 s          0 s        101 s       3766 s          0 s
       #3  3242 MHz       1536 s          0 s        128 s       3762 s          0 s
       #4  2625 MHz       1399 s          0 s        117 s       3909 s          0 s
  Memory: 15.60690689086914 GB (13910.2265625 MB free)
  Uptime: 545.14 sec
  Load Avg:  1.81  1.38  0.62
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-15.0.7 (ORCJIT, znver3)
  Threads: 5 on 4 virtual cores

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      48 bits physical, 48 bits virtual
Byte Order:                         Little Endian
CPU(s):                             4
On-line CPU(s) list:                0-3
Vendor ID:                          AuthenticAMD
Model name:                         AMD EPYC 7763 64-Core Processor
CPU family:                         25
Model:                              1
Thread(s) per core:                 2
Core(s) per socket:                 2
Socket(s):                          1
Stepping:                           1
BogoMIPS:                           4890.85
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization:                     AMD-V
Hypervisor vendor:                  Microsoft
Virtualization type:                full
L1d cache:                          64 KiB (2 instances)
L1i cache:                          64 KiB (2 instances)
L2 cache:                           1 MiB (2 instances)
L3 cache:                           32 MiB (1 instance)
NUMA node(s):                       1
NUMA node0 CPU(s):                  0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Mitigation; safe RET, no microcode
Vulnerability Spec store bypass:    Vulnerable
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected
Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft

@gdalle
Copy link
Owner Author

gdalle commented Feb 3, 2024

Too complicated, not enough benefits

@gdalle gdalle closed this Feb 3, 2024
@gdalle gdalle deleted the matrices branch March 1, 2024 18:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
run benchmark Benchmarks are run by CI
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@gdalle