Skip to content

Commit

Permalink
Remove outdated info on benchmarks
Browse files Browse the repository at this point in the history
  • Loading branch information
gdalle committed Sep 12, 2023
1 parent b30cc77 commit 26d0827
Showing 1 changed file with 0 additions and 12 deletions.
12 changes: 0 additions & 12 deletions docs/src/alt_performance.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,9 +17,6 @@ The test case is an HMM with diagonal multivariate normal observations.
- `K`: number of trajectories
- `I`: number of Baum-Welch iterations

!!! danger "Why is this empty?"
The benchmark suite is computationally expensive, and we only run it once for each new release. If the following section contains no plots and the links are broken, you're probably reading the development documentation or a local build of the website. Check out the [stable documentation](https://gdalle.github.io/HiddenMarkovModels.jl/stable/) instead.

### Single sequence

Full benchmark logs: [`results_single_sequence.csv`](./assets/benchmark/results/results_single_sequence.csv).
Expand Down Expand Up @@ -68,15 +65,6 @@ On the plots, we compensate it by subtracting the runtime of the same algorithm
This estimate for the overhead is put in parentheses in the legend.
It is probably over-pessimistic, which is fair because it means that the comparison is now biased against Julia.

### Allocations

A major bottleneck of performance in Julia is memory allocations.
The benchmarks for HMMs.jl thus employ a custom implementation of diagonal multivariate normals, which is entirely allocation-free.

This partly explains the performance gap with HMMBase.jl as the dimension `D` grows beyond 1.
Such a trick is also possible with HMMBase.jl, but slightly more demanding since it requires subtyping `Distribution` from Distributions.jl, instead of just implementing DensityInterface.jl.
We might do it in future benchmarks.

### Parallelism

The packages we include have different approaches to parallelism, which can bias the evaluation in complex ways:
Expand Down

0 comments on commit 26d0827

Please sign in to comment.