Releases: kmheckel/spyx
Releases · kmheckel/spyx
v0.1.20
Paper Edition
Major Revamp:
- Replaced spyx.axn.Axon with spyx.axn.custom
- All preimplemented surrogate gradients are now standalone activation functions, no need to wrap them with another function
- spyx.axn.ActivityRegularization was moved to spyx.nn because it is a hk.Module and therefore a layer.
- Loss and accuracy functions converted to higher order funcs which return the version used in training loops. Time axis arg added.
- Notebooks in the docs were updated to reflect syntax changes.
- time constants are now constrained via jnp.clip which is cleaner and more efficient.
- Fixed bug in data shuffling and optimized it to remove an unnecessary permutation call.
Improved nn.py
I changed the nn definitions to use jnp.clip (hopefully faster) and changed it so that user specified beta values are single learnable constants for the layer - might change again in the future to allow flexible specification of either scalar or vectors for beta.
v0.1.17
camera-ready version bump
v0.1.15
v0.1.0-beta
Stable API. Please provide feedback in the Issues or Discussion sections!
v0.0.1-alpha
Initial code base. More to follow.