Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reservoir Computing with Haiku #705

Open
Wotaker opened this issue Jul 26, 2023 · 0 comments
Open

Reservoir Computing with Haiku #705

Wotaker opened this issue Jul 26, 2023 · 0 comments

Comments

@Wotaker
Copy link

Wotaker commented Jul 26, 2023

Hi, the Resrviour Computing (RC) is an especially interesting architecture of a Recurent Neural Networks (RNN). It is a convinient tool for the analysys of dynamic systems. I am currently working on my Master thesis studying brain effective connectivity and I use the RC during the studies. Unfortunately none of the autograd libraries (TF, PyTorch nor JAX ecosysem) officially supports this awesome computing approach.

My idea was to implement the Echo State Networks (ESN), the most basic of the architectures in RC, using JAX in Haiku and to benefit both from autograd and JIT acceleration. But I do not have enough time nor skillset to do it on my own, so I plant this idea here, so you can maybe integrate it in your awesome library.

For now, I am using the PyRCN library with a scikit-learn like interface, but it can not be accelerated using GPU.

-> A helpful survey on reservoir computing
-> I have left the same idea in the JAX's discussion page

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant