Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(optional) Verify the smoothness of ODE Flows and try to train with gradient constraints #20

Open
Tracked by #5
EiffL opened this issue Jan 9, 2022 · 0 comments

Comments

@EiffL
Copy link
Contributor

EiffL commented Jan 9, 2022

image

https://github.com/astrodeepnet/sbi_experiments/blob/main/notebooks/ffjord/pure_jax_ode.ipynb

-> Implements a ffjord in jax using sirens to parametrize the dynamics.

FFJORD trained by NLL:
image

FFJORD trained by score loss:
image

It's working pretty well on a first try. Could probably be slightly better with more optimization of the model, note that for instance in https://www.tensorflow.org/probability/examples/FFJORD_Demo they just have tiny networks, and stack 4 ffjords on top of each other.

It would be great to write down exactly the equations of the score of a ffjord to demonstrate the score is smooth.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant