Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Flax NNX Randomness #4279

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

8bitmp3
Copy link
Collaborator

@8bitmp3 8bitmp3 commented Oct 10, 2024

Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@8bitmp3
Copy link
Collaborator Author

8bitmp3 commented Oct 10, 2024

Also updating:

- Here is a list of the main PRNG-related types in Flax NNX:
+ Here are the main PRNG-related types in Flax NNX:

Added the JAX jax.random tutorial for new users:

> **Note:** To learn more about random number generation in JAX,
the `jax.random` API, and PRNG-generated sequences, check out
this [JAX PRNG tutorial](https://jax.readthedocs.io/en/latest/random-numbers.html).

Added a link to JAX Working with pytrees for new users:

`nnx.reseed` is a function that accepts an arbitrary graph node (this includes
[pytrees](https://jax.readthedocs.io/en/latest/working-with-pytrees.html#working-with-pytrees)
of `nnx.Module`s)...

Added nnx.:

...`nnx.Rngs` object..... `nnx.reseed`.... `nnx.Dropout`

@8bitmp3 8bitmp3 self-assigned this Oct 10, 2024
@8bitmp3
Copy link
Collaborator Author

8bitmp3 commented Oct 10, 2024

rebasing after #4281

@8bitmp3
Copy link
Collaborator Author

8bitmp3 commented Oct 15, 2024

@cgarciae PTAL, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant