Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remove example #19

Merged
merged 1 commit into from
Oct 27, 2024
Merged

remove example #19

merged 1 commit into from
Oct 27, 2024

Conversation

chaoming0625
Copy link
Collaborator

This pull request removes the examples/006_fsdp_and_optimizer.py file, which contained a comprehensive example of using JAX with mesh sharding and a custom optimizer. The file included various components such as environment setup, data classes, neural network definitions, optimizer implementations, and training routines.

Key changes:

  • Removed the entire examples/006_fsdp_and_optimizer.py file, which included:
    • Environment setup for JAX with mesh sharding (os.environ['XLA_FLAGS'] = '--xla_force_host_platform_device_count=8').
    • Data classes for mesh rules and neural network definitions (MeshRules, MLP).
    • Custom optimizer implementation (SGD, SGDState).
    • Training and visualization code (train_step, dataset generation, and plotting).

@chaoming0625 chaoming0625 merged commit 6b54e34 into main Oct 27, 2024
22 checks passed
@chaoming0625 chaoming0625 deleted the update branch October 27, 2024 03:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant