Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhancements to batching #463

Open
neworderofjamie opened this issue Sep 27, 2021 · 0 comments
Open

Enhancements to batching #463

neworderofjamie opened this issue Sep 27, 2021 · 0 comments
Milestone

Comments

@neworderofjamie
Copy link
Contributor

The batching system does a few things which make sense in typical ML use cases but, reduce it's usefulness as an efficient parameter-sweeping tool:

  • VarAccessDuplication::DUPLICATE variables are currently initialised once and the same value is copied across all batches. We probably should 'allocate' num things * num batches RNG streams and decide which ones to actually use on a variable-by-variable basis (controlled by flag in Models::VarInit perhaps)
  • Currently connectivity i.e. ind, rowLength etc have the equivalent of VarAccessDuplication::SHARED as this fits with typical ML uses of batching. However, as long as max row length etc stays the same across all batches, no reason not to make this more flexible
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant