You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Let's introduce training configure tool. This tool should find a configuration for network training with some optimal memory costs.
The Training Tool will be able to perform actions to improve the training process:
based on a given memory budget, select only a part of the layers for training, or even a part of the weights of a certain layer - this process called sparse backpropagation.
applications of mixed precision quantization, search for parts of the network for which the materialization technique will be performed (when intermediate results are not saved for some part of the network, but they are recalculated in the backpropagation process)
Let's introduce training configure tool. This tool should find a configuration for network training with some optimal memory costs.
The Training Tool will be able to perform actions to improve the training process:
Related issue: #12873
The text was updated successfully, but these errors were encountered: