Orbit is a customized training loop library built on top of Tensorflow 2. It
provides a flexible lightweight library that users can easily use or fork when
writing customized training loop code
in TF2. It intergates with tf.distribute seamlessly and supports running on
different device types (CPU, GPU, and TPU).