use highway network and employ decaying learning rate

[primetang]

use highway network and employ decaying learning rate in the new code.

[dennybritz]

Why is the try/catch needed? Can't you just say saver = tf.train.Saver()?

[dennybritz]

Also, I think batches_num_pre_epoch is somewhat of a strange name. I think it should be num_batches_per_epoch. I also think it would be cleaner to not decay per epoch, but decay per some number of steps and have a parameter for that and get rid of that batches per epoch function.

[primetang]

Thank you for your attention, I have rewrite the code about decay_step, and use saver = tf.train.Saver() instead of try/catch.

[qwaider]

Interested