[Training] On device training doesn't work with INT8 Models

[Training] On device training doesn't work with INT8 Models #3574