Check require grad before generating gradient output

Check require grad before generating gradient output #6324