Add an option to run tasks so they raise an error during the run (#890)

Add an option to run tasks so they raise an error during the run (#890) #3224