Knowing When To Take A Step Back