We argued previously that we needs to be considering in regards to the specification of the task as an iterative strategy of imperfect communication between the AI designer and the AI agent. For example, within the Atari game Breakout, the agent should either hit the ball back with the paddle,
