Learning Goals From Failure

aha.cs.columbia.edu Figure 1: What are they doing? While just the action is observable (heating the bottle), we still predict the goal behind the action (to open the bottle). In this paper, we learn from failure examples to learn representations of goals in video.