What happens if the cup is pushed towards the edge of the table?

What happens if the cup is pushed towards the edge of the table?

Our goal is to learn "What happens if Force X is applied to Point Y in the scene?". For example, from a single image, we can infer that the cup will drop if we push it towards the edge of the table. On the right we show the output of our method, i.e. a sequence of velocities in 3D.

Paper

"What happens if..." Learning to Predict the Effect of Forces in Images

Roozbeh Mottaghi, Mohammad Rastegari, Abhinav Gupta, and Ali Farhadi ECCV  2016

Video

Source Code and Dataset

This project's source code, dataset, and simulator code can be downloaded here:

Media Coverage