What happens if the cup is pushed towards the edge of the table?
Our goal is to learn "What happens if Force X is applied to Point Y in the scene?". For example, from a single image, we can infer that the cup will drop if we push it towards the edge of the table. On the right we show the output of our method, i.e. a sequence of velocities in 3D.
This project's source code, dataset, and simulator code can be downloaded here: