imSitu is a dataset supporting situation recognition, the problem of producing a concise summary of the situation an image depicts including: (1) the main activity, (2) the participating actors, objects, substances, and locations and most importantly (3) the roles these participants play in the activity. The role set used by imSitu is derived from the linguistic resource FrameNet and the entities are derived from ImageNet. The data in imSitu can be used to create robust algorithms for situation recognition.
On September 19, 2016, the New York Times published an article about imSitu called Computer Vision: On the Way to Seeing More.
|Situations per Image||3|
|Unique Entity Types (>3)||11,538 (6,794)|
|Unique Roles (role types)||1,788 (190)|
|Images per Verb (range)||250.2 (200 - 400)|
|Unique Situations (>3)||205,095 (21,505)|
The annotations, supporting metadata and python evaluation scripts are hosted on GitHub. To download images you can follow these direct links: