About Diagram Understanding

Diagram Understanding Example

Diagram Understanding is a project that aims to parse diagrams and answer the corresponding questions. See AI2D Dataset below.


A Diagram Is Worth A Dozen Images

Aniruddha Kembhavi, Mike Salvato, Eric Kolve, Minjoon Seo, Hannaneh Hajishirzi, and Ali Farhadi ECCV  2016

AI2D Dataset

Images 4,903
Questions 4,563
Annotations 4,903

AI2D is a dataset of illustrative diagrams for research on diagram understanding and associated question answering. Each diagram has been densely annotated with object segmentations, diagrammatic and text elements. Each diagram has a corresponding set of questions and answers. For questions about this dataset, please contact ai2-data@allenai.org.


Diagram Understanding Example

Annotated Diagram

Example of an annotated diagram.