When humans learn a new task there is no clear distinction between training and inference. Even after we explicitly learn a task, we keep learning while we perform. In this project we study the problem of learning to learn without supervision in the context of visual navigation. Our agent learns how to adapt itself to environments by interacting with them. Accordingly, the agent may continue learning even during inference.