NavCog3 is a smartphone turn-by-turn navigation assistant system we developed
specifically designed to enable independent navigation for people with visual impairments …

Blind people often need to identify objects around them, from packages of food to items of
clothing. Automatic object recognition continues to provide limited assistance in such tasks …

When preparing to visit new locations, sighted people often look at maps to build an a priori
mental representation of the environment as a sequence of step-by-step actions and points …

Independent navigation is challenging for blind people, particularly in unfamiliar
environments. Navigation assistive technologies try to provide additional support by guiding …

We introduce a novel vision-and-language navigation (VLN) task of learning to provide real-
time guidance to a blind follower situated in complex dynamic navigation scenarios …

Methods that provide accurate navigation assistance to people with visual impairments often
rely on instrumenting the environment with specialized hardware infrastructure. In particular …

Camera manipulation confounds the use of object recognition applications by blind people.
This is exacerbated when photos from this population are also used to train models, as with …

In this paper we propose a computer vision-based technique that mines existing spatial
image databases for discovery of zebra crosswalks in urban settings. Knowing the location …

Sighted players gain spatial awareness within video games through sight and spatial
awareness tools (SATs) such as minimaps. Visually impaired players (VIPs), however, must …

Navigation assistance services for people with visual impairment pose the challenge of
providing accurate guidance through non-visual navigation instructions. This paper …