Projects

CamIO Hands

This project builds on the CamIO project to provide point-and-tap interactions allowing a user to acquire detailed information about tactile graphics and 3D models. 

The interface uses an iPhone’s depth and color cameras to track the user’s hands while they interact with a model. When the user points to a feature of interest on the model with their index finger, the system reads aloud basic information about that feature. For additional information, the user lifts their index finger and taps the feature again. This process can be repeated multiple times to access additional levels of…

Characteristics of Smooth Pursuit in Individuals with Central Field Loss

This project investigates the properties of smooth pursuit eye movements in individuals with macular degeneration. Commonly believed to be a fovea-linked eye movement, smooth pursuit has not been previously investigated in individuals with central field loss, despite its importance for tracking moving objects, such as vehicles or pedestrians on a busy street.

Choreographed and Orchestrated Video Annotation (COVA)

Choreographed and Orchestrated media refers to a relatively new concept involving different aspects of a coordinated media presentation coming from different networked devices. In this case, COVA will allow video annotations such as audio descriptions to be played from a personal device such as a smartphone, while a primary video presentation is being played on a completely separate device such as a projector in a theater.

Computer Vision Journal Club

The Computer Vision Journal Club meets periodically to discuss papers on topics in computer vision, machine learning and other topics of interest such as assistive technologies for persons who are blind or visually impaired, dual sensory loss (hearing and vision loss), neuroscience and psychophysics. All are welcome to attend.

Crosswatch

Crosswatch is a smartphone-based system developed for providing real-time guidance to blind and visually impaired travelers at traffic intersections. Using the smartphone's built-in camera and other sensors, Crosswatch is designed to tell blind and visually impaired travelers what kind of traffic intersection they are near, how to align themselves properly to the crosswalk, and when the walk light or other traffic light indicates it is time to cross.

Click here for link to zip file containing Crosswatch code (open source) and documentation.