You've been logged out of GDC Vault since the maximum users allowed for this account has been reached. To access Members Only content on GDC Vault, please log out of GDC Vault from the computer which last accessed this account.

Click here to find out about GDC Vault Membership options for more users.

close

The Number One Educational Resource for the Game Industry

Session Name: Powering a Cognitive Assistant for the Blind Using AR
Speaker(s): Yang Liu, Markus Meister
Company Name(s): Caltech, Caltech
Track / Format: Innovation

Did you know free users get access to 30% of content from the last 2 years?


Get your team full access to the most up to date GDC content

Overview: Augmented reality can extend your cognitive abilities. Things that you cannot perceive can be brought within reach of your senses in real time. On that premise, speakers Yang Liu and Markus Meister from Caltech will present a cognitive assistant for blind persons based on the Microsoft HoloLens. The system identifies objects in the environment and gives them virtual voices, communicating maximally distilled knowledge in a way that is intuitive and natural to the human user. By interacting with these voices, the blind user gains all kinds of new abilities: from obstacle avoidance to formation and recall of spatial memories. With this technology, blind people can navigate an unfamiliar multi-story building on their first attempt, without any training. Liu and Meister will discuss the design principle behind the technology and argue that with the same principles, AR can power intelligent assistants that boost cognitive powers for everyone.

XRDC 2018

Yang Liu

Caltech

Markus Meister

Caltech

free content

Innovation

Virtual / Augmented Reality