Augmentative communication devices are traditionally speech generating devices through which the actor uses input devices to construct speech. These devices are typically devoid of any context related to a user’s position, geographical location, scene understanding, etc. With the recent additions of cameras, global positioning sensors and fast computing power in mobile devices, we can make the augmentative communication experience more immersive while removing one level of friction between user and machine. This work will result in a new paradigm for people with speech disabilities to interact with augmentative speech devices. We are developing an innovative tool to enhance communication devices by immersing the device in the speaker’s environment, resulting in context-informed augmentative communication.
The Taskar Center for Accessible Technology
Designing for the fullness of human experience