Multi-modal framework to support users with special needs in interaction with public information systems

A framework that provides means for users with special needs to interact with otherwise not accesible public kiosk systems is beeing introduced. On terminals extended by this framework users can interact with kiosk systems through their own mobile device permitting them customized means for interaction. Additionally personal information stored on the mobile device can be used to provide further assistance to the user. Several psychological studies have been conducted in order to evaluate this approach.