Towards Lifelike Computer Interfaces that Learn
02.15.2007 - 01.30.2010

This collaborative research project investigates, develops and evaluates lifelike, natural computer interfaces as portals to intelligent programs in the context of Decision Support System (DSS). The goal of this effort is to provide a natural interface that supports realistic spoken dialog and non-verbal cues that is capable of learning to maintain its knowledge current and correct. Research objectives focus around the development of an avatar-based interface with which the DSS user can interact. Communication with the avatar will occur in spoken natural language combined with gestural expressions or pointing on the screen. Speaker-independent continuous speech input as a spontaneous dialog will be supported within the specified DSS domain. A robust backend that can respond intelligently to the questions asked by the DSS user will generate the responses spoken in reply by the avatar with realistic inflection and visual expressions.

This project extends a current National Scien ... >>more