Staging

Language in virtual worlds

In the multimedia project Staging, CST works together with a number of other Danish research institutions on the topic of interaction with and within virtual worlds. The goal is to allow the user to speak as well as to use other modalities (for instance gestures via a data glove) in order to interact with autonomous agents in a virtual farm. To integrate verbal input with input from other modalities so as to allow as natural as possible a form of communication between user and machine, is a complex and innovative task. The system's language engineering component must be able to translate verbal messages and matching gestures to abstract meaning representations the agents can react to - of course in a coherent dialogue.

Dialogfragment in Stagings farmscenario

Enlarge

CST Contact

Patrizia Paggio patrizia @ cst.dk