This paper presents the EU funded project Art-E-Fact and goes into details of the dialogue management module, showing that a directed graph approach is appropriate if certain measures are taken. In this project, a software environment with designated authoring tools is being developed for the creation of narrative, interactive discussion groups of virtual characters. Interaction comprises chatting with a keyboard and the use of specialized devices, e.g. gesture recognition. Target use groups are visitors of a museum who will get interpretations of works of art from different points of view.