A conversational framework for multiple modalities

Abstract

This paper is concerned with creating conversations around the ECIR conference with multiple modalities. We use a Furhat robot from Furhat robotics to have a physical presence and handle voice. Rasa addresses the AI component of the system. First, we develop a framework for managing messaging between Rasa AI with the Furhat frontend and a display frontend. Second, we create a protocol that describes how to format messages for this connection. The results of the thesis discuss the conversations from the ECIR conference. We evaluate the log from the conference and do both statistical analysis and a discussion of the qualitative results. The thesis also describes the general principles of conversational AI in the background chapter.