2022/06/01 by Thomas Baier, Baier, Thomas, Selene Báez Santamaría +4
Computer Science · #Natural Language Processing Techniques #Semantic Web and Ontologies #Speech and dialogue systems #cs.AI #cs.HC #cs.RO
paper · pdf · doi:10.48550/arxiv.2206.00636
arxiv created 2022/06/01 · arxiv updated 2022/06/02
The paper describes a flexible and modular platform to create multimodal interactive agents. The platform operates through an event-bus on which signals and interpretations are posted in a sequence in time. Different sensors and interpretation components can be integrated by defining their input and output as topics, which results in a logical workflow for further interpretations. We explain a broad range of components that have been developed so far and integrated into a range of interactive agents. We also explain how the actual interaction is recorded as multimodal data as well as in a so-called episodic Knowledge Graph. By analysing the recorded interaction, we can analyse and compare different agents and agent components.