Benchmarking fusion engines of multimodal interactive systems

Bruno Dumas, Rolf Ingold, Denis Lalanne

Research output: Contribution in Book/Catalog/Report/Conference proceedingConference contribution

60 Downloads (Pure)


This article proposes an evaluation framework to benchmark the performance of multimodal fusion engines. The paper first introduces different concepts and techniques associated with multimodal fusion engines and further surveys recent implementations. It then discusses the importance of evaluation as a mean to assess fusion engines, not only from the user perspective, but also at a performance level. The article further proposes a benchmark and a formalism to build testbeds for assessing multimodal fusion engines. In its last section, our current fusion engine and the associated system HephaisTK are evaluated thanks to the evaluation framework proposed in this article. The article concludes with a discussion on the proposed quantitative evaluation, suggestions to build useful testbeds, and proposes some future improvements.
Original languageEnglish
Title of host publicationProceedings of the 2009 international conference on Multimodal interfaces (ICMI-MLMI '09)
PublisherACM Press
Number of pages8
ISBN (Print)9781605587721
Publication statusPublished - 2009
Externally publishedYes


  • fusion
  • multimodal fusion
  • multimodal interfaces
  • multimodal toolkit
  • 42
  • multimodal
  • unread
  • HephaisTK


Dive into the research topics of 'Benchmarking fusion engines of multimodal interactive systems'. Together they form a unique fingerprint.

Cite this