Benchmarking fusion engines of multimodal interactive systems

Bruno Dumas, Rolf Ingold, Denis Lalanne

Research output: Contribution in Book/Catalog/Report/Conference proceedingConference contribution

59 Downloads (Pure)

Abstract

This article proposes an evaluation framework to benchmark the performance of multimodal fusion engines. The paper first introduces different concepts and techniques associated with multimodal fusion engines and further surveys recent implementations. It then discusses the importance of evaluation as a mean to assess fusion engines, not only from the user perspective, but also at a performance level. The article further proposes a benchmark and a formalism to build testbeds for assessing multimodal fusion engines. In its last section, our current fusion engine and the associated system HephaisTK are evaluated thanks to the evaluation framework proposed in this article. The article concludes with a discussion on the proposed quantitative evaluation, suggestions to build useful testbeds, and proposes some future improvements.
Original languageEnglish
Title of host publicationProceedings of the 2009 international conference on Multimodal interfaces (ICMI-MLMI '09)
PublisherACM Press
Pages169-176
Number of pages8
ISBN (Print)9781605587721
DOIs
Publication statusPublished - 2009
Externally publishedYes

    Fingerprint

Keywords

  • fusion
  • multimodal fusion
  • multimodal interfaces
  • multimodal toolkit
  • 42
  • multimodal
  • unread
  • HephaisTK
  • SMUIML

Cite this

Dumas, B., Ingold, R., & Lalanne, D. (2009). Benchmarking fusion engines of multimodal interactive systems. In Proceedings of the 2009 international conference on Multimodal interfaces (ICMI-MLMI '09) (pp. 169-176). ACM Press. https://doi.org/10.1145/1647314.1647345