Modeling and resolving conflicts and apprehensions in multimodal models

  • Jonathan Pirau

Student thesis: Master typesMaster in Computer science

Abstract

The multimodal interaction allows the user to communicate with a computer using di
erent modalities. It bring to light the question of the fusion between those modalities. Back in the 90’s, numerous work have been done on mul-timodal fusion models. This works analyze all those models using the papers published on them. The systems using those models are also analyzed. This allows us to determine what is good and bad in those models and how the in-teraction with the user and the system is managed. Following this, a solution will be proposed : the MUSE model. This solution will be supported by some application developments aiming to demonstrate all those properties and by a user evaluation. This user evaluation is a comparison of the understanding of MUSE and the main multimodals models such as the CASE and CARE. Then an adjustment will be done following the evaluation results and the user feed-back.
Date of Award26 Aug 2016
Original languageEnglish
Awarding Institution
  • University of Namur
SupervisorBruno Dumas (Supervisor)

Keywords

  • Multimodality
  • MUSE
  • CASE
  • data fusion
  • CARE
  • usability
  • TYCOON
  • multimodal systems

Cite this

Modeling and resolving conflicts and apprehensions in multimodal models
Pirau, J. (Author). 26 Aug 2016

Student thesis: Master typesMaster in Computer science