Description languages for multimodal interaction: A set of guidelines and its illustration with SMUIML

Bruno Dumas, Denis Lalanne, Rolf Ingold

Research output: Contribution to journalArticlepeer-review

229 Downloads (Pure)

Abstract

This article introduces the problem of modeling multimodal interaction, in the form of markup languages. After an analysis of the current state of the art in multimodal interaction description languages, nine guidelines for languages dedicated at multimodal interaction description are introduced, as well as four different roles that such language should target: communication, configuration, teaching and modeling. The article further presents the SMUIML language, our proposed solution to improve the time synchronicity aspect while still fulfilling other guidelines. SMUIML is finally mapped to these guidelines as a way to evaluate their spectrum and to sketch future works.
Original languageEnglish
Pages (from-to)237-247
Number of pages11
JournalJournal on Multimodal User Interfaces
Volume3
Issue number3
DOIs
Publication statusPublished - 11 Feb 2010
Externally publishedYes

Keywords

  • Human-machine interaction
  • Markup languages
  • Multimodal interfaces
  • Multimodal modelling
  • unread

Fingerprint

Dive into the research topics of 'Description languages for multimodal interaction: A set of guidelines and its illustration with SMUIML'. Together they form a unique fingerprint.

Cite this