Description languages for multimodal interaction: A set of guidelines and its illustration with SMUIML

Bruno Dumas, Denis Lalanne, Rolf Ingold

Résultats de recherche: Contribution à un journal/une revueArticleRevue par des pairs

233 Téléchargements (Pure)

Résumé

This article introduces the problem of modeling multimodal interaction, in the form of markup languages. After an analysis of the current state of the art in multimodal interaction description languages, nine guidelines for languages dedicated at multimodal interaction description are introduced, as well as four different roles that such language should target: communication, configuration, teaching and modeling. The article further presents the SMUIML language, our proposed solution to improve the time synchronicity aspect while still fulfilling other guidelines. SMUIML is finally mapped to these guidelines as a way to evaluate their spectrum and to sketch future works.
langue originaleAnglais
Pages (de - à)237-247
Nombre de pages11
journalJournal on Multimodal User Interfaces
Volume3
Numéro de publication3
Les DOIs
Etat de la publicationPublié - 11 févr. 2010
Modification externeOui

mots-clés

  • Markup languages
  • Multimodal interfaces
  • Multimodal modelling
  • Human-machine interaction

Empreinte digitale

Examiner les sujets de recherche de « Description languages for multimodal interaction: A set of guidelines and its illustration with SMUIML ». Ensemble, ils forment une empreinte digitale unique.

Contient cette citation