Multimodal interfaces: A survey of principles, models and frameworks

Bruno Dumas, Denis Lalanne, Sharon Oviatt

Résultats de recherche: Contribution dans un livre/un catalogue/un rapport/dans les actes d'une conférenceChapitre

740 Téléchargements (Pure)

Résumé

Abstract. The grand challenge of multimodal interface creation is to build reliable processing systems able to analyze and understand multiple communication means in real-time. This opens a number of associated issues covered by this chapter, such as heterogeneous data types fusion, architectures for real-time processing, dialog management, machine learning for multimodal interaction, modeling languages, frameworks, etc. This chapter does not intend to cover exhaustively all the issues related to multimodal interfaces creation and some hot topics, such as error handling, have been left aside. The chapter starts with the features and advantages associated with multimodal interaction, with a focus on particular findings and guidelines, as well as cognitive foundations underlying multimodal interaction. The chapter then focuses on the driving theoretical principles, time-sensitive software architectures and multimodal fusion and fission issues. Modeling of multimodal interaction as well as tools allowing rapid creation of multimodal interfaces are then presented. The article concludes with an outline of the current state of multimodal interaction research in Switzerland, and also summarizes the major future challenges in the field.
langue originaleAnglais
titreHuman Machine Interaction
Sous-titreResearch Results of the MMI Program
rédacteurs en chefDenis Lalanne, Jürg Kohlas
EditeurLNCS - Springer-Verlag
Pages3-26
Nombre de pages24
Volume5440
ISBN (imprimé)3642004369
Les DOIs
Etat de la publicationPublié - 2009
Modification externeOui

Série de publications

NomLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5440 LNCS

Empreinte digitale Examiner les sujets de recherche de « Multimodal interfaces: A survey of principles, models and frameworks ». Ensemble, ils forment une empreinte digitale unique.

  • Contient cette citation

    Dumas, B., Lalanne, D., & Oviatt, S. (2009). Multimodal interfaces: A survey of principles, models and frameworks. Dans D. Lalanne, & J. Kohlas (eds.), Human Machine Interaction: Research Results of the MMI Program (Vol 5440, p. 3-26). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol 5440 LNCS). LNCS - Springer-Verlag. https://doi.org/10.1007/978-3-642-00437-7_1