A graphical editor for the SMUIML multimodal user interaction description language

Bruno Dumas, Beat Signer, Denis Lalanne

Research output: Contribution to journalArticle

23 Downloads (Pure)

Abstract

We present the results of an investigation on software support for the SMUIML multimodal user interaction description language (UIDL). In particular, we introduce a graphical UIDL editor for the creation of SMUIML scripts. The data management as well as the dialogue modelling in our graphical editor is based on the SMUIML language. Due to the event-centred nature of SMUIML, the multimodal dialogue modelling is represented by a state machine in the graphical SMUIML dialogue editor. Our editor further offers a real-time graphical debugging tool. Compared to existing multimodal dialogue editing solutions, the SMUIML graphical editor offers synchronised dual editing in graphical and textual forms as well as a number of operators for the temporal combination of modalities. The presented graphical editor represents the third component of a triad of tools for the development of multimodal user interfaces, consisting of an XML-based modelling language, a framework for the authoring of multimodal interfaces and a graphical editor. ?? 2013 Elsevier B.V. All rights reserved.
Original languageEnglish
JournalScience of Computer Programming
Volume86
Early online date24 Apr 2013
DOIs
Publication statusPublished - 15 Jun 2014
Externally publishedYes

Fingerprint

XML
Information management
User interfaces
Modeling languages

Keywords

  • Graphical editor
  • HephaisTK
  • Multimodal interaction
  • SMUIML
  • UIDL

Cite this

@article{a08e208b38f1438bae40909a36c5d735,
title = "A graphical editor for the SMUIML multimodal user interaction description language",
abstract = "We present the results of an investigation on software support for the SMUIML multimodal user interaction description language (UIDL). In particular, we introduce a graphical UIDL editor for the creation of SMUIML scripts. The data management as well as the dialogue modelling in our graphical editor is based on the SMUIML language. Due to the event-centred nature of SMUIML, the multimodal dialogue modelling is represented by a state machine in the graphical SMUIML dialogue editor. Our editor further offers a real-time graphical debugging tool. Compared to existing multimodal dialogue editing solutions, the SMUIML graphical editor offers synchronised dual editing in graphical and textual forms as well as a number of operators for the temporal combination of modalities. The presented graphical editor represents the third component of a triad of tools for the development of multimodal user interfaces, consisting of an XML-based modelling language, a framework for the authoring of multimodal interfaces and a graphical editor. ?? 2013 Elsevier B.V. All rights reserved.",
keywords = "Graphical editor, HephaisTK, Multimodal interaction, SMUIML, UIDL, Multimodal interaction, UIDL, Graphical editor, SMUIML, HephaisTK",
author = "Bruno Dumas and Beat Signer and Denis Lalanne",
year = "2014",
month = "6",
day = "15",
doi = "10.1016/j.scico.2013.04.003",
language = "English",
volume = "86",
journal = "Science of Computer Programming",
issn = "0167-6423",
publisher = "Elsevier",

}

A graphical editor for the SMUIML multimodal user interaction description language. / Dumas, Bruno; Signer, Beat; Lalanne, Denis.

In: Science of Computer Programming, Vol. 86, 15.06.2014.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A graphical editor for the SMUIML multimodal user interaction description language

AU - Dumas, Bruno

AU - Signer, Beat

AU - Lalanne, Denis

PY - 2014/6/15

Y1 - 2014/6/15

N2 - We present the results of an investigation on software support for the SMUIML multimodal user interaction description language (UIDL). In particular, we introduce a graphical UIDL editor for the creation of SMUIML scripts. The data management as well as the dialogue modelling in our graphical editor is based on the SMUIML language. Due to the event-centred nature of SMUIML, the multimodal dialogue modelling is represented by a state machine in the graphical SMUIML dialogue editor. Our editor further offers a real-time graphical debugging tool. Compared to existing multimodal dialogue editing solutions, the SMUIML graphical editor offers synchronised dual editing in graphical and textual forms as well as a number of operators for the temporal combination of modalities. The presented graphical editor represents the third component of a triad of tools for the development of multimodal user interfaces, consisting of an XML-based modelling language, a framework for the authoring of multimodal interfaces and a graphical editor. ?? 2013 Elsevier B.V. All rights reserved.

AB - We present the results of an investigation on software support for the SMUIML multimodal user interaction description language (UIDL). In particular, we introduce a graphical UIDL editor for the creation of SMUIML scripts. The data management as well as the dialogue modelling in our graphical editor is based on the SMUIML language. Due to the event-centred nature of SMUIML, the multimodal dialogue modelling is represented by a state machine in the graphical SMUIML dialogue editor. Our editor further offers a real-time graphical debugging tool. Compared to existing multimodal dialogue editing solutions, the SMUIML graphical editor offers synchronised dual editing in graphical and textual forms as well as a number of operators for the temporal combination of modalities. The presented graphical editor represents the third component of a triad of tools for the development of multimodal user interfaces, consisting of an XML-based modelling language, a framework for the authoring of multimodal interfaces and a graphical editor. ?? 2013 Elsevier B.V. All rights reserved.

KW - Graphical editor

KW - HephaisTK

KW - Multimodal interaction

KW - SMUIML

KW - UIDL

KW - Multimodal interaction

KW - UIDL

KW - Graphical editor

KW - SMUIML

KW - HephaisTK

U2 - 10.1016/j.scico.2013.04.003

DO - 10.1016/j.scico.2013.04.003

M3 - Article

VL - 86

JO - Science of Computer Programming

JF - Science of Computer Programming

SN - 0167-6423

ER -