Designing Multimodal Mobile interaction for a Text Messaging application for Visually impaired Users

Carlos Duarte, Simon Desart, David Costa, Bruno Dumas

Research output: Contribution to journalArticle

11 Downloads (Pure)

Abstract

While mobile devices have experienced important accessibility advances in the past years, people with visual impairments still face important barriers, especially in specific contexts when both their hands are not free to hold the mobile device, like when walking outside. By resorting to a multimodal combination of body based gestures and voice, we aim to achieve full hands and vision free interaction with mobile devices. In this article, we describe this vision and present the design of a prototype, inspired by that vision, of a text messaging application. The article also presents a user study where the suitability of the proposed approach was assessed, and a performance comparison between our prototype and existing SMS applications was conducted. Study participants received positively the prototype, which also supported better performance in tasks that involved text editing.
Original languageEnglish
Article number26
Number of pages11
JournalFrontiers in ICT
Volume4
Issue numberDEC
DOIs
Publication statusPublished - 6 Dec 2017

Keywords

  • non-visual interaction
  • body-based interaction
  • gestures
  • voice
  • multimodal interaction
  • accessibility
  • Accessibility
  • Non-visual interaction
  • Gestures
  • Body-based interaction
  • Voice
  • Multimodal interaction

Fingerprint Dive into the research topics of 'Designing Multimodal Mobile interaction for a Text Messaging application for Visually impaired Users'. Together they form a unique fingerprint.

  • Cite this