Voice and gesture development environment: keyboard free programming

Date

2017-08, 2017-082017-08

Authors

Bouse, Leana Morgan
Bouse, Leana Morgan

ORCID

Journal Title

Journal ISSN

Volume Title

Publisher

DOI

Abstract

Computer interaction is essential for computer science professionals. Traditional input devices, such as a keyboard and mouse, can be difficult obstacles for professionals with pre-existing manual impairments or may develop future manual impairments as a result of extensive computer use. To address the needs of these professionals, we developed the Voice and Gesture Development Environment (VGDE), allowing users to create Java programs through the use of voice and gesture, by using Microsoft Speech for speech recognition engine and the Leap Motion device and Application Program Interface (API) for gesture recognition. This software allows users to dictate Java code naturally through voice commands, as well as edit and navigate the user's code with voice and gestures. The purpose of the VGDE is to reduce the amount of keyboard and mouse usage while programming and interacting with a development environment.

Description

Keywords

gesture recognition, human-computer interaction, programming by voice, speech recognition

Sponsorship

Rights:

This material is made available for use in research, teaching, and private study, pursuant to U.S. Copyright law. The user assumes full responsibility for any use of the materials, including but not limited to, infringement of copyright and publication rights of reproduced materials. Any materials used should be fully credited with its source. All rights are reserved and retained regardless of current or future development or laws that may apply to fair use standards. Permission for publication of this material, in part or in full, must be secured with the author and/or publisher.

Citation