Hybrid interfaces for multimodal interaction

7.8.5.1 Gesture interaction

Gesture interaction is a way for computers to interpret purposeful human motions, thereby creating a bridge between machines and humans that allows a richer interaction experience than the primitive input methods of keyboard and mouse. Using gesture recognition, operators can literally point a finger at the computer screen to interact directly with objects, without actually touching the screen. This technology is still in its infancy but several devices and applications are beginning to appear. Devices like the Xbox Kinect and the Leap Motion gesture controller are likely to become mainstream options very quickly. In the short term, this probably will not make conventional input devices such as mice, keyboards and even touch screens redundant, but will be added to the range of HSIs to allow operators more flexibility in interacting with plant systems. For an extensive discussion of gesture interaction, the reader is referred to the work of Bill Buxton, a Microsoft researcher (Buxton, 2011).