Sign In

Communications of the ACM

ACM TechNews

System Recognizes Hand Gestures to Expand Computer Input on a Keyboard

View as: Print Mobile App Share:
A man controls his laptop with hand gestures.

The innovation aims to make the laptop user experience faster and smoother, with less need for keyboard shortcuts or working with a mouse and trackpad.

Credit: Getty Images

A new system developed by researchers at Canada's University of Waterloo responds to users' hand gestures as computer commands.

The "Typealike" system uses a standard laptop Webcam equipped with a mirror.

The system allows different gestures and combinations of gestures to be programmed to trigger various operations.

For example, the system could be programmed to increase the volume when it recognizes the user's right hand beside the keyboard with the thumb pointing up.

Typealike was trained using machine learning.

The program could eliminate the need for keyboard shortcuts and the use of a mouse and trackpad, as well as the need for hand-held controllers in virtual reality.

From University of Waterloo News (Canada)
View Full Article


Abstracts Copyright © 2022 SmithBucklin, Washington, DC, USA


No entries found