Sensing Gesture Controller Gaming



I am attempting to build an entirely new and unique way to interact with computers and gaming. My current goal is to build and program a three dimensional control interface designed for computers and gaming. It senses the location of a hand over its face and outputs a signal proportional to position for each axis: x (left and right), y (up and down), and z (in and out). So, you can control three things at one time, like turning three knobs all at once by moving your hand through the air. The possibilities are truly infinite.

Simply press the large illuminated switch to start recording and release it to stop. The playback can be one-shot or looping. Playback can be retriggered with swipe gestures or by external signals from a module with trigger outputs. When pressed quickly, it freezes the hand position to lock in the output. Playback can be sped up or slowed by using circular gestures, clockwise for faster, counter-clockwise for slower. Recording can also be triggered externally. One pulse starts the recording and the next pulse ends it. Using external triggers to start and stop recording as well as to synchronize the playback, you can make perfectly synchronized loops.

To provide feedback, it has LEDs ringing its active sensing area. These LEDs light up according to the location of your hand. It lights red for the z axis and blue for the x and y axis. As you get closer to the surface, the red LEDs get brighter. As you move closer to a location on the x-y axis, the blue LEDs in that region get brighter and those farther away get dimmer. This makes it visually stunning, brilliant for live play and, excellent for dark spaces.

It can also recognize a number of simple gestures. It recognizes swiping gestures as well as circular motions over its surface. These gestures can be used as trigger outputs and for interacting with the built-in looping feature. It provides a menu system that uses gestures to change the system behavior.

It will be entirely open source. All aspects of the design, including hardware design files and software source code, will be released under cc-nc-sa 2.0 license. There will be a USB connector on the back of the device. This will allow anyone to program and reprogram it to suit their purposes. Want to use it to fly drones? Make a true virtual reality gaming experice? Go for it!

Design Story

We are all familiar with the vision of the future where we interact with computers by moving naturally in free space. Well, it has arrived. I knew that I wanted to explore the possibility of employing it to bring futuristic interaction to the gaming world. I began by envisioning a standalone device with a deep feature set, but decided to limit the scope of this design to the core functionality. This allowed me to focus on developing a device using this central technology.

How does it work?

It will work by generating an electrical field and sensing changes in it causes by the proximity of your hand. Think of it as a smartphone screen with an added dimension of depth four to five inches from the surface. The system uses six electrodes to form the active sensing area. The sensing electrodes are part of the circuit board which lays just behind the piece of acrylic.

Where Do the Pledges Go?

The pledges will support final development costs and prototyping, the purchase of components for the units, and the cost of manufacturing.