Man controls NES Super Mario Bros with Kinect

By Tom Warren, on 29th Nov 10 7:00 pm with Comments Off

Remember the guy that showed off a real-time light saber Kinect hack? Well he’s back controlling an NES version of Super Mario with Kinect.

YouTube user, Yankeyan, has posted another proof of concept video showing him jumping and running whilst controlling Super Mario. In a description posted with the video, Yankeyan describes his decision to create the hack:

“I programmed it to recognize my motions and passed the virtual button presses to the NES emulator. I could have placed a simulated keypad right in front of me that I can press with my hands, but I thought full body gestures were more in the spirit of Kinect. Of course, Mario isn’t designed to be played like this, so this is really really hard.”

Microsoft said earlier this month that it left the USB connection on the Kinect open, “by design.” Kinect “hackers” have recently taken the device to new heights. Videos emerged of device owners fully controlling Windows 7 and interactive prototype puppets. Kinect hacking is only at the very early stages but what’s clear is hackers are demonstrating the potential of the technology for use on PCs. Microsoft recently purchased 3D gesture experts Canesta. Microsoft’s investment in this technology is likely to see them focus heavily on bringing gesture based control to Windows 8. Earlier this year a number of Windows 8 product slides leaked from a HP employee that pointed towards some new product features. Kinect integration, a Windows App Store and fast boot were all promised. Microsoft previously purchased 3DV systems, who also make gesture recognition technology. With the push for this technology in gaming, it’s only natural that Microsoft would also want to port this to Windows.