Microsoft has revealed a prototype gaming system that turns any room into an interactive, augmented reality display.
Called RoomAlive it uses projectors and depth cameras to work out the dimensions of a room so any surface within it can be used as a display on which to show images.
The technology is similar to last year’s IllumiRoom, which used a Kinect sensor and projector to extend the gaming experience beyond the confines of the TV.
This time around, Room Alive doesn’t require a TV, and instead relies on the Kinect and a multi-projector system affixed to the ceiling.
Once implemented, gamers no longer sit on the couch and interact via controllers. A video demo (below) shows a whack-a-mole game whereby players hit their target with a plastic gun or by slapping it with their hands.
“It’s virtual reality that’s shared, and it’s adaptive to your environment, so if you throw a ball around, it should bounce on your table,” said Microsoft researcher Hrvoje Benko. The team is still working on sounds, but ideally, an item should sound different when bouncing off the carpet versus the floor, he said.
Room Alive uses multiple projector-camera units (procams) that include a depth camera, a wide-field-of-view projector, and a computer. Together, they can cover an entire room or focus on one corner.
“Users can touch, shoot, stomp, dodge and steer projected content that seamlessly co-exists with their existing physical environment,” Microsoft said.
Watch a demo video showing Room Alive here: