Mixing Real and Virtual Worlds is being explored by Microsoft’s Adaptive Systems and Interaction group. Microsoft’s LightSpace (pdf) creates “smart rooms” that use depth cameras and projectors to interact with people and the space they occupy.
The accompanying video shows the “lightspace” using an array of projectors and depth-sensing cameras to sense human forms. It lets users move two-dimensional digital objects among various surfaces in a room, explains Seattle’s TechFlash. It’s an extension of past work by the researchers in surface computing and natural user interfaces.