AR in unknown scenes is always going to be difficult without a remote expert to annotate the map. Here, we restrict ourselves to finding a dominant plane in the scene, and then running simple VR/AR games on this plane: essentially, you can have little AR critters running around on your tabletop. At present, no attempt is made to exploit the map to e.g. find occluding geometry; this is an area of future work. (From Georg Klein).
I love how it goes in and out of register, and how it ‘picks up’ the registration from an initial set of objects. People will end up intuiting that AR works in certain ways “not around trees” for instance, or only in “static scenes”.