In-camera special effects
Copy and paste 3D objects in live video.
The video shows another step towards our goal of allowing users to add special effects to video in the camera, as it is captured.
The technology allows the user to copy and paste objects within live video, in 3D. The development here is the fact that it can be achieved easily, using a single button interface, while the video is captured. The user performs the operation by clicking the button and dragging the on-screen cursor across the object to be copied.
The technology builds a 3D model of the object on the fly, and captures a set of textures out of the video. The model and textures can then be rendered back into the video in order to perform live editing operations, such as copy and paste.
The is just one application of the technology, however. It can be used more generally to enable Augmented Reality systems to interact with the real world. By addressing this key defficiency in current AR systems, the technology is a key step towards practical AR.
See • In-camera special effects - final version for the final version of this video, which has one extra test on the end.