Calipso: Physics-based Image and Video Editing

Project Description

Calipso is an interactive method for editing images and videos in a physically-coherent manner. Our main idea is to realize physics-based manipulations by running a full physics simulation on proxy geometries given by non-rigidly aligned CAD models. Running these simulations allows us to apply new, unseen forces to move or deform selected objects, change physical parameters such as mass or elasticity, or even add entire new objects that interact with the rest of the underlying scene.

In Calipso, the user makes edits directly in 3D; these edits are processed by the simulation and then transfered to the target 2D content using shape-to-image correspondences in a photo-realistic rendering process.

Project Page: http://mimesis.inria.fr/calipso/
Paper: http://arxiv.org/abs/1708.03748

Project Details

  • Date 26 September 2017
  • Tags Augmented Reality
Back to Top