The use of vectors in making Interactive Dynamic Videos

journal

An Interactive Dynamic Video (IDV) is an imaging technique where you can “touch” and manipulate objects in a captured video recording [1]. They analyze the vibrations (or find what they call “vibration modes”) in the video in different frequencies to be able to predict how the object in the video would act/move in new situations (such as when poked or pushed). This technique involves acceleration, velocity, and displacement vectors (for modal analysis). [2]

As a result, the videos can now be manipulated and be used to apply special effects.

Sources:

[1] http://news.mit.edu/2016/touching-objects-in-videos-with-interactive-dynamic-video-0802
[2] http://interactivedynamicvideo.com/ISMB_Davis_2015.pdf

Link to their website: http://interactivedynamicvideo.com/ (they have videos where they explain and apply this technique to create different special effects + possible application in Pokémon GO)

Advertisements