Sign In

Communications of the ACM

ACM TechNews

Reach in and Touch Objects in Videos With 'interactive Dynamic Video'

View as: Print Mobile App Share:
Researchers analyzed video clips to find "vibration modes" at different frequencies that represent distinct ways an object can move.

Researchers in the Computer Science and Artificial Intelligence Lab at the Massachusetts Institute of Technology have developed an imaging technique that lets you reach in and touch objects in videos.

Credit: Abe Davis/MIT CSAIL

Researchers at the Massachusetts Institute of Technology's Computer Science and Artificial Intelligence Laboratory (CSAIL) have developed Interactive Dynamic Video (IDV), an imaging method that can simulate the tactile sensation of objects in videos using cameras and algorithms.

"This technique lets us capture the physical behavior of objects, which gives us a way to play with them in virtual space," says CSAIL postdoctoral student Abe Davis. "By making videos interactive, we can predict how objects will respond to unknown forces and explore new ways to engage with videos."

The team simulated objects by analyzing video clips to find "vibration modes" at distinct frequencies to represent the different ways an object can move, enabling predictions of how they will move in new situations.

"If you want to model how an object behaves and responds to different forces, we show that you can observe the object respond to existing forces and assume that it will respond in a consistent way to new ones," Davis notes.

The researchers say engineering and entertainment are two areas in which IDV could find potential use. For example, the technique could enable much faster rendering of virtual objects for movies. Davis says the simulation of a real-world structure's response to wind or seismic events is another possible use.

From MIT News
View Full Article


Abstracts Copyright © 2016 Information Inc., Bethesda, Maryland, USA


No entries found

Sign In for Full Access
» Forgot Password? » Create an ACM Web Account