Most of us know that sound comes from vibrations. These vibrations create sound waves which move through mediums such as air and water before reaching our ears.But, can we recreate sound from video images? Abe Davis takes one step further to proof his method to these hidden properties. A software called "the motion microscope" finds the subtle motion of a video and amplifies them so that it become large enough for us to see. Thus, it can be used as touch sensor to monitor breath and pulse. The same concept can be applied to what we hear. The motion is used to capture the vibration of sound and turn everything that we see into microphone. Watch the video below:
Reference:
Abe Davis, Michael Rubinstein, Neal Wadhwa, Gautham Mysore, Fredo Durand,William T. Freeman "The Visual Microphone: Passive Recovery of Sound from Video", ACM Transactions on Graphics (Proc. SIGGRAPH, 2014, Volume 33, Number 4, Pages 79:1-79:10
No comments:
Post a Comment