Video Inpainting Software Promises More Realistic Look On Computer-Generated Moving Objects
Did you still remember Gollum? A wicked sneaky little hobbit who has lived for hundreds of years and appeared officially in Lord of the Rings II: The Two Towers? Well, who can forget him anyway? His appearance marks a new era in Hollywood blockbusters where effects artists start resorting to a new video editing technique called inpainting.
Until today, VFX artists do inpainting by removing and replacing the original object traditionally, which takes tons of time and many resources. To facilitate them, a team managed by Prof. Dr. Christian Theobalt has developed a video inpainting software.
With this software, effects artists do not have to go from frames to frames to calculate the necessary pixels to cover the original objects and replace them with the ones generated by computer. All of those time consuming chores can be done automatically using the brainchild of Prof. Theobalt. Check it out in action on the video below!
The idea comes from shift maps – a term used by image editing geeks to refer to relative shift of pixel in the output image taken from the input one. In video editing, this is done by taking a section of video in a particular moment and using it to cover the occluded moving object. Considering that, this video inpainting software can only work effectively if the video backgrounds is static.
Also, since it’s still under development, the results produced by automatic inpainting still come with visual noises. They are hardly apparent, though, especially if your eyes aren’t very sharped. While there are previous works with similar functionality, only Prof. Theobalt’s software works with high definition video, which is a great plus.