Deep Dubbing

The challenge

Dubbing movies/tv series from their original language to another language is awkward. Specifically, the problem I think my idea solves is the mismatch between the dubbing and the motion of the lips of the actors. My solution would be fixing a small detail, but I think it would be very attractive to people who are in the dubbing business.

The solution

My solution is to use the same technique used in this video (https://youtu.be/cQ54GDm1eL0) which is based on this recent deep learning paper (http://grail.cs.washington.edu/projects/AudioToObama/siggraph17_obama.pdf) to make dubbing seem more realistic.