This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs
Role in this project:
ML Engineer Contributions:3 reviews, 61 commits, 13 PRs in 6 months
Contributions summary:Prajwal primarily contributed to the training and inference code for a lip-sync generation model. Their work involved debugging and refining existing code in training scripts, fixing preprocessing steps, and adding inference options such as cropping and face box specifications. The user adjusted loss function weights and addressed issues related to audio indexing, showcasing a focus on model performance and practical usability.