We provide a PyTorch implementation of the paper Voice Separation with an Unknown Number of Multiple Speakers In which, we present a new method for separating a mixed audio sequence, in which multiple voices speak simultaneously. The new method employs gated neural networks that are trained to separate the voices at multiple processing steps, while maintaining the speaker in each output channel fixed. A different model is trained for every number of possible speakers, and the model with the largest number of speakers is employed to select the actual number of speakers in a given sample. Our method greatly outperforms the current state of the art, which, as we show, is not competitive for more than two speakers.
Role in this project:
ML Engineer Contributions:1 review, 15 commits, 7 PRs in 11 months
Contributions summary:Yossi focused on data generation and model support within the speech separation project. They added scripts for generating datasets, including features for room simulation and noise addition. Furthermore, the user fixed issues related to argument parsing and audio loading, which improved the usability of the models. These modifications enhanced the development of the core model and its ability to process varied audio inputs.
audioneural-networkpytorch
Watermarking Deep Neural Networks (USENIX 2018)
Contributions:19 commits in 1 day
deep-neural-networks