Yifan Peng
Senior Research Scientist at NVIDIA
California, United States
Summary
🤩
Rockstar🎓
Top SchoolYifan Peng is a research scientist based in California with nine years of experience focused on multimodal large language models and speech AI. Currently at NVIDIA, he builds multimodal LLMs and full‑duplex speech-to-speech systems, drawing on a PhD in Electrical and Computer Engineering from Carnegie Mellon where he also taught speech recognition courses. His internships at Meta and ASAPP and a prior NVIDIA research internship reflect a consistent track record in voice-preserving translation, speech model compression, and speech-language modeling. Known for combining rigorous academic training (4.0 GPA at CMU, top-ranked undergraduate at Tsinghua) with applied research, he bridges cutting-edge model research and deployable speech systems.
9 years of coding experience
5 years of employment as a software developer
Bachelor of Engineering - BE Electronic Information Science and Technology, Bachelor of Engineering - BE Electronic Information Science and Technology at Tsinghua UniversityDoctor of Philosophy - PhD Electrical and Computer Engineering, Doctor of Philosophy - PhD Electrical and Computer Engineering at Carnegie Mellon University
Chinese, English
Github Skills (63)
speaker-diarization10
pytorch10
machine-translation10
speech-processing10
chainer10
speech-enhancement10
text-to-speech10
speech-synthesis10
voice-conversion10
multimodal10
large-language-models10
automatic-speech-recognition10
kaldi10
deep-learning10
speech10
Programming languages (4)
Github contributions (5)
pyf98/DPHuBERT
May 2023 - Mar 2025
INTERSPEECH 2023: "DPHuBERT: Joint Distillation and Pruning of Self-Supervised Speech Models"
Contributions:1 review, 4 PRs, 29 pushes in 1 year 9 months
speech
pyf98/pyf98.github.io
Jul 2022 - Sep 2024
Personal webpage
Contributions:132 pushes, 6 branches in 2 years 2 months
reactpersonal-webpagewebpage
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.