Wei Xu
Senior Data Engineer
Los Angeles, California, United States
Summary
👤
Senior🎓
Top SchoolWei Xu is a Senior Data Engineer with a decade of experience building large-scale data platforms and pipelines for high-throughput consumer services. Based in Los Angeles, he has driven lakehouse and warehouse migrations, real-time ingestion at million-QPS scale, and cost-optimized Spark/Dataflow transformations at companies including Tinder, Snap, and now Airbnb. Fluent in Python, Scala, Java and C++, Wei has delivered measurable improvements—90% cost savings on processing and 50% query runtime gains—while designing schema governance for hundreds of event types and GDPR-compliant data-cleaning pipelines. He pairs deep systems experience with a strong academic foundation (USC MS) and a background in distributed networking and recommendation systems, making him adept at bridging low-level engineering with business-facing analytics.
10 years of coding experience
9 years of employment as a software developer
Master's degree Computer Science, Master's degree Computer Science at University of Southern CaliforniaBachelor’s Degree Electrical Electronics and Communications Engineering, Bachelor’s Degree Electrical Electronics and Communications Engineering at Beijing University of Posts and Telecommunications
English, Chinese
Stackoverflow
21reputation
7kreached
1answer
1question
Github Skills (33)
conda9
slurm8
conda-forge8
dcop7
python7
shell7
pip6
distributed-systems6
ns36
multi-agent6
distributed-computing6
network-programming6
macos-sierra6
html5
javascript5
Programming languages (7)
Github contributions (5)
luptior/fast_downsample
Apr 2018 - Aug 2019
Contributions:19 commits, 16 pushes, 1 branch in 1 year 4 months
luptior/pyDcop
Jun 2019 - Apr 2020
Library for research on Distributed Constraints Optimization Problems
Contributions:9 commits, 2 PRs, 9 pushes in 10 months
gurobiproblemsoptimizationmultiobjective-optimizationconstraint-programming
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.