Ming-yuan Lu
Senior Data Scientist
New York, New York, United States
Summary
👤
Senior🎓
Top SchoolMing-yuan Lu is a Senior Data Scientist with nine years of experience building production-scale data pipelines and analytics platforms, currently at Enigma Labs after leading data engineering efforts at The Wall Street Journal. He holds a PhD in particle astrophysics from the University of Wisconsin–Madison and brings a researcher's rigor to engineering problems, having developed C++ simulation and interferometric analysis tools for cosmic neutrino experiments. At WSJ he built a Scala/Spark streaming pipeline ingesting 40M+ events/day and optimized Postgres performance up to 25x while provisioning infrastructure with Terraform on AWS. His technical breadth spans Python, Scala, C/C++, Spark, Kafka/Kinesis, Druid, TimescaleDB and observability tooling, enabling rapid, cost-effective delivery of near real-time insights for product and editorial stakeholders. Colleagues rely on him to translate complex analytical needs into robust data schemas and streaming architectures, blending academic-caliber statistical thinking with pragmatic cloud engineering. An under-the-radar strength is his ability to fuse experimental physics techniques with large-scale data systems to solve unusual signal-processing and data-quality challenges.
10 years of coding experience
11 years of employment as a software developer
Doctor of Philosophy (Ph.D.), Particle Astrophysics, Doctor of Philosophy (Ph.D.), Particle Astrophysics at University of Wisconsin-MadisonBachelor’s Degree, Physics, Bachelor’s Degree, Physics at National Taiwan University
English, Chinese, French, Chinese
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (4)
ara7
monte-carlo7
neutrino6
simulation6
Programming languages (2)
Github contributions (5)
mingyuanlu/ARA_reconstruction
Oct 2016 - Jun 2020
Contributions:2 releases, 261 commits, 2 PRs in 3 years 8 months
arareconstructionneutrino
mingyuanlu/bubble-breaker
Jun 2019 - Jul 2019
Contributions:118 commits, 3 PRs, 104 pushes in 29 days
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.