Yifan Zeng
Singapore, United States
Summary
👤
SeniorYifan Zeng is a Principal Big Data Developer with 8 years of experience building and operating large-scale data platforms across finance, academia, and enterprise technology. As a founding member of NTT DATA’s big data group he managed a 1000+ node Hadoop/Presto/Trino estate, delivered real-time and offline synchronization for 1000+ production tasks with 99.99% reliability, and cut storage costs by 40% through lifecycle and hot/cold separation. Skilled in Java, Spark, Flink, Kafka, and cloud-native tooling, he also designs data lineage, quality, and AI integration layers that turn raw telemetry into actionable business metrics. Comfortable both in hands-on engineering and technical mentorship, he combines rigorous operational discipline with a research-informed approach from his time at SUTD and NUS collaborations. Based in Singapore, he’s particularly adept at translating complex cross-system requirements into resilient, high-throughput pipelines that support ML and analytics at scale.
9 years of coding experience
Github Skills (56)
optimization8
database8
python8
mongodb8
reinforcement-learning8
recommender-system8
machine-learning8
databases8
java8
spark-streaming8
large-language-models8
parallel8
pytorch8
data-science8
redis7
Programming languages (6)
Github contributions (5)
Yifan122/RecommendSystem
Nov 2019 - Nov 2019
电影推荐系统
Contributions:22 commits, 20 pushes, 1 branch in 2 days
redispythondjangospark-sqlspark
Yifan122/filter_pruning
Jul 2017 - Feb 2019
Contributions:66 pushes, 1 branch in 1 year 7 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.