Yang Jie
Senior Development Engineer at Baidu Inc.
Beijing, China
Summary
🤩
Rockstar🎓
Top SchoolYang Jie is a Senior Development Engineer based in Beijing with 11 years' experience architecting high-throughput ad platforms at Baidu, where he leads the demand-side platform and ad exchange for the Union division. He combines deep backend engineering with systems-level optimization, having refactored core Java components of Apache Spark to improve performance and maintainability. As an Apache Spark Committer & PMC and Apache uniffle PPMC member, he contributes to one of the most widely used big-data engines, focusing on critical areas like ExternalSorter, BloomFilter, and deprecated-API migrations. His academic background (MEng, Xi'an Jiaotong University) underpins a methodical approach to scalable data processing and algorithmic efficiency. Colleagues know him for bridging production needs and open-source stewardship—delivering pragmatic, low-level improvements that yield measurable system gains.
12 years of coding experience
学士, 计算机科学与技术, 学士, 计算机科学与技术 at 青岛科技大学工学硕士, Computer Science, 工学硕士, Computer Science at Xi'an Jiaotong University
Chinese, Chinese, Japanese
Github Skills (10)
javas10
apache-spark10
refactoring10
performance-optimization10
java10
refactor10
data-processing10
data-storage9
data-structures8
data-structure8
Programming languages (11)
Github contributions (5)
apache/spark
Jun 2020 - Jan 2023
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:
Back-end Developer
Back-end DeveloperContributions:4766 reviews, 116 commits, 1986 PRs in 2 years 7 months
Contributions summary:Yang primarily focused on refactoring and enhancing the Java-based core of the Apache Spark data processing engine. Their contributions involved moving and refactoring core methods within the data processing and storage components, specifically improving the efficiency of the `Row#getSeq` method and optimizing code related to the `ExternalSorter`, and `BloomFilter`. Additionally, the user addressed deprecated APIs by replacing them with modern counterparts, enhancing the code's maintainability.
apache-sparkpythonscalarjava
LuciferYang/OAP
Jul 2017 - Dec 2021
Optimized Analytics Package for Spark Platform
Contributions:457 pushes, 199 branches in 4 years 5 months
analyticsoptimizedspark
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.