Jae Hyeon Bae

Join Prog.AI to see contacts

Summary

👤

Senior

Jae Bae is a seasoned data engineer with 13 years building large-scale analytics and experimentation platforms for companies like Apple, Robinhood, Netflix, Uber, and Facebook. He has deep end-to-end expertise in data modeling, real-time and batch pipelines, storage engines (including pioneering Elasticsearch and Druid adoption), and orchestration with Spark, Flink, Kafka, and Airflow. As a technical lead he has driven AB-testing and assignment systems, rule engines, and metrics optimization, combining hands-on implementation with platform design. An active open-source contributor, he has improved Apache Druid’s S3 and credentials integrations and helped evolve Netflix’s Suro pipeline, underscoring a focus on reliable external service integration. Based in San Jose, he blends low-level systems experience (search engines and C++ early in his career) with modern cloud-native analytics to deliver resilient, production-grade data systems.

13 years of coding experience

Github Skills (21)

data-pipelines10

apache-druid10

apache-curator10

java10

javas10

aws10

amazon-s310

file-handling10

aws-s310

data-pipeline10

elasticsearch-curator10

s3-bucket10

elasticsearch8

file-processing8

elasticsearch-api8

Programming languages (3)

JavaScalaPython

Github contributions (5)

Netflix/suro

Apr 2013 - Apr 2015

Netflix's distributed Data Pipeline

Role in this project:

Back-end Developer

Contributions:278 commits, 35 PRs, 44 pushes in 1 year 11 months

Contributions summary:Jae's contributions focused on modifying and improving the `LocalFileSink` and `S3FileSink` classes, core components within the data pipeline. The primary changes involved refactoring code, switching from the `notify` method to the `notice` method to send messages to the queue. The updates also include changes to use `MessageWritable` to pass messages, improving durability, and modifications to the `ElasticSearchSink` class. The code also suggests improvements to the underlying data handling processes.

data-pipeline

apache/druid

Jan 2014 - Jul 2014

Apache Druid: a high performance real-time analytics database.

Role in this project:

Back-end Developer

Contributions:8 commits, 1 comment in 6 months

Contributions summary:Jae contributed to enhancements in the Apache Druid project, focusing on curator library updates and S3 extension improvements. Their work included upgrading curator versions and incorporating logging for service reinstatement processes. Furthermore, they developed and refactored code related to AWS credentials handling, introducing a file-based session credentials provider and adapting S3 service interactions. These changes demonstrate a focus on improving Druid's integration with external services and ensuring reliability.

apache-druiddatabasedruid

Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.

Request Free Trial