Ryan Johnson
Sr. Staff Engineer at LogicBlox
United States
Summary
🤩
RockstarRyan Johnson is a Sr. Staff Engineer with five years of hands-on experience building and hardening large-scale data processing systems across Databricks, AWS, and earlier research at LogicBlox. He focuses on backend engineering for distributed analytics, contributing notable fixes and refinements to Apache Spark and Delta Lake—improving task execution, metadata handling, and DataFrame compatibility. At Databricks and AWS he’s driven changes that reduce runtime overhead and clarify core state management, demonstrating an engineer who balances performance tuning with maintainability. Ryan’s open-source work on two flagship projects for the data ecosystem shows a pragmatic, systems-first approach to solving failure scenarios and streamlining tests for reliability at scale.
5 years of coding experience
Github Skills (14)
dataframes10
unit-testing10
javas10
big-data10
spark10
delta-lake10
java10
data-processing10
dataframe10
scala10
datasets9
sql9
analytics8
acid7
Programming languages (6)
Github contributions (5)
delta-io/delta
Oct 2021 - Dec 2022
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Role in this project:
Backend Developer
Backend DeveloperContributions:290 reviews, 27 commits, 17 PRs in 1 year 2 months
Contributions summary:Ryan's commits primarily focused on enhancing the Delta Lake storage framework, specifically in relation to its integration with Spark. They updated the `StateCache` helper class to improve DataFrame compatibility and reduce runtime overhead. The user also refactored the `Snapshot` class, splitting the `state` method into `stateDS` and `stateDF` for enhanced clarity and performance. Furthermore, the user modified multiple unit tests to align with the Delta specification and streamline testing processes.
prestodbsparktrinobig-dataanalytics
apache/spark
Aug 2022 - Jan 2024
Apache Spark - A unified analytics engine for large-scale data processing
Role in this project:Back-end Developer
Back-end DeveloperContributions:67 reviews, 10 PRs, 79 comments in 1 year 5 months
Contributions summary:Ryan primarily focused on improving the Spark task execution and metadata handling within the Apache Spark project. Their commits demonstrate a deep understanding of task listeners, addressing failure scenarios and ensuring proper cleanup. They also contributed to file metadata handling, specifically enabling custom metadata fields for file formats and fixing metadata column name conflicts. This work reflects a focus on improving the core functionality and data processing capabilities of Spark.
apache-sparkpythonscalarjava
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.