David Esteban
Senior Data & AI Engineer
Madrid, Community of Madrid, Spain
Summary
👤
Senior🎓
Top SchoolDavid Esteban is a Cloud Data Engineer with 8 years' experience designing and shipping resilient data platforms across AWS and Azure, currently preparing data for Veeva Link after leading HEMA's migration to a Databricks-based lakehouse. He combines hands-on Spark and Kafka engineering with infrastructure-as-code and CI/CD practices, having built ingestion systems with Lambda, ECS Fargate, Airflow and automated deployments using CDK and Azure Pipelines. David mentors teams, establishes code standards and reusable Spark packages, and has practical experience with Unity Catalog, Lake Formation and Redshift/Synapse migrations. His background spans on-prem to cloud migrations, MLOps prototyping and even UX-driven software design from earlier roles, reflecting a rare blend of data engineering, DevOps and product-oriented thinking. He contributes to open source and writes a technical blog to stay current and share lessons from production-scale data work.
9 years of coding experience
8 years of employment as a software developer
Charles III University of Madrid (Universidad Carlos III de Madrid)
English, Spanish
Stackoverflow
41reputation
5kreached
4answers
1question
Github Skills (54)
azure-data-factory10
powershell-module10
twitter9
microsoft-cognitive-services9
publish9
sentiment-analysis9
azure8
powershell8
databricks8
cicd8
spark-streaming8
speech8
flume8
devops8
cognitive-services7
Programming languages (6)
Github contributions (5)
dsu4rez/bigdata-realtime-twitter-analysis
Jun 2019 - Nov 2021
Personal project where I perform some analytics (including Sentiment Analysis) over a Twitter Stream using Big Data Technologies of the Hadoop echosystem such as Flume, Kafka, and Spark Streaming.
Contributions:1 review, 8 commits, 4 PRs in 2 years 5 months
big-dataflumehadoopkafkasentiment-analysis
dsu4rez/AR-bus-stop
Aug 2017 - Jan 2018
Contributions:9 commits, 12 pushes, 1 branch in 4 months
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.