Daniel De Lima
Data Engineer
São Paulo, Brazil
Summary
👤
Senior🎓
Top SchoolDaniel De Lima is a Data Engineer based in São Paulo with a decade of experience and over seven years focused on data and BI, specializing in cloud-native pipelines and data modeling. He currently consults at Jobsity, leading GCP-based solutions using Airflow/Composer, DBT and BigQuery, and helped migrate pipelines from AWS to GCP achieving a 5x execution efficiency improvement. Comfortable across the data stack, he has built and optimized ETL and streaming systems with Airflow, Kafka, Spark, Hive and Python, and has practical SRE/DevOps experience automating observability and CI/CD. A former undergraduate researcher in wireless sensor networks, he brings an experimental mindset and curiosity—always trying something new—to solving data reliability and cost-efficiency challenges.
10 years of coding experience
4 years of employment as a software developer
Bachelor's Degree in Engineering, Electrical Engineering - Emphasis on Computing, Bachelor's Degree in Engineering, Electrical Engineering - Emphasis on Computing at Polytechnic School of the University of São PauloColégio ETAPA
Portuguese, English
Stackoverflow
732reputation
57kreached
14answers
0questions
Github Skills (43)
brightness9
hdmi9
hidpi9
retina9
scaling9
python9
automation9
edid9
virtual9
orchestration8
documentation8
etl8
apache8
machine-learning8
scheduler8
Programming languages (5)
Github contributions (5)
Lavedonio/instackup
Dec 2019 - Dec 2021
A package to ease interaction with cloud services, DB connections and commonly used functionalities in data analytics.
Contributions:11 releases, 4 PRs, 79 pushes in 2 years
data-analyticsanalyticscloud-servicesinteractiondatabase-access
Lavedonio/Medcel_Python_Scripts
Apr 2019 - Jun 2019
Contributions:55 commits, 41 pushes, 1 branch in 1 month
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.