Joseph Mccartin
Technical Lead - Data Platforms
London, England, United Kingdom
Summary
👤
Senior🎓
Top SchoolJoseph Mccartin is a Technical Lead in Data Platforms with 11 years' experience building production-grade big data and ML systems, currently leading platform work at Our Future Health UK. He specialises in Python and Spark across Hadoop ecosystems, with strong competencies in Scala, Docker, CI/CD (Jenkins), and Git workflows, and a track record of productionising NLP and recommendation pipelines on Kubernetes. Previously he led data engineering and Terraform-backed orchestration and data lake projects at Culture Trip, and has driven Spark migrations and ETL frameworks for enterprises including Vodafone and Quantexa. His background as a PhD in particle physics (CMS at CERN) underpins deep expertise in large-scale distributed computation, multivariate analysis, and reproducible research workflows. Practical mentoring, hiring experience and a habit of turning research-grade code into robust microservices make him as comfortable managing teams as shipping resilient data platforms.
11 years of coding experience
5 years of employment as a software developer
Bachelor of Science (B.Sc.), Physics, Bachelor of Science (B.Sc.), Physics at University of CanterburyDoctor of Philosophy (PhD), Elementary Particle Physics, Doctor of Philosophy (PhD), Elementary Particle Physics at Ghent University
English, Russian
Stackoverflow
1reputation
0reached
0answers
0questions
Github Skills (43)
observation10
apache-airflow10
dagster10
data-pipelines10
data-collection10
python10
operation10
data-science10
airbyte10
data-engineering10
machine-learning10
hexagonal-architecture10
workflow-engine10
metadata10
apache10
Programming languages (2)
Github contributions (5)
jmccartin/twitter_saver
Dec 2018 - Jul 2019
Collects threads from a user's twitter page and saves them to a database, or publishes them to a latex file.
Contributions:1 release, 32 commits, 18 PRs in 6 months
databaselatextwitter
jmccartin/AirflowSpark
Sep 2019 - Apr 2020
Demonstration project for Apache Airflow/Spark integration
Contributions:9 commits, 4 PRs, 10 pushes in 6 months
airflowapache-airflowspark
Find and Hire Top DevelopersWe’ve analyzed the programming source code of over 60 million software developers on GitHub and scored them by 50,000 skills. Sign-up on Prog,AI to search for software developers.