Rebuilding a production data platform for scale and recovery
Data Engineer → Senior Data Engineer
A six-year platform story: faster processing, lower cost, safer change, and recovery designed before the incident.
50% faster core processingbefore/after wall-clock runtime of the rebuilt core pipeline · 2020–2024 Data Engineer role
40% lower infrastructure costbefore/after infrastructure run-rate across the Kubernetes migration · 2020–2024 Data Engineer role
Python · SQL · Apache Spark · Apache Kafka · Apache Airflow · dbt