Rebuilding a production data platform for scale and recovery
Data Engineer → Senior Data Engineer
A six-year platform story: faster processing, lower cost, safer change, and recovery designed before the incident.
50% faster core processingrole-level before/after wall-clock on the rebuilt Spark/Airflow path — not a lab sample · Data Engineer role, 2020–2024
40% lower infrastructure costrole-level before/after infrastructure run-rate on the Kubernetes migration — not a lab sample · Data Engineer role, 2020–2024
Python · SQL · Apache Spark · Apache Kafka · Apache Airflow · dbt