Case studies

Data platforms, databases, and agentic systems built for production.

Case studies across data platforms, database lifecycle operations, system architecture, and agentic systems running in production.

  1. Data platforms Ingestion, processing and serving at terabyte scale
  2. Database lifecycle Replication, failover, backup and version upgrades
  3. Agentic systems Tools, evaluation and persistence inside a live stack
  4. System architecture Boundaries, contracts and recovery paths

Case studies

01Professional practice2020 – present

Rebuilding a production data platform for scale and recovery

Data Engineer → Senior Data Engineer

A six-year platform story: faster processing, lower cost, safer change, and recovery designed before the incident.

50% faster core processingbefore/after wall-clock runtime of the rebuilt core pipeline · 2020–2024 Data Engineer role

40% lower infrastructure costbefore/after infrastructure run-rate across the Kubernetes migration · 2020–2024 Data Engineer role

Python · SQL · Apache Spark · Apache Kafka · Apache Airflow · dbt

  • Data quality & contracts
  • Observability & SLOs
  • Iceberg & the lakehouse

02Professional practice2024 – present

Turning model output into product state you can audit

Senior Data Engineer

A governed analytics workflow with typed state, provenance, evaluation, review, and an honest fallback path.

60% faster analytics deliverybefore/after delivery time for recurring analytics requests · 2024–2026 Senior Data Engineer role

75% less analyst manual effortbefore/after manual effort per recurring analyst request · 2024–2026 Senior Data Engineer role

Python · Pydantic · LangGraph · LangChain · CrewAI · Google-ADK

  • AI agents in production
  • Data quality & contracts
  • RAG

03Independent product2024 – present

ClickHomes: an independent real-estate product

Founder and sole engineer — built outside my day job

A real-estate product I own end to end: PostgreSQL for truth, ClickHouse for speed, RESO as the only way in

90+ SQL migrationsversioned migration files in the repository

Python · FastAPI · PostgreSQL · ClickHouse · RESO · Next.js

  • PostgreSQL
  • Data quality & contracts
  • AI agents in production

04Measured lab2026

Multi-engine HA lab: eight failover scenarios

Personal lab

Six database engines, eight failover scenarios, one laptop — with the numbers

8 of 8 failover scenarios passedmy own test plan, executed on Docker with 8 CPU / 12.5 GB · 2026

383 µs replay lag measured on one hosta single pg_stat_replication reading with primary and hot standby on the same machine — loopback, no network, so it is a floor for the configuration rather than a latency anyone should expect across hosts

MongoDB · ScyllaDB · SolrCloud · MariaDB · Galera · Redis

  • Distributed databases
  • PostgreSQL
  • Observability & SLOs

05Measured lab2026

Orchestrated failover and a restore I actually performed

Personal lab

A production-shaped Postgres cluster on one laptop: killed the primary, rebuilt the replica, recovered a dropped table

10–20 s observed promotion window after SIGKILLSIGKILL of the Patroni leader, then patronictl polled every 10 s until the survivor showed as Leader — so 10 s is the measurement resolution, not the precision of the result · 2026

under 5 s replica rebuilt from backuppatronictl reinit, timed from the pgBackRest restore command begin to Patroni reporting the replica created · 2026

PostgreSQL · Patroni · etcd · pgBackRest · Ansible · Rocky Linux

  • PostgreSQL
  • Distributed databases
  • Self-hosted ops

06Measured lab2024 – 2026

A lakehouse, and the RAG pipeline that runs on it

Personal lab

The two halves of the thesis as one system: Trino and Iceberg underneath, retrieval and answers on top, both measured

88 ms one-month predicate over 1.5M Iceberg rowsmedian of 7 server-side runs from system.runtime.queries, after 2 warm-ups, on a month-partitioned Iceberg table · 2026

909,968 rows recovered by snapshot rollbackunqualified DELETE, then ALTER TABLE EXECUTE rollback_to_snapshot, counted against the pre-incident total · 2026

Trino · Apache Iceberg · Apache Polaris · StarRocks · Apache Spark · Delta Lake

  • Iceberg & the lakehouse
  • RAG
  • Distributed databases