Data Lakehouse Migration
Migrated 200TB legacy warehouse to Databricks lakehouse architecture
DatabricksDelta LakedbtTerraformAWS
Led the migration of a 200TB legacy data warehouse to a modern lakehouse architecture on Databricks with Delta Lake.
The project involved rebuilding 150+ ETL pipelines, implementing data quality frameworks with Great Expectations, and establishing data governance with Unity Catalog.
Reduced query costs by 60% and improved data freshness from daily to hourly for critical business metrics.