Snowflake Cloud Migration

Overview

Led the migration of dozens of terabytes of enterprise data from on-prem repositories to Snowflake cloud data warehouse, delivering hundreds of modernized data products for marketing, compliance, and analytics teams.

Challenge

Legacy on-prem data repositories were costly to maintain, slow to query, and couldn't support the modern analytics use cases that business teams needed. Marketing and compliance teams were constrained by outdated tooling and data access patterns.

Approach

Owned the Jira scrum board, backlog, and roadmap for systematic migration. Led a team of data engineers applying agile methodology to build data products in Snowflake with the objective of decommissioning on-prem repositories.

• Defined migration strategy for dozens of TB of enterprise data
• Built data products across Staging, Domain, DataMart, and Curated/Consumption layers
• Instituted data quality assurance using Splunk, Tosca, and anomaly detection
• Coordinated with governance teams to ensure architectural and data governance standards

Key Results

• Legacy on-prem repositories systematically decommissioned
• Modernized customer and compliance analytics capabilities
• Enhanced data reliability through quality assurance processes
• Reduced data product errors with proactive anomaly detection

Technical Details

The migration leveraged DBT for transformations, GitLab for version control and CI/CD, and Alation for data cataloging and governance. Data quality was maintained through Splunk monitoring and Tosca automated testing.