Teradata to Greenplum DWH Migration

the outcome

As part of this initiative, our team migrated the existing CI/CD pipeline from TeamCity to Gitea and implemented an automated task creation mechanism in Jira to enhance workflow efficiency. We conducted an in-depth analysis of migration approaches for SSIS packages, ensuring a smooth transition. A key aspect of our work was the migration and optimization of ETL jobs from Teradata to Greenplum. We successfully migrated about 100 jobs, improving their performance and developing unit tests to ensure reliability. The entire process was meticulously documented for future reference. Additionally, we developed a structured approach for OLAP cube processing and oversaw its implementation to maintain consistency and efficiency.
As a result, the company managed to cut the estimated migration time in half, significantly reduce licensing costs, and accelerate employee adoption of the new DWH. By optimizing job performance and integrating Soda-based unit testing, we enhanced processing speed and established early error detection mechanisms, ensuring greater system stability and efficiency.