Case Study - Migration from ECS to EKS

About Keboola

Keboola provides a single data stack for customers to integrate multiple data sources onto one easy-to-use platform. It provides GDPR-compliant services for banks and auditors and bundles a Snowflake data repository for advanced modeling and activation.

Challenge

Keboola launched in 2011 and ran its systems on Amazon ECS. In late 2020, it decided to shift to Amazon EKS to better support both multi-cloud setups and customers that wanted to run systems on their own hardware. Keboola needed a platform that would work across major cloud providers while aligning with its philosophy of buying rather than building things that are not core to its business.

Migration

Keboola turned to pipetail for expertise in shifting workloads from Amazon ECS to Amazon EKS without adding management overhead. We worked in step, making iterative changes every week rather than attempting to migrate all at once. The teams held regular workshops and design meetings as the project evolved.

Everything was managed by Terraform from the start, making deployment fully automated and reproducible.

Results

The move to Kubernetes resulted in dramatically faster customer integration and significant cost savings. Previously, Keboola was using a stable pool of EC2 instances that were over-provisioned during quiet periods. With autoscaling on EKS, compute and data processing costs dropped by 40%.