Building a Migration Framework From
GCP to AWS

Building a framework to migrate existing workloads from GCP to AWS. Using a multi-region setup for latency to external services, whilst allowing flexibility and scalability for future growth.

Client: CrypPro
Website: cryppro.com
Industry: FinTech
Services: Migration

Opportunity

Cryppro is an innovative quantitative trading firm specialised in systematic trading & product innovation in the digital assets space.​ They have built proprietary infrastructure and developed their quantitative algorithms leveraging the market microstructure. ​

​Using low latency technology, they provide 24/7 liquidity on cryptocash & derivatives across multiple centralised exchanges (CeFi) and decentralised exchanges (DeFi).

CrypPro were running their infrastructure on the Google Cloud Platform (GCP), connecting to exchanges via the public internet. This was a workable solution for them, however, as most of their exchanges are hosted on AWS, the latency benefits of being in the same location were significant.

This, combined with cost concerns on the Google Cloud platform, meant that a move to AWS was on the cards. CrypPro approached AWS asking for a specialised partner who could assist with an introduction to the AWS platform and prepare some baseline infrastructure that the CrypPro team could expand upon to build up their services within the AWS cloud.

Future Expandability

The ability to quickly redeploy into other regions when expanding into new markets as well as quickly scaling up and down infrastructure, taking full advantage of AWS elasticity.

Latency Decreases

Creating a competitive advantage by locating AWS workloads in the same regions where the exchanges are taking place.

Reusable Components

Reducing developer frictions and overhead with best practice infrastructure deployment, the CrypPro team can spend their time focusing on their industry leading algorithm.

The ability to quickly redeploy into other regions when expanding into new markets as well as quickly scaling up and down infrastructure, taking full advantage of AWS elasticity.

Creating a competitive advantage by locating AWS workloads in the same regions where the exchanges are taking place.

Reducing developer frictions and overhead with best practice infrastructure deployment, the CrypPro team can spend their time focusing on their industry leading algorithm.

Solution

Firemind developed the framework of a solution using Terraform to interact with AWS, creating reusable components to be deployed at scale across multiple regions.

We implemented many of the AWS account baseline setups as well as the AWS Single Sign on as a managed service for CrypPro. This enabled streamlined identity management for all future add-ons.

Initially a network stack was created, this was configured to allow peer-to-peer connections between regions, as opposed to centralising in one region and transiting (as is common in many other setups). This was primarily to reduce round trip latencies when traversing regional boundaries of AWS.

In addition to setting up core infrastructure on Amazon EC2 using Amazon Linux 2 AMI’s, AWS managed services were also utilised, such as Amazon S3 for long-term cold storage, as well as AWS Secrets Manager for secure credential storage, all authenticated by the AWS IAM service.

Firemind tested connectivity between instances and also defined security boundaries between instances that did not previously exist in the GCP setup, allowing a move towards the principle of least privilege.

Access to Amazon EC2 was configured using AWS Systems Manager session manager, which when coupled to AWS Single Sign on, allows fine-grained access controls to EC2 instances, as well as clear audit trails.

To finalise this project, we provided general cloud consultancy and advice on rightsizing instances, as well as potentially considering moves to AWS Graviton2.

Outcome

Once the solution was completed, runbooks and short introductory sessions were carried out to allow the CrypPro team to gain a full understanding of the solution as it stood.

We crafted detailed and thorough documentation on how to carry out common maintenance tasks on both the AWS stack and with Terraform itself. This will lead to a successful migration, away from GCP, reducing data and cloud costs significantly.

AWS

Being AWS Partners, we leverage AWS services for everything from hosting your cloud environment to storing, computing and transforming your data.

Here are some of the AWS services that allowed us to deliver on this project.

AWS Lambda
Amazon API Gateway
Amazon S3

Start your journey with us today