Case Study
About TrueFoundry
TrueFoundry is at the forefront of simplifying Machine Learning (ML) and Generative AI application development, leveraging the power of high-performance GPUs to drive these innovations. Their service platform enables teams to build, experiment, and deploy ML models with the efficiency and capabilities often reserved for Big-Tech, with the added advantage of seamless GPU integration.
The problem
TrueFoundry faced the challenge of needing robust GPU resources to support the deployment of large language models (LLMs) and other intensive ML models for their inbound customers. High base costs and complex setups with other cloud providers not only hindered their ability to offer these essential GPU-powered services effectively but also posed financial unpredictability.
Sustainability and a focus on climate friendly solutions were also high on the priority list for the TrueFoundary team.
Objectives
TrueFoundry was in search of a cloud provider that could meet the following key objectives:
GPU Availability
Essential for supporting the deployment of large language models (LLMs) and other intensive ML models.
Scalable Kubernetes Infrastructure
A foundation for TrueFoundry and its add-ons to facilitate ML model deployment.
Cost-effective Scaling
An infrastructure that scales up or down based on usage without financial unpredictability.
Accelerate Your Performance with Civo Cloud GPUs: Power Up in Seconds
Unlock the full potential of your machine learning or AI projects with Civo's Cloud GPU solutions.
How Civo helped
Civo emerged as the cloud provider of choice for TrueFoundry, primarily due to its robust GPU offering. The integration of Civo's GPU-powered clusters into TrueFoundry's platform was pivotal, enabling quick and seamless deployment of large language models (LLMs) and intensive ML models. Chinmay Singh of TrueFoundry expressed, “We were impressed with how Civo's services integrated effortlessly into our platform. Their APIs are user-friendly and their infrastructure costs are a fraction of the hyperscalers, which is crucial for a startup scaling as rapidly as ours.”
“The dedication and expertise of Civo's support team have been standout. They've been instrumental in helping us navigate any challenges”
The support received from Civo was not just technical but also strategic, providing TrueFoundry with the foundation to explore larger collaborations. "Our interactions with Civo went beyond solving technical issues; they were about building a roadmap for our future growth together," shared Singh.
”Anuraag Gutgutia, overseeing customer success, highlighted the value of Civo's support, "The dedication and expertise of Civo's support team have been standout. They've been instrumental in helping us navigate any challenges, always with a focus on our long-term success.”
Results
The tangible outcomes of TrueFoundry's collaboration with Civo have been significant, particularly in terms of GPU performance. With Civo's GPU infrastructure, TrueFoundry successfully launched more than 120 clusters, demonstrating not only the scalability but also the reliability of Civo's GPU services.
Srihari Radhakrishna, Senior ML Engineer at TrueFoundary, shared some insights into the performance improvements, "With Civo, we've seen a marked enhancement in deployment speeds and efficiency. This has not only improved our service delivery but has also played a crucial role in client conversion and retention."
The adoption of Civo clusters for production workloads by TrueFoundry's clients further solidifies the trust in Civo's capabilities. "Our clients opting to continue with Civo for their production environments speaks volumes. It underscores the performance and stability of the Civo platform," added Gutgutia.
The partnership with Civo has proved such a success, that it has paved the way for TrueFoundry to consider more strategic ventures, including a potential project to build cutting-edge, robust Machine Learning infrastructure, at low cost, for generative AI and MLusers.
Get in touch today
Speak to Civo's sales team and engineers, who will help guide you on your journey.
Products and tools used
TrueFoundry's deployment strategy leveraged Civo's offerings to fulfill their unique requirements:
Cloud GPU Support
Kubernetes Clusters
Customer Support and Documentation
