Case Study
About Fermyon
Fermyon, a leader in AI inferencing, relies heavily on high-performance GPUs to drive the capabilities of its innovative products, including Fermyon Cloud and Spin. Their latest offering, Fermyon Serverless AI, is revolutionizing AI application development, leveraging the power of GPUs to minimize coding complexity and maximize performance.
At the heart of Fermyon's success is a commitment to high-performance computing, optimized resource utilization, and a strategic partnership with Civo, as highlighted in our case study video.
The Problem
Fermyon's AI inferencing offerings required robust and reliable GPU resources, particularly the high-performance NVIDIA A100, which was in high-demand and scarce in the market. The challenge was not just about finding these GPUs but securing them at a cost-effective rate while ensuring technical support that would allow Fermyon to optimize their use.
Fermyon's commitment to technological sustainability necessitated a provider whose values and practices aligned with this ethos, further narrowing their search for a suitable partner.
Objectives
Fermyon was in search of a cloud provider that could meet the following key objectives:
Access to High-Quality GPUs
Essential for their advanced AI inferencing, they needed a provider that could offer top-tier GPUs like the NVIDIA A100.
High Performance and Efficiency
To achieve the best possible performance for AI applications, maximizing efficiency was a priority.
Cost-Effectiveness
It was imperative to partner with a cloud provider that could offer competitive pricing without compromising on quality or performance.
Sustainable Computing Solutions
Aligned with their commitment to eco-friendly practices, they sought a provider offering sustainable technology solutions.
Accelerate Your Performance with Civo Cloud GPUs: Power Up in Seconds
Unlock the full potential of your machine learning or AI projects with Civo's Cloud GPU solutions.
How Civo helped
Civo's provision of NVIDIA A100 GPUs was the cornerstone of Fermyon's successful deployment of serverless AI applications. "The first thing that drew us to Civo, of course, is that you had the right kind of GPUs that we needed," stated Fermyon CEO Matt Butcher. This access to high-quality GPUs was crucial, given the market's scarcity and Fermyon's growing demands.
In addition to meeting hardware needs, Civo's Deep Green initiative deeply resonated with Fermyon's sustainability goals. The innovative approach of repurposing waste heat from GPUs for heating swimming pools was a testament to this alignment. Matt expressed his excitement about this synergy, remarking, "It was so cool... we're taking the waste out of one thing and using it in a way that's aligned with our sustainability objectives."
The partnership between Civo and Fermyon went beyond the mere provision of hardware. It encompassed a high level of ongoing support and collaboration, which was greatly valued by Fermyon. Matt and the Fermyon team appreciated the continuous dialogue with Civo's engineering team, stating, "We've had many conversations over time with engineers at Civo to make sure that we were using the GPU in the most effective way." This close communication was crucial in ensuring that Fermyon could optimize the use of GPUs for their specific needs. Matt further emphasized the significance of this support by referring to it as “top tier support," which illustrates the value Fermyon placed on the technical and customer support provided by Civo.
The operational benefits of Civo's platform, particularly the use of Civo's Terraform providers, were crucial in streamlining Fermyon's infrastructure deployment, saving considerable time and resources. Matt highlighted Civo's straightforward usability with the overwhelming options presented by other cloud providers like AWS or Azure, highlighting the efficiency and user-friendliness of Civo's services.
This ease of use and efficient tooling facilitated Fermyon's smooth transition first to traditional GPUs and then to the more sustainable, carbon-neutral Deep Green GPUs. This seamless shift not only met their immediate needs but also supported their growth and scalability in the competitive tech landscape.
Results
The partnership with Civo has significantly boosted Fermyon's AI inferencing capabilities, primarily through the access to high-performance NVIDIA A100 GPUs. This access has been a game-changer, enabling Fermyon to achieve greater efficiency and power in their serverless AI offerings.
In addition to the significant performance advancements, the adoption of Civo's Deep Green GPUs marked a major step forward in Fermyon's sustainability journey. This move dovetailed with their commitment to eco-friendly practices, enhancing their computing efficiency while contributing to an eco-conscious technology ecosystem.
Matt Butcher summed up the experience with Civo, reflecting on the ease and effectiveness of the partnership: "It's just worked for us, right? We've just been able to use things as they are... This is familiar. I'm comfortable with this." His words reinforce how Civo's solutions not only met Fermyon's immediate technical needs but also played a pivotal role in their growth trajectory and commitment to sustainable computing.
“The first thing that drew us to Civo, of course, is that you had the right kind of GPUs that we needed.”
Get in touch today
Speak to Civo's sales team and engineers who will help guide you on your Kubernetes journey.
Products and tools used
Fermyon utilized several Civo services to achieve their objectives:
Civo's Cloud GPUs
Deep Green GPUs
