Baseten

““Baseten helped us train models to be 23x faster and is projected to save us $1.9M—while making the process so easy that even non-ML engineers could get results in under 30 minutes.””

“Baseten let us productionize our models in days, not months.”

“Open-source models can give us the same quality as small closed-source models on certain use cases at about a third of the cost. But to actually run those workloads properly, we needed dedicated deployments with KV cache-aware routing — otherwise every turn in the conversation resets and you lose the whole benefit.”

“The reason why we came to Baseten in the first place was the latency requirements. With our bursty workloads, we got queued for our requests similar to any other user of AI. And our customers don't care about who's queuing you.”

“Working with Baseten has allowed us to focus less time on our serving and capacity needs and more on the quality of the output we’re getting from the models.”

“Baseten supports billions of custom, fine-tuned LLM calls per week from OpenEvidence, serving high-stakes medical information to healthcare providers in every major healthcare facility in the country. If you see a doctor today, chances are that they are leveraging OpenEvidence for up-to-date medical information.”

“Through the partnership with Baseten, we have the ability to serve different types of models, which means that my team can really focus on the ones that are the best fit.”

“When we set out to make our Laguna family of models available to the world, we knew the inference layer would make or break the developer experience at launch. Baseten exceeded our quality and performance bar. The speed from conversion to production-grade, white labeled API was unlike anything we had seen from an infrastructure partner.”

“Our customers really care about speed, reliability, and the ability to deploy custom fine-tuned models for financial services. Baseten met all three criteria so far and it’s been a boon to our business.”

“Our goal at Oxen has always been to get customers from raw datasets to production-ready models as fast as possible. But building and managing GPU infrastructure ourselves would have pulled us away from where we add the most value. Whenever I’ve seen a platform try to do both hardware and software, they usually fail at one of them. That’s why partnering with Baseten to handle infrastructure was the obvious choice. It lets us stay focused on delivering the best possible experience for our customers.”

“Training custom LoRAs has always been one of the most effective ways to leverage open-source models, but it often came with infrastructure headaches. With Oxen and Baseten, that complexity disappears. We can train and deploy models at massive scale without ever worrying about CUDA, which GPU to choose, or shutting down servers after training. It just works. The time saved in development and iteration is incredible.”

“Baseten was a delight to integrate with. We never have to worry about GPU capacity, and can give our customers reliable and fast fine-tuning.”

“We tested a lot of vendors. A lot of people say they are performant and multi-cloud, but when we asked for the TPM we needed, we were told we could only unlock it with massive upfront compute reservations. With Baseten, we serve the majority of our traffic on one provider, pay as we go, and have a team who we can co-engineer with as we scale and add new models and workloads.”

“Baseten stayed up when 3 different clouds went down, 2 of them being some of the largest providers of GPUs. That tells me everything I need to know about who to build on.”

“What I really care about is latency, reliability, and knowing that my account will not arbitrarily get blocked if we go over some rate limit. I need confidence we can scale without intervention.”

“"I want the best possible experience for our users, but also for our company. Baseten has hands down provided both. We really appreciate the level of commitment and support from your entire team."”

““We’re really appreciative of the support and just moving so quickly on this. The latency improvements have been so impressive, and on such a short timeline.””

““Our engineering team just wants to work with you guys. They told me really straightforwardly. And that goes a long way.””

““The ‘let’s get this thing going and then figure out the contract details later’ attitude is so much better than some of your competitors who wanted to tie us down first. We’re really impressed with the level of commitment and support from your engineers.””

“Inference for custom-built LLMs could be a major headache. Thanks to Baseten, we’re getting cost-effective high-performance model serving without any extra burden on our internal engineering teams. Instead, we get to focus our expertise on creating the best possible domain-specific LLMs for our customers. The improved performance means Writer customers can enjoy faster response times and higher token throughput when interacting with Palmyra models.”

“Inference for custom-built LLMs could be a major headache. Thanks to Baseten, we’re getting cost-effective high-performance model serving without any extra burden on our internal engineering teams. Instead, we get to focus our expertise on creating the best possible domain-specific LLMs for our customers.”

“We no longer have to reserve GPUs just in case we see usage spikes during viral moments. This scalability is critical as Flow gains wider adoption with its new team and enterprise offerings.”

“We no longer have to reserve GPUs just in case we see usage spikes during viral moments.”

“With Baseten, we gained a lot of control over our entire inference pipeline and worked with Baseten’s team to optimize each step.”

“With Baseten and AWS, we have providers that we trust, and more importantly, our users can trust.”