Baseten on Hugging Face Inference Providers 🔥
We're on a journey to advance and democratize artificial intelligence through open source and open science. Baseten joins our growing ecosystem, enhancing the breadth and capabilities of serverless inference directly on the Hub's model pages. Inference Providers are also seamlessly integrated into our client SDKs (for both JS and Python), making it super easy to use a wide variety of models with your preferred providers.
Key Takeaways
- Baseten is an AI infrastructure platform that covers serverless AI, training and more.
With a catalog of many frontier models, Baseten makes it easy for developers to integrate a wide range of AI capabilities into their applications with minimal setup.
- Follow Baseten on Hugging Face: https://huggingface.
How it works In the website UI In your user account settings, you are able to: Set your own API keys for the providers you've signed up with.
- Use a Hugging Face token to authenticate - the request will be routed to Baseten automatically.
From your favorite Agent Harness Hugging Face Inference Providers are integrated in most Agent Harnesses - including Pi, OpenCode, Hermes Agents, OpenClaw, and more.
- For instance, if you use a baseten API key you're billed on your baseten account.
when you authenticate via the Hugging Face Hub, you'll only pay the standard provider API rates.
- We also provide free inference with a small quota for our signed-in free users, but please upgrade to PRO if you can!
Stats & Key Facts
- #) Important Note ‼️ PRO users get $2 worth of Inference credits every month.
Baseten is an AI infrastructure platform that covers serverless AI, training and more. With a catalog of many frontier models, Baseten makes it easy for developers to integrate a wide range of AI capabilities into their applications with minimal setup. Baseten supports a broad spectrum of model types - from LLMs to text-to-speech and more.
As part of this initial integration, Baseten is launching support for conversational and text-generation tasks on Hugging Face, enabling access to popular open-weight LLMs such as Kimi K3 , latest DeepSeek V4 Flash , GLM-5. Support for additional tasks will roll out soon! See the full list of models supported by Baseten here .
This applies to the widget and code snippets in the model pages. 1) for Python and for JavaScript. The following examples show how to use the latest DeepSeek V4 Flash through Baseten.
For more details please read the original article at Hugging Face.
Continue Learning
Comments
Sign in to join the conversation