Is the future of data centers portable? Runware builds a pod to find out
On Tuesday, AI infrastructure company Runware announced the launch of its own modular data center called Sonic Inference Pod. Designed as a single transportable unit, the Pod represents a more flexible kind of compute that can sit alongside hyperscalers' massive data center projects. Runware says the Pod can offer inference at a higher quality but lower cost than other serverless inference platforms and GPU clouds.
Key Takeaways
- The modular design means it's easy to add capacity quickly by creating new pods rather than having to expand a fixed data center.
In some ways, this is the future, Flaviu Radulescu, co-founder and CEO of Runware, told TechCrunch.
- "What we want is to power the world's intelligence, to be the backbone every AI model runs on with capacity that keeps up with demand instead of throttling it.
- OpenAI, for example, is close to striking a $500 billion deal that would see it build a data center in Ohio, according to reports .
But Radulescu doesn't see those projects as a threat to the Sonic Inference Pods, describing the flexibility of the pods as a key differentiator.
- "Every one of those calls needs someone who understands exactly what each component does and what breaks if it's gone.
" Building AI data centers is a controversial topic, however, especially because of how many resources it uses .
- More inference built this way means less new grid, less water, for the same amount of compute.
Stats & Key Facts
- #The company already provides inference to a few companies, including Higgsfield AI and Wix, and has 160 sites available to power its pods right now.
- #Runware announced a $50 million Series A in December to provide the infrastructure needed for companies to generate images.
- #OpenAI, for example, is close to striking a $500 billion deal that would see it build a data center in Ohio, according to reports .
On Tuesday, AI infrastructure company Runware announced the launch of its own modular data center called Sonic Inference Pod. On Tuesday, AI infrastructure company Runware announced the launch of its own modular data center called Sonic Inference Pod. Designed as a single transportable unit, the Pod represents a more flexible kind of compute that can sit alongside hyperscalers' massive data center projects.
Runware says the Pod can offer inference at a higher quality but lower cost than other serverless inference platforms and GPU clouds. The modular design means it's easy to add capacity quickly by creating new pods rather than having to expand a fixed data center. In some ways, this is the future, Flaviu Radulescu, co-founder and CEO of Runware, told TechCrunch.
"We believe distributed compute, positioned closer to end users for faster inference, is what will win in the long term," he said, noting his company as an example. Aside from a lower price, Radulescu noted that the Runware system can scale and add capacity fast, deploy anywhere there is power, and adapt quickly to new hardware releases. The Runware pods also do not use water, but rather a closed-loop cooling system that can be built in days, compared to the months or even years it takes to build traditional data centers.
For more details please read the original article at TechCrunch AI.
Continue Learning
Comments
Sign in to join the conversation