Databricks' former AI chief thinks he can cut AI's power bill by 1,000x
Un0 is an image-generation system tool that shows for the first time how the company's technology can replicate conventional AI systems. The drive to discover the next big thing in AI has funded some pretty ambitious projects - but one company is taking it as a chance to rebuild computing architecture from the ground up. Led by Naveen Rao, formerly the head of AI at Databricks, Unconventional AI promises to make inference processing vastly more power efficient.
Key Takeaways
- The secret weapon: a new kind of oscillator-based computer architecture.
On Thursday, the company released its first model AI - called Un0 - an image-generation system tool that shows for the first time how the company's technology can replicate conventional AI systems.
- " The output from the new Un-0 model is similar to that of image-generation models like Stable Diffusion or OpenAI's GPT Image 1.
- From there, the plan is to build an entire inference stack from the ground up, with Unconventional AI eventually supplying compute capacity just like any other provider.
"We will build a new kind of system composed of our chips," says Rao.
- As Rao sees it, the available supply of power will be one of the hard limits for AI in the years to come - and Unconventional is one of the few projects able to address it.
- Join 1,000+ founders and VCs at all stages for real-world scaling insights and connections that move the needle.
Stats & Key Facts
- #"We will run AI models there, and we will have a network cable where prompts come in and inferences go out, but it'll be done at 1/1000 of power.
- #" It's a stunningly ambitious goal, particularly for a company that still counts less than 50 employees.
The secret weapon: a new kind of oscillator-based computer architecture. On Thursday, the company released its first model AI - called Un0 - an image-generation system tool that shows for the first time how the company's technology can replicate conventional AI systems. In an accompanying new paper, the company's research team details how they built a fully functional image generation model using a software simulation of the new architecture - one that performs just as well as state-of-the-art diffusion models.
"This is the 'hello world' of a new kind of computer," Rao told TechCrunch. "Over the next year, you're going to start seeing some pretty interesting news around this. " The output from the new Un-0 model is similar to that of image-generation models like Stable Diffusion or OpenAI's GPT Image 1.
The impressive part is how it arrives at that performance. The model is built on an oscillator-based architecture that is completely different from the chips that power conventional computing and traditional LLMs. The advantages of the oscillator-based computing are complex, but Rao believes it will ultimately reduce power use by as much as 1000 times.
For more details please read the original article at TechCrunch AI.
Why It Matters for Business
Real business deployments are the most reliable signal of where AI is generating measurable ROI. Watching which sectors operationalize AI, what they pay for it, and how it changes their P&L tells you more than any vendor demo. These case studies are what serious buyers and investors triangulate on.
Continue Learning
Comments
Sign in to join the conversation