Three insights you may have missed from theCUBE's coverage of RAISE Summit
Agentic inference is reshaping the center of gravity in AI infrastructure. What began as a race to scale training has shifted into a phase defined by expanding context windows, memory‑augmented reasoning and the need to keep graphics processing units continuously fed with data. As enterprises push deeper into agentic systems, storage has moved into the [...
Key Takeaways
- Agentic inference is reshaping AI infrastructure through specialized compute, storage-as-memory, new capital models and data sovereignty at RAISE Summit.
UPDATED 23:37 EDT / JULY 15 2026 AI Three insights you may have missed from theCUBE's coverage of RAISE Summit by Victoria Gayton Agentic inference is reshaping the center of gravity in AI infrastructure .
- Storage is actually a whole new storage tier that's being created to extend the memory for the system.
" Matson spoke with theCUBE at RAISE Summit , during an exclusive broadcast on theCUBE, SiliconANGLE Media's livestreaming studio.
- "They're looking at whole processes, not just one bespoke task.
That means you need different computing engines, and they need to work together at scale .
- "Our logarithmic math - it's completely under the hood," he told theCUBE.
"From a user point of view, from a [software development kit] point of view, you don't even notice it.
- It represents an early commercial-scale example of heterogeneous inference in production.
Agentic inference is reshaping AI infrastructure through specialized compute, storage-as-memory, new capital models and data sovereignty at RAISE Summit. UPDATED 23:37 EDT / JULY 15 2026 AI Three insights you may have missed from theCUBE's coverage of RAISE Summit by Victoria Gayton Agentic inference is reshaping the center of gravity in AI infrastructure . What began as a race to scale training has shifted into a phase defined by expanding context windows, memory‑augmented reasoning and the need to keep graphics processing units continuously fed with data.
As enterprises push deeper into agentic systems, storage has moved into the critical path of AI performance. Agentic inference is exposing new bottlenecks, accelerating the adoption of design patterns and pushing organizations to rethink how intelligence is staged, retrieved and delivered to GPUs, according to Greg Matson (pictured), senior vice president and head of marketing and products at Solidigm, a trademark of SK Hynix NAND Product Solutions Corp. "It started a couple of years ago with training, where the need for high-capacity, high-performance storage very adjacent to the GPUs was all of a sudden center stage," Matson told theCUBE.
"But now, as we go from last year to this year, inference phase into agentic inference, it's exploding even more. Storage is actually a whole new storage tier that's being created to extend the memory for the system. " Matson spoke with theCUBE at RAISE Summit , during an exclusive broadcast on theCUBE, SiliconANGLE Media's livestreaming studio.
For more details please read the original article at SiliconANGLE AI.
Continue Learning
Comments
Sign in to join the conversation