Nvidia open-sources cuFile API, accelerating GPU read/write capability for high-speed storage
As artificial intelligence applications become ever hungrier for faster access to data, Nvidia Corp. today announced it is open-sourcing the application programming interface for its powerful cuFile vertical data storage stack, enabling millisecond data access. The company also announced a large-scale industry initiative with technology leaders to optimize memory and storage with Storage-Next.
Key Takeaways
- SiliconANGLE UPDATED 11:00 EDT / AUGUST 04 2026 AI Nvidia open-sources cuFile API, accelerating GPU read/write capability for high-speed storage by Kyt Dotson As artificial intelligence applications become ever hungrier for faster access to data, Nvidia Corp.
The initiative aims to bring storage makers, controller vendors, thermal design, cooling, and orchestration providers together with standard bodies to find opportunities for superior graphics processing unit-driven storage.
- Prior to the launch, it acted as a core component of the company's GPUDirect Storage software .
It provides direct, high-speed data access between local distributed storage and GPU memory; this allows GPUs to bypass the central processing unit and system main memory, which greatly reduces memory access delays.
- This allows the synchronization of massive data sets at rates that can keep up with elite GPU speeds.
If the bandwidth to this data is delayed or pinched off by a bottleneck, it causes something called the "GPU starvation" loop, where some GPUs in a distributed array sit idle waiting for data to be ready.
- The company will build its grounded, high-speed data access for storage off SCADA, short for scaled, accelerated data access.
This solution provides the groundwork for massively parallel GPUs to pull data at high bandwidth and extremely low delay.
- " Nvidia said SCADA allows high-speed storage layers to operate securely.
SiliconANGLE UPDATED 11:00 EDT / AUGUST 04 2026 AI Nvidia open-sources cuFile API, accelerating GPU read/write capability for high-speed storage by Kyt Dotson As artificial intelligence applications become ever hungrier for faster access to data, Nvidia Corp. today announced it is open-sourcing the application programming interface for its powerful cuFile vertical data storage stack, enabling millisecond data access. The company also announced a large-scale industry initiative with technology leaders to optimize memory and storage with Storage-Next.
The initiative aims to bring storage makers, controller vendors, thermal design, cooling, and orchestration providers together with standard bodies to find opportunities for superior graphics processing unit-driven storage. During Nvidia's announcement at the Future of Memory and Storage conference, the company said the cuFile API enables secure access from storage in just milliseconds. CuFile was first officially launched into general availability in July 2021 alongside the company's GPU access CUDA Toolkit 11.
Prior to the launch, it acted as a core component of the company's GPUDirect Storage software . It provides direct, high-speed data access between local distributed storage and GPU memory; this allows GPUs to bypass the central processing unit and system main memory, which greatly reduces memory access delays. Using direct memory access, or DMA, it can move data directly from storage devices such as NVMe drives into GPU memory.
For more details please read the original article at SiliconANGLE AI.
Continue Learning
Comments
Sign in to join the conversation