Back to News Hub
☁️Google Cloud AI
July 31, 2026
Design

What's new in AI infrastructure and orchestration this month

Overview

At Google, AI is a soup-to-nuts endeavor. Obviously, we make leading AI models like Gemini and Nano Banana. We incorporate AI into the tools you use every day (think Gmail, BigQuery, AlloyDB, Google Cloud Code and Google Cloud Assist).

Key Takeaways

  • We make software frameworks to help you build with AI, like Gemini Enterprise Agent Platform, JAX, or MaxTest.

    And we co-design the powerful infrastructure platform that runs underneath it all, including a broad range of standard compute, accelerators like TPUs and GPUs, optimized networks and storage, as well as orchestration software like GKE and Cluster Director.

  • To support this, we are making AI infrastructure and orchestration news at a furious pace.

    In this blog, we provide a monthly snapshot of the recent launches and milestones that you need to know about to keep up-to-date, deep dives on architecture and performance tuning, and discussions of specialized use cases, always with pointers to where you can learn more.

  • C4N is our first network- and block-storage-optimized VM series built to eliminate data-transfer bottlenecks.

    Powered by 5th Gen Intel Xeon Scalable processors and built on Google's Titanium offloading hardware, it achieves 400 Gbps network bandwidth, 95 million packets per second (MPPS), and up to 25 GiB/s of block storage throughput when paired with Hyperdisk Extreme.

  • If you're running reinforcement learning (RL) workloads, you can now interleave independent RL jobs onto shared physical hardware, increasing aggregate accelerator duty cycles from a ~40% baseline up to 70% without impacting model convergence or accuracy.

    New AI security tool: Looking to secure your AI supply chain on GKE , deploy AI workloads safely, and cut down on shadow AI?

  • Whichever your preferred deployment path - via Model Garden, custom orchestration, or GKE with llm-d recipes - this guide offers detailed step-by-step instructions to help you evaluate and pilot Kimi K3 in Google Cloud.

Stats & Key Facts

  • #Powered by 5th Gen Intel Xeon Scalable processors and built on Google's Titanium offloading hardware, it achieves 400 Gbps network bandwidth, 95 million packets per second (MPPS), and up to 25 GiB/s of block storage throughput when paired with Hyperdisk Extreme.
  • #This capability enables standard GKE clusters to scale up to 15,000 nodes while maintaining full active Network Policy enforcement, supporting the massive infrastructure needs of large enterprise and AI/ML customers.
  • #If you're running reinforcement learning (RL) workloads, you can now interleave independent RL jobs onto shared physical hardware, increasing aggregate accelerator duty cycles from a ~40% baseline up to 70% without impacting model convergence or accuracy.

We make software frameworks to help you build with AI, like Gemini Enterprise Agent Platform, JAX, or MaxTest. And we co-design the powerful infrastructure platform that runs underneath it all, including a broad range of standard compute, accelerators like TPUs and GPUs, optimized networks and storage, as well as orchestration software like GKE and Cluster Director. Then we package them all up into supercomputing platforms like AI Hypercomputer to power the industry-wide transformation to the AI and agentic future.

This is critical in today's agentic era, where AI is evolving from answering questions to reasoning and taking action. Companies that want to lead in this next phase of AI need computing infrastructure that's designed and optimized for these new requirements, so they can innovate faster, deliver compelling user and customer experiences, and optimize for cost and energy efficiency - all at massive scale. To support this, we are making AI infrastructure and orchestration news at a furious pace.

In this blog, we provide a monthly snapshot of the recent launches and milestones that you need to know about to keep up-to-date, deep dives on architecture and performance tuning, and discussions of specialized use cases, always with pointers to where you can learn more. Keep an eye out for updates to this blog every month. July 2026 Product, technology, and tools updates Product update: Google Cloud Managed Lustre is now GA, and available in four distinct performance tiers that deliver throughput ranging from 125 MB/s, 250 MB/s, 500 MB/s, to 1000 MB/s per TiB of capacity - with the ability to scale up to 8 PB of storage capacity.

The Managed Lustre solution is powered by DDN's EXAScaler, combining DDN's decades of leadership in high-performance storage with Google Cloud's expertise in cloud infrastructure. Product update: C4N network and storage optimized VMs are now GA . C4N is our first network- and block-storage-optimized VM series built to eliminate data-transfer bottlenecks.

Powered by 5th Gen Intel Xeon Scalable processors and built on Google's Titanium offloading hardware, it achieves 400 Gbps network bandwidth, 95 million packets per second (MPPS), and up to 25 GiB/s of block storage throughput when paired with Hyperdisk Extreme. New feature: GKE Dataplane V2 up to 15K Nodes with Network Policies (GA) . This capability enables standard GKE clusters to scale up to 15,000 nodes while maintaining full active Network Policy enforcement, supporting the massive infrastructure needs of large enterprise and AI/ML customers.

New feature: Co-operative time-slicing in llm-d . If you're running reinforcement learning (RL) workloads, you can now interleave independent RL jobs onto shared physical hardware, increasing aggregate accelerator duty cycles from a ~40% baseline up to 70% without impacting model convergence or accuracy. New AI security tool: Looking to secure your AI supply chain on GKE , deploy AI workloads safely, and cut down on shadow AI?

We open-sourced k8s-aibom, a lightweight, unprivileged Kubernetes controller that continuously monitors container clusters to automatically detect running AI runtimes (like vLLM and Triton) and generate standard CycloneDX Machine Learning Bill of Materials (ML-BOMs). Check out the k8s-aibom project and get involved. Practitioner guides and how-tos How-to guide: On July 27, Google announced Day 0 support for Moonshot AI's Kimi K3 2.

For more details please read the original article at Google Cloud AI.

Continue Learning

Originally published by Google Cloud AI
Read the original

Comments

Sign in to join the conversation