DiffusionGemma: 4x faster text generation

Google DeepMind released DiffusionGemma, an experimental open-weights model that writes text through a diffusion process instead of one word at a time, running up to 4x faster than standard models on GPUs. The model is a 26B Mixture of Experts design that activates only about 3.8B parameters per step and generates 256 tokens in parallel. It reaches more than 1,000 tokens per second on a single NVIDIA H100 and ships free to use under the Apache 2.0 license.