BREAKING
NVIDIA Releases 'TwoTower' Diffusion LM
0
x
throughput
0
%
quality kept
0
T
training tokens
Two Towers Split the Work
Context Tower
frozen
●
Processes clean tokens causally
●
Reuses existing backbone
Denoiser Tower
trained
●
Refines noisy blocks
●
Linked by cross-attention
Benchmarks vs AR Baseline
MMLU
78.24
HumanEval
75.58
GSM8K
90.14
One Checkpoint, Three Modes
1
Mask Diffusion
↓
2
Mock-AR
↓
3
Standard AR
Open Weights on Hugging Face
AI NEWS BLITZ
NVIDIA has unveiled TwoTower, a diffusion language model built for faster generation.