RL Post-Training Diffusion Language Models Along Their Own Generation Paths

TL;DR

Diffusion language models are a promising and more efficient alternative to autoregressive models. However, most RL post-training techniques are not easily adapted to these models.