TL;DR
Existing diffusion models often struggle with maintaining geometric accuracy during sampling, leading to distorted outputs. A new method called Geometry-Correct Diffusion Posterior Sampling was developed, utilizing Denoiser-Pullback Curvature Guidance and Manifold-Aligned Damping.
✦ Why It Matters
Engineers can enhance the geometric accuracy of their generative models using this new sampling technique.
Key Takeaways
How It Works
The proposed method enhances diffusion posterior sampling by using a damped Gauss-Newton correction that adjusts guidance based on noise levels. This correction is computed in diffusion-state coordinates, allowing for more accurate likelihood gradient adjustments without the need for complex Jacobians.
The integration of a variance-preserving Langevin transition ensures that the sampling process maintains the necessary statistical properties, leading to improved image quality.
Related