Index Backpropagation Quantization
January 2026
20 min read
Quantization, Deep Learning, VQ-VAE, Optimization
Use arrow keys or click to navigate slides. Press 'F' or Fullscreen icon for best experience.
What You'll Learn
- •Limitations of traditional Codebook Learning
- •Introduction to Index Backpropagation Quantization
- •The Backpropagation Trick explained
- •Loss Function comparison: Standard vs IBQ
- •Gradient flow improvements
Key Concepts Covered
A common failure mode in VQ-VAEs addressed by improved quantization methods.
Traditional method for bypassing non-differentiable quantization steps.
Optimizing indices directly via relaxed constraints or specific tricks.
Resources
Slide Overview
- Problem: Codebook Learning Issues
- Solution: Index Backpropagation
- Mathematical Formulation
- Loss Functions & Results