Tag: sampling

Blog Post·2024-06-19·5 min read

DDIM: Deterministic Sampling in Fewer Steps

DDPM needs 1000 steps to generate a sample. DDIM reframes the reverse process as an ODE and gets the same quality in 50. The model weights are identical — only the sampling procedure changes.

diffusion ddim sampling generative-models

Blog Post·2024-06-19·7 min read

Statistical Foundations: Distributions, Estimation, and Sampling

Language models are probabilistic systems. Understanding the statistical machinery behind maximum likelihood estimation, Bayesian inference, and sampling algorithms clarifies why training and decoding work the way they do.

math statistics sampling bayesian llm-training