|
Home
|
Intern |
doFollow |
|
About
|
Intern |
doFollow |
|
All Posts
|
Intern |
doFollow |
|
All Tags
|
Intern |
doFollow |
|
Research
|
Intern |
doFollow |
|
Software
|
Intern |
doFollow |
|
DeepMind
|
Extern |
doFollow |
|
April 15, 2025
|
Intern |
doFollow |
|
Sander Dieleman
|
Intern |
doFollow |
|
latent variables
|
Extern |
doFollow |
|
The recipe
|
Intern |
doFollow |
|
How we got here
|
Intern |
doFollow |
|
Why two stages?
|
Intern |
doFollow |
|
Trading off reconstruction quality and modelability
|
Intern |
doFollow |
|
Controlling capacity
|
Intern |
doFollow |
|
Curating and shaping the latent space
|
Intern |
doFollow |
|
The tyranny of the grid
|
Intern |
doFollow |
|
Latents for other modalities
|
Intern |
doFollow |
|
Will end-to-end win in the end?
|
Intern |
doFollow |
|
Closing thoughts
|
Intern |
doFollow |
|
Acknowledgements
|
Intern |
doFollow |
|
References
|
Intern |
doFollow |
|
1
|
Intern |
doFollow |
|
2
|
Intern |
doFollow |
|
3
|
Intern |
doFollow |
|
4
|
Intern |
doFollow |
|
5
|
Intern |
doFollow |
|
6
|
Intern |
doFollow |
|
7
|
Intern |
doFollow |
|
8
|
Intern |
doFollow |
|
9
|
Intern |
doFollow |
|
10
|
Intern |
doFollow |
|
11
|
Intern |
doFollow |
|
12
|
Intern |
doFollow |
|
my blog post on typicality
|
Intern |
doFollow |
|
13
|
Intern |
doFollow |
|
14
|
Intern |
doFollow |
|
15
|
Intern |
doFollow |
|
16
|
Intern |
doFollow |
|
Test of Time award at NeurIPS 2024
|
Extern |
doFollow |
|
https://t.co/Ochh17IvGx
|
Extern |
doFollow |
|
November 28, 2024
|
Extern |
doFollow |
|
17
|
Intern |
doFollow |
|
Aurora model
|
Extern |
doFollow |
|
GPT-4o
|
Extern |
doFollow |
|
18
|
Intern |
doFollow |
|
Adam optimiser
|
Extern |
doFollow |
|
19
|
Intern |
doFollow |
|
20
|
Intern |
doFollow |
|
21
|
Intern |
doFollow |
|
22
|
Intern |
doFollow |
|
23
|
Intern |
doFollow |
|
24
|
Intern |
doFollow |
|
25
|
Intern |
doFollow |
|
26
|
Intern |
doFollow |
|
Stable Diffusion
|
Extern |
doFollow |
|
DALL-E 2
|
Extern |
doFollow |
|
Imagen 2
|
Extern |
doFollow |
|
DALL-E 3
|
Extern |
doFollow |
|
Imagen 3
|
Extern |
doFollow |
|
27
|
Intern |
doFollow |
|
my previous blog post on noise schedules
|
Intern |
doFollow |
|
casting diffusion as autoregression in frequency space
|
Intern |
doFollow |
|
auditory masking
|
Extern |
doFollow |
|
28
|
Intern |
doFollow |
|
29
|
Intern |
doFollow |
|
30
|
Intern |
doFollow |
|
I tried to explain this on Twitter
|
Extern |
doFollow |
|
rate-distortion theory
|
Extern |
doFollow |
|
31
|
Intern |
doFollow |
|
32
|
Intern |
doFollow |
|
entropy coding
|
Extern |
doFollow |
|
Huffman coding
|
Extern |
doFollow |
|
arithmetic coding
|
Extern |
doFollow |
|
33
|
Intern |
doFollow |
|
EQ-VAE paper
|
Extern |
doFollow |
|
34
|
Intern |
doFollow |
|
35
|
Intern |
doFollow |
|
36
|
Intern |
doFollow |
|
Tupper’s self-referential formula
|
Extern |
doFollow |
|
37
|
Intern |
doFollow |
|
38
|
Intern |
doFollow |
|
39
|
Intern |
doFollow |
|
40
|
Intern |
doFollow |
|
41
|
Intern |
doFollow |
|
42
|
Intern |
doFollow |
|
43
|
Intern |
doFollow |
|
an extensive exploration
|
Extern |
doFollow |
|
44
|
Intern |
doFollow |
|
45
|
Intern |
doFollow |
|
46
|
Intern |
doFollow |
|
47
|
Intern |
doFollow |
|
48
|
Intern |
doFollow |
|
my previous blog post
|
Intern |
doFollow |
|
VQGAN paper
|
Extern |
doFollow |
|
DALL-E VAE
|
Extern |
doFollow |
|
49
|
Intern |
doFollow |
|
50
|
Intern |
doFollow |
|
51
|
Intern |
doFollow |
|
52
|
Intern |
doFollow |
|
53
|
Intern |
doFollow |
|
a latent generative modelling paper
|
Extern |
doFollow |
|
54
|
Intern |
doFollow |
|
tweeted about it
|
Extern |
doFollow |
|
55
|
Intern |
doFollow |
|
their paper
|
Extern |
doFollow |
|
56
|
Intern |
doFollow |
|
57
|
Intern |
doFollow |
|
58
|
Intern |
doFollow |
|
59
|
Intern |
doFollow |
|
60
|
Intern |
doFollow |
|
61
|
Intern |
doFollow |
|
pic.twitter.com/eK7ZtLJ6lc
|
Extern |
doFollow |
|
April 14, 2025
|
Extern |
doFollow |
|
62
|
Intern |
doFollow |
|
@jxmnop on Twitter
|
Extern |
doFollow |
|
63
|
Intern |
doFollow |
|
64
|
Intern |
doFollow |
|
65
|
Intern |
doFollow |
|
66
|
Intern |
doFollow |
|
67
|
Intern |
doFollow |
|
AuraEquiVAE
|
Extern |
doFollow |
|
68
|
Intern |
doFollow |
|
69
|
Intern |
doFollow |
|
70
|
Intern |
doFollow |
|
71
|
Intern |
doFollow |
|
72
|
Intern |
doFollow |
|
73
|
Intern |
doFollow |
|
74
|
Intern |
doFollow |
|
diffusion distillation
|
Intern |
doFollow |
|
consistency decoder
|
Extern |
doFollow |
|
75
|
Intern |
doFollow |
|
76
|
Intern |
doFollow |
|
77
|
Intern |
doFollow |
|
78
|
Intern |
doFollow |
|
79
|
Intern |
doFollow |
|
80
|
Intern |
doFollow |
|
81
|
Intern |
doFollow |
|
82
|
Intern |
doFollow |
|
83
|
Intern |
doFollow |
|
84
|
Intern |
doFollow |
|
85
|
Intern |
doFollow |
|
86
|
Intern |
doFollow |
|
87
|
Intern |
doFollow |
|
88
|
Intern |
doFollow |
|
89
|
Intern |
doFollow |
|
90
|
Intern |
doFollow |
|
91
|
Intern |
doFollow |
|
92
|
Intern |
doFollow |
|
93
|
Intern |
doFollow |
|
94
|
Intern |
doFollow |
|
95
|
Intern |
doFollow |
|
motion estimation
|
Extern |
doFollow |
|
96
|
Intern |
doFollow |
|
97
|
Intern |
doFollow |
|
98
|
Intern |
doFollow |
|
99
|
Intern |
doFollow |
|
100
|
Intern |
doFollow |
|
101
|
Intern |
doFollow |
|
102
|
Intern |
doFollow |
|
103
|
Intern |
doFollow |
|
104
|
Intern |
doFollow |
|
105
|
Intern |
doFollow |
|
106
|
Intern |
doFollow |
|
107
|
Intern |
doFollow |
|
Twitter
|
Extern |
doFollow |
|
BlueSky
|
Extern |
doFollow |
|
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Generative Adversarial Nets
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Pixel recurrent neural networks
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Conditional image generation with pixelcnn decoders
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
WaveNet: A Generative Model for Raw Audio
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
SampleRNN: An Unconditional End-to-End Neural Audio Generation Model
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Deep Unsupervised Learning using Nonequilibrium Thermodynamics
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Generative Modeling by Estimating Gradients of the Data Distribution
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Denoising Diffusion Probabilistic Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
WaveGrad: Estimating Gradients for Waveform Generation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
DiffWave: A Versatile Diffusion Model for Audio Synthesis
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Neural Discrete Representation Learning
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Auto-Encoding Variational Bayes
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Stochastic Backpropagation and Approximate Inference in Deep Generative Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Generating Diverse High-Fidelity Images with VQ-VAE-2
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Attention is All you Need
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Adam: A Method for Stochastic Optimization
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
GIVT: Generative Infinite-Vocabulary Transformers
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Autoregressive Image Generation without Vector Quantization
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Symbolic Music Generation with Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Score-based Generative Modeling in Latent Space
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
D2C: Diffusion-Decoding Models for Few-Shot Conditional Generation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Diffusion Priors In variational Autoencoders
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
High-Resolution Image Synthesis with Latent Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Autoregressive Quantile Networks for Generative Modeling
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Generating Images with Sparse Representations
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Transframer: Arbitrary Frame Prediction with Generative Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
JPEG-LM: LLMs as Image Generators with Canonical Codec Representations
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Recent Advances in Autoencoder-Based Representation Learning
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoff
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
β-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Language-Guided Image Tokenization for Generation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
On the Spectral Bias of Neural Networks
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Restructuring Vector Quantization with the Rotation Trick
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Finite Scalar Quantization: VQ-VAE Made Simple
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Language Model Beats Diffusion – Tokenizer is Key to Visual Generation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Image and Video Tokenization with Binary Spherical Quantization
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
LTX-Video: Realtime Video Latent Diffusion
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Deep Compression Autoencoder for Efficient High-Resolution Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Distribution Matching in Variational Inference
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
ELBO surgery: yet another way to carve up the variational evidence lower bound
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Image-to-Image Translation with Conditional Adversarial Networks
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Vector-quantized Image Modeling with Improved VQGAN
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Analyzing and Improving the Image Quality of StyleGAN
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Flow to the Mode: Mode-Seeking Diffusion Autoencoders for State-of-the-Art Image Tokenization
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
DINOv2: Learning Robust Visual Features without Supervision
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Vector Quantized Contrastive Predictive Coding for Template-based Music Generation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Generative Spoken Language Modeling from Raw Audio
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
AudioLM: a Language Modeling Approach to Audio Generation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
How Should We Extract Discrete Audio Tokens from Self-Supervised Models?
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
A Theory of Usable Information Under Computational Constraints
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
When Worse is Better: Navigating the compression-generation tradeoff in visual tokenization
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Masked Autoencoders Are Effective Tokenizers for Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
GigaTok: Scaling Visual Tokenizers to 3 Billion Parameters for Autoregressive Image Generation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Alias-Free Latent Diffusion Models: Improving Fractional Shift Equivariance of Diffusion Latent Space
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Improving the Diffusability of Autoencoders
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Sample what you cant compress
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Epsilon-VAE: Denoising as Visual Decoding
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Diffusion Autoencoders are Scalable Image Tokenizers
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Simple diffusion: End-to-end diffusion for high resolution images
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Simpler Diffusion (SiD2): 1.5 FID on ImageNet512 with pixel-space diffusion
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Improving Image Generation with Better Captions
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Consistency Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Music2Latent: Consistency Autoencoders for Latent Audio Compression
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Diffusion Autoencoders: Toward a Meaningful and Decodable Representation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latents
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
DisCo-Diff: Enhancing Continuous Diffusion Models with Discrete Latents
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Variable-rate discrete representation learning
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
An Image is Worth 32 Tokens for Reconstruction and Generation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
One-D-Piece: Image Tokenizer Meets Quality-Controllable Compression
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
FlexTok: Resampling Images into 1D Token Sequences of Flexible Length
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
“Principal Components” Enable A New Language of Images
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Learning Ordered Representations with Nested Dropout
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
ElasticTok: Adaptive Tokenization for Image and Video
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Adaptive Length Image Tokenization via Recurrent Allocation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
CAT: Content-Adaptive Image Tokenization
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Tokenize Image as a Set
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Visual Lexicon: Rich Image Features in Language Space
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
DiscreTalk: Text-to-Speech as a Machine Translation Problem
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
From Pixels to Tokens: Byte-Pair Encoding on Quantized Visual Modalities
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
A New Algorithm for Data Compression
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
SoundStream: An End-to-End Neural Audio Codec
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
High Fidelity Neural Audio Compression
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
High-Fidelity Audio Compression with Improved RVQGAN
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
A mathematical theory of communication
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Byte Latent Transformer: Patches Scale Better Than Tokens
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Language modeling via stochastic processes
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Model
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Large Concept Models: Language Modeling in a Sentence Representation Space
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Coordinate In and Value Out: Training Flow Transformers in Ambient Space
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
PixelFlow: Pixel-Space Generative Models with Flow
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Understanding Diffusion Objectives as the ELBO with Simple Data Augmentation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
JetFormer: An Autoregressive Generative Model of Raw Images and Text
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
perspectives on diffusion
|
Intern |
doFollow |
|
EEML 2024 summer school
|
Extern |
doFollow |
|
available on YouTube
|
Extern |
doFollow |
|
a Python notebook
|
Extern |
doFollow |
|
Two forms of iterative refinement
|
Intern |
doFollow |
|
A spectral view of diffusion
|
Intern |
doFollow |
|
What about sound?
|
Intern |
doFollow |
|
Unstable equilibrium
|
Intern |
doFollow |
|
flow-based models
|
Extern |
doFollow |
|
adversarial models
|
Extern |
doFollow |
|
an earlier blog post
|
Intern |
doFollow |
|
written about it before
|
Intern |
doFollow |
|
Fourier transform
|
Extern |
doFollow |
|
Imagenette dataset
|
Extern |
doFollow |
|
1
|
Intern |
doFollow |
|
2
|
Intern |
doFollow |
|
3
|
Intern |
doFollow |
|
pink noise
|
Extern |
doFollow |
|
perspectives on diffusion blog post
|
Intern |
doFollow |
|
Rissanen et al. (2022)
|
Extern |
doFollow |
|
4
|
Intern |
doFollow |
|
5
|
Intern |
doFollow |
|
6
|
Intern |
doFollow |
|
7
|
Intern |
doFollow |
|
Nyquist frequency
|
Extern |
doFollow |
|
Audio clip 1
|
Intern |
doFollow |
|
Audio clip 2
|
Intern |
doFollow |
|
Audio clip 3
|
Intern |
doFollow |
|
Audio clip 4
|
Intern |
doFollow |
|
GTZAN music/speech dataset
|
Extern |
doFollow |
|
green noise
|
Extern |
doFollow |
|
10
|
Intern |
doFollow |
|
11
|
Intern |
doFollow |
|
12
|
Intern |
doFollow |
|
phase information is typically discarded
|
Intern |
doFollow |
|
mel scale
|
Extern |
doFollow |
|
Riffusion
|
Extern |
doFollow |
|
https://t.co/Akv8aZl8Rv
|
Extern |
doFollow |
|
December 15, 2022
|
Extern |
doFollow |
|
mel-frequency cepstral coefficients (MFCCs)
|
Extern |
doFollow |
|
discrete cosine transform (DCT)
|
Extern |
doFollow |
|
classifier-free guidance
|
Intern |
doFollow |
|
13
|
Intern |
doFollow |
|
14
|
Intern |
doFollow |
|
15
|
Intern |
doFollow |
|
16
|
Intern |
doFollow |
|
17
|
Intern |
doFollow |
|
Tian et al. (2024)
|
Extern |
doFollow |
|
Mattar et al. (2024)
|
Extern |
doFollow |
|
19
|
Intern |
doFollow |
|
20
|
Intern |
doFollow |
|
21
|
Intern |
doFollow |
|
22
|
Intern |
doFollow |
|
pic.twitter.com/XSxP27pKSt
|
Extern |
doFollow |
|
August 4, 2024
|
Extern |
doFollow |
|
pic.twitter.com/snLQavtZBf
|
Extern |
doFollow |
|
August 22, 2024
|
Extern |
doFollow |
|
Modelling the Power Spectra of Natural Images: Statistics and Information
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Statistics of natural image categories
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Natural Image Statistics: A probabilistic approach to early computational vision
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Flow Matching for Generative Modeling
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Scaling Rectified Flow Transformers for High-Resolution Image Synthesis
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Multi-instrument Music Synthesis with Spectrogram Diffusion
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesis
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Simple and Effective Masked Diffusion Language Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Simplified and Generalized Masked Diffusion for Discrete Data
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Rolling Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
FIFO-Diffusion: Generating Infinite Videos from Text without Training
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Diffusion models are autoencoders
|
Intern |
doFollow |
|
Noise schedules: a whirlwind tour
|
Intern |
doFollow |
|
Noise levels: focusing on what matters
|
Intern |
doFollow |
|
Model design choices: what might tip the balance?
|
Intern |
doFollow |
|
Noise schedules are a superfluous abstraction
|
Intern |
doFollow |
|
Adaptive weighting mechanisms
|
Intern |
doFollow |
|
1
|
Intern |
doFollow |
|
2
|
Intern |
doFollow |
|
7
|
Intern |
doFollow |
|
8
|
Intern |
doFollow |
|
9
|
Intern |
doFollow |
|
blog post
|
Intern |
doFollow |
|
Photo credit: kipply
|
Extern |
doFollow |
|
10
|
Intern |
doFollow |
|
11
|
Intern |
doFollow |
|
12
|
Intern |
doFollow |
|
13
|
Intern |
doFollow |
|
Section 2
|
Intern |
doFollow |
|
15
|
Intern |
doFollow |
|
EDM paper
|
Extern |
doFollow |
|
“Variational Diffusion Models”
|
Extern |
doFollow |
|
“Analyzing and Improving the Training Dynamics of Diffusion Models”
|
Extern |
doFollow |
|
16
|
Intern |
doFollow |
|
17
|
Intern |
doFollow |
|
“Continuous diffusion for categorical data”
|
Extern |
doFollow |
|
18
|
Intern |
doFollow |
|
inverse transform sampling
|
Extern |
doFollow |
|
“Continuous Diffusion for Mixed-Type Tabular Data”
|
Extern |
doFollow |
|
19
|
Intern |
doFollow |
|
Santos & Lin (2023)
|
Extern |
doFollow |
|
20
|
Intern |
doFollow |
|
Fisher Information
|
Extern |
doFollow |
|
“Align your steps”
|
Extern |
doFollow |
|
21
|
Intern |
doFollow |
|
bilevel optimisation
|
Extern |
doFollow |
|
the most overused of all snowclones
|
Extern |
doFollow |
|
ICML 2024 in Vienna
|
Extern |
doFollow |
|
Score-Based Generative Modeling through Stochastic Differential Equations
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Denoising Diffusion Probabilistic Models
|
Extern |
doFollow |
|
Improved Denoising Diffusion Probababilistic Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
https://arxiv.org/abs/2301.10972
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Progressive Distillation for Fast Sampling of Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Maximum Likelihood Training of Score-Based Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restoration
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Diffusion sampling: tread carefully!
|
Intern |
doFollow |
|
Moving through input space with purpose
|
Intern |
doFollow |
|
Diffusion distillation
|
Intern |
doFollow |
|
Distilling diffusion sampling into a single forward pass
|
Intern |
doFollow |
|
Progressive distillation
|
Intern |
doFollow |
|
Guidance distillation
|
Intern |
doFollow |
|
Rectified flow
|
Intern |
doFollow |
|
Consistency distillation & TRACT
|
Intern |
doFollow |
|
BOOT: data-free distillation
|
Intern |
doFollow |
|
Sampling with neural operators
|
Intern |
doFollow |
|
Score distillation sampling
|
Intern |
doFollow |
|
Adversarial distillation
|
Intern |
doFollow |
|
But what about “no free lunch”?
|
Intern |
doFollow |
|
Do we really need a teacher?
|
Intern |
doFollow |
|
Charting the maze between data and noise
|
Intern |
doFollow |
|
an in-depth blog post
|
Intern |
doFollow |
|
previous blog post on the geometry of diffusion guidance
|
Intern |
doFollow |
|
4
|
Intern |
doFollow |
|
previously written about this feat of magic
|
Intern |
doFollow |
|
5
|
Intern |
doFollow |
|
6
|
Intern |
doFollow |
|
7
|
Intern |
doFollow |
|
8
|
Intern |
doFollow |
|
10
|
Intern |
doFollow |
|
11
|
Intern |
doFollow |
|
various perspectives on diffusion
|
Intern |
doFollow |
|
12
|
Intern |
doFollow |
|
previously discussed
|
Intern |
doFollow |
|
13
|
Intern |
doFollow |
|
15
|
Intern |
doFollow |
|
Guidance: a cheat code for diffusion models
|
Intern |
doFollow |
|
16
|
Intern |
doFollow |
|
18
|
Intern |
doFollow |
|
21
|
Intern |
doFollow |
|
22
|
Intern |
doFollow |
|
23
|
Intern |
doFollow |
|
24
|
Intern |
doFollow |
|
compelling results
|
Extern |
doFollow |
|
26
|
Intern |
doFollow |
|
27
|
Intern |
doFollow |
|
28
|
Intern |
doFollow |
|
29
|
Intern |
doFollow |
|
30
|
Intern |
doFollow |
|
31
|
Intern |
doFollow |
|
32
|
Intern |
doFollow |
|
33
|
Intern |
doFollow |
|
DreamFusion
|
Extern |
doFollow |
|
34
|
Intern |
doFollow |
|
35
|
Intern |
doFollow |
|
36
|
Intern |
doFollow |
|
37
|
Intern |
doFollow |
|
39
|
Intern |
doFollow |
|
40
|
Intern |
doFollow |
|
41
|
Intern |
doFollow |
|
42
|
Intern |
doFollow |
|
43
|
Intern |
doFollow |
|
44
|
Intern |
doFollow |
|
45
|
Intern |
doFollow |
|
SDXL Turbo
|
Extern |
doFollow |
|
46
|
Intern |
doFollow |
|
December 5, 2023
|
Extern |
doFollow |
|
implicitly relies on there being many sampling steps
|
Intern |
doFollow |
|
Denoising Diffusion Implicit Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Gotta Go Fast When Generating Data with Score-Based Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
GENIE: Higher-Order Denoising Diffusion Solvers
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Pseudo Numerical Methods for Diffusion Models on Manifolds
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Fast Sampling of Diffusion Models with Exponential Integrator
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Distilling the Knowledge in a Neural Network
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
A Comprehensive Survey on Knowledge Distillation of Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Knowledge Distillation in Iterative Generative Models for Improved Sampling Speed
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Classifier-Free Diffusion Guidance
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
On Distillation of Guided Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Improved Techniques for Training Score-Based Generative Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Improved Techniques for Training Consistency Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference
|
Extern |
doFollow |
|
Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrapping
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Efficient Estimation of Word Representations in Vector Space
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Fast Sampling of Diffusion Models via Operator Learning
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Fourier neural operator for parametric partial differential equations
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
DreamFusion: Text-to-3D using 2D Diffusion
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Differentiable Image Parameterizations
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Parallel WaveNet: Fast High-Fidelity Speech Synthesis
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Noise-free Score Distillation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Diff-Instruct: A Universal Approach for Transferring Knowledge From Pre-trained Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
One-step Diffusion with Distribution Matching Distillation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Tackling the Generative Learning Trilemma with Denoising Diffusion GANs
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Adversarial score matching and improved sampling for image generation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANs
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Adversarial Diffusion Distillation
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Emerging Properties in Self-Supervised Vision Transformers
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
StyleGAN-T: Unlocking the Power of GANs for Fast Large-Scale Text-to-Image Synthesis
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Understanding DDPM Latent Codes Through Optimal Transport
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
This note about why high-dimensional spheres are “spikey”
|
Extern |
doFollow |
|
1
|
Intern |
doFollow |
|
available to download in PDF format
|
Extern |
doFollow |
|
pic.twitter.com/nTakZArbsD
|
Extern |
doFollow |
|
June 10, 2018
|
Extern |
doFollow |
|
the same blog post
|
Intern |
doFollow |
|
7
|
Intern |
doFollow |
|
8
|
Intern |
doFollow |
|
9
|
Intern |
doFollow |
|
10
|
Intern |
doFollow |
|
@sedielem
|
Extern |
doFollow |
|
@sanderdieleman
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Diffusion Models Beat GANs on Image Synthesis
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Universal Guidance for Diffusion Models
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
Classifier-Free Diffusion Guidance
|
Extern |
doFollow |
|
↩
|
Intern |
doFollow |
|
2
|
Intern |
doFollow |
|
3
|
Intern |
doFollow |
|
4
|
Intern |
doFollow |
|
5
|
Intern |
doFollow |
|
Jekyll
|
Extern |
noFollow |
|
HPSTR Theme
|
Extern |
noFollow |