FlashDiffusion: Fused Tiled Kernel Spectral Decomposition
Diffusion maps, and kernel methods more generally, provide an interpretable nonlinear spectral representation basis for geometric learning. In the geometric limit, small bandwidth, these matrices tend to be high rank and thus require materializing dense Gaussian kernels requires $O(N^2)$ memory.
arXiv cs.LG1 min read