Discrete Flow Matching for High-Dimensional Discrete Data Generation

Explore a comprehensive lecture on Discrete Flow Matching, a novel discrete flow paradigm for generating high-dimensional discrete data. Delve into the key contributions of this approach, including its use of general probability paths, generic sampling formula, and improved generative perplexity. Learn how Discrete Flow Matching scales up to 1.7B parameters, achieving significant results on coding benchmarks. Understand the non-autoregressive generation of high-quality discrete data and how it narrows the gap between autoregressive models and discrete flow models. Follow the detailed equation walkthrough, examine the results, and engage with the Q&A session to deepen your understanding of this innovative technique in AI for drug discovery.

- Intro + Background
- Equation Walkthrough
- Results
- Q+A