Data Refinement: Unleashing the Power of SQL in Python Using Polars

Explore the power of SQL in Python using Polars in this 15-minute conference talk by Tom Levy at Conf42 Python 2024. Discover why Polars is a valuable tool for data refinement and learn how to leverage LazyFrames for handling large datasets efficiently. Gain insights into utilizing SQL-like syntax within Python, including the implementation of Common Table Expressions (CTEs). Follow along as the speaker covers key topics such as the advantages of Polars, introduction to SQL content, and practical applications for big data processing. Enhance your data manipulation skills and learn how to streamline your workflow by combining the strengths of SQL and Python in this informative presentation.

intro
preamble
agenda
why polars?
introduction to sql content
utilize lazyframes for big datasets
common table expressions ctes
thank you!