Out-of-Core Columnar Datasets

Explore the impact of table implementation on performance in handling large datasets through this 23-minute EuroPython Conference talk. Dive into the world of Big Data analysis, focusing on tabular data structures and their efficiency in various operations like filtering, grouping, sorting, and alignment. Compare different libraries and systems in the Python ecosystem designed for both on-disk and in-memory tabular data management, including PyTables, relational databases, BLZ, Blaze, NumPy, DyND, and Pandas. Gain insights into out-of-core databases for handling extremely large tables and learn which solutions best suit different data analysis needs in the Python world.

Francesc Alted - Out-of-Core Columnar Datasets