Addressing Multithreading and Multiprocessing in Transparent and Pythonic Ways

Explore advanced techniques for multithreading and multiprocessing in Python through this comprehensive talk from the EuroPython 2018 conference. Delve into the history and challenges of parallel computing in Python, including issues like oversubscription and nested parallelism. Learn when to utilize the Global Interpreter Lock (GIL) and when to bypass it for optimal performance. Discover new libraries and methods for effective multiprocessing, such as the static multiprocessing module and thread pool control. Gain practical insights through examples of processor pinning, thread pool management, and best practices for controlling parallel execution on various hardware configurations. Understand the current limitations and future directions for multithreading and multiprocessing in Python, equipping yourself with the knowledge to harness multi-core architectures efficiently in your Python projects.

David Liu - Addressing multithreading and multiprocessing in transparent and Pythonic ways