Python Process Pools - Concurrency and Asynchrony
A process pool allows you to launch a limited number of processes automatically. It's more of a "set it and forget it" data processing solution. While it may not always provide a HUGE speed advantage, it can at least easily perform several times more operations in the same amount of time on any hardware. Plus, there's the ability to work with asynchrony for those who appreciate it.
TG channel where I provide some context for the videos - https://t.me/PythonClinicChnl
Timecodes:
00:00 - Intro
00:36 - What is a pool
02:48 - Multiprocess map and balancing
08:34 - Outperforming a standard map by 16x
12:30 - Asynchrony
15:50 - apply_async
23:09 - A terrible secret and outro