Learn to use queues, daemon threads, and occasions in a Machine Studying venture
Introduction
In most Machine Studying jobs, you gained’t do analysis on enhancing some mannequin structure or designing a brand new loss perform. More often than not it’s essential to make the most of what already exists and adapt it to your use case. So it is rather necessary to optimize your venture by way of architectural design and implementation. Every little thing begins from there: you need optimum code, that’s clear, reusable and runs as quick as doable. Threading is a Python built-in native library that folks don’t use as usually as they need to.
About Threads
Threads are a method for a program to break up itself into two or extra concurrently (or pseudo-simultaneously) working duties … usually, a thread is contained inside a course of and completely different threads in the identical course of share the identical sources.
On this article, we don’t speak about multiprocessing, however the Python library for multiprocessing works very equally to the multithreading one. Generally:
- Multithreading is nice for I/O bounds duties, like calling an API inside a for loops
- Multiprocessing is used for CPU-bound duties, like…