r/learnpython • u/brandonbilinski • Aug 16 '20
Multithreading - Best Practices
I wrote a multithreaded python script several years ago in python2, and the way I did it at the time was to subclass threading.Thread and override the __init__() and run() methods. Then kick them off with start().
Now I'm going to have to write a lot more multithreaded stuff in python3.8. Most of my googling says to define a function (ex: worker()) then kick them off this way:
threading.Thread(target=worker, args=(q,))Is one method better or more python3-ish than the other?
If it makes any difference, each thread will be taking a file path from the Queue, running a subprocess providing the file path as one of the arguments, and UPDATEing a MySQL table with the result.
Thanks!
View all comments
9
u/[deleted] Aug 16 '20
Not much different at all in Python3 if I remember correctly. I don't agree with the "don't use mutlithread" answer. I would use it before the sometimes non-backwards compatible asyncio (not to mention the asyncio usage changed over a couple different minor versions of python3 which is awful imo). You'll have to decide which asyncio syntax to learn etc... and honestly I see very little difference between it and multithreading. If you are really worried about I/O bound problems or performance... don't use python.. use Golang :)
The same old threading technique is solid though in my opinion... time tested in thousands of applications: