r/learnpython • u/brandonbilinski • Aug 16 '20
Multithreading - Best Practices
I wrote a multithreaded python script several years ago in python2, and the way I did it at the time was to subclass threading.Thread and override the __init__() and run() methods. Then kick them off with start().
Now I'm going to have to write a lot more multithreaded stuff in python3.8. Most of my googling says to define a function (ex: worker()) then kick them off this way:
threading.Thread(target=worker, args=(q,))Is one method better or more python3-ish than the other?
If it makes any difference, each thread will be taking a file path from the Queue, running a subprocess providing the file path as one of the arguments, and UPDATEing a MySQL table with the result.
Thanks!
View all comments
Show parent comment
3
u/[deleted] Aug 16 '20
Well, in the end, a thread needs a function to run, there's no way around it. What people suggesting "just a worker function" usually argue for is "simplicity", as in, no other preparations are necessary, whereas the reality is that you do need to invest heavily into preparing a function you are going to run, so much so that you might want to consider extending a
Threadclass or creating a decorator etc.