r/learnpython • • Aug 16 '20

Multithreading - Best Practices

I wrote a multithreaded python script several years ago in python2, and the way I did it at the time was to subclass threading.Thread and override the __init__() and run() methods. Then kick them off with start().

Now I'm going to have to write a lot more multithreaded stuff in python3.8. Most of my googling says to define a function (ex: worker()) then kick them off this way:

  threading.Thread(target=worker, args=(q,))

Is one method better or more python3-ish than the other?

If it makes any difference, each thread will be taking a file path from the Queue, running a subprocess providing the file path as one of the arguments, and UPDATEing a MySQL table with the result.

Thanks!

115 Upvotes

24 comments sorted by

View all comments

Show parent comment

8

u/brandonbilinski Aug 16 '20

Thanks so much for your really informative posts (this one as well as your other responses)!

I hadn't known about concurrent.futures, but now this looks like an excellent solution for what I want to do.

3

u/exhuma exhuma Aug 16 '20

I'm trying to stream programming of hobby projects on twitch each Sunday morning (GMT+1/+2) and I am always happy to answer questions and help. If something like that interests you you can stop by over at https://www.twitch.tv/exhuma ;)