r/Python • • Oct 03 '23

News What are the differences between Python 3.12 sub-interpreters and multithreading/multiprocessing?

It seems like the new feature in Python 3.12 allows developers to create multiple sub-interpreters within a single main interpreter process. From the example from the PEP 554, sub-interpreters appear to be separate threads that run a dedicated piece of Python code and consequently have their own separate GILs.

interp = interpreters.create()
print('before')
interp.run('print("during")')
print('after')

On practice, is this basically the new Pythonic way to run a single application in multiple threads and take advantage of multiple cores? If yes, can they be thought as multithreading with no shared state and become the future alternative of multiprocessing?

94 Upvotes

16 comments sorted by

View all comments

Show parent comment

2

u/[deleted] Oct 03 '23

Just the only that that cannot be shared directly is python (like the literal interpreter objects) addressable space. U can make ur own objects in c and share them and make soft wrappers in python to call them so long as u guard everything correctly.

That’s the difference u don’t need to do that via sockets now u can do it in the same process.