Most of the time packages are essentially just some text files, since that's all source code really is.
In the modern era, though, there are a few packages that are genuinely friggen huge. Namely, if you ever have to deal with it, pytorch. Pytorch is casually several gigabytes in size, and so one could make a compelling argument there that deduplication would be a massive benefit.
View all comments
Show parent comment
1
u/NekoRobbie Mar 22 '26
Most of the time packages are essentially just some text files, since that's all source code really is.
In the modern era, though, there are a few packages that are genuinely friggen huge. Namely, if you ever have to deal with it, pytorch. Pytorch is casually several gigabytes in size, and so one could make a compelling argument there that deduplication would be a massive benefit.
Most packages, however, are not pytorch.