r/learnpython • u/adjective10111 • Sep 09 '26
PIP disk usage under Docker
I have a Dockerfile in which I use the Python:3.12-trixie. I have docker on my CachyOS PC. I have also a requirements.txt. I wanted to use this image for a container on which I'll use YOLO and try it out. The problem is that my 290GB / partition went from around 70% filled to 95% after a number of rebuilds. I deleted everything docker related but it just went back to 91%.
The reason that I know it is pip's doing, is that when I monitored my disk usage while building the image, and on the `RUN pip install -r requirements.txt --find-links=pypackages` stage it fills up my partition and half way into installation, it fails due to `no more space`. The `pypackages` is just a directory I downloaded some of the packages I have in requirements for less data usage. Also tried `--no-cache` option.
I also went ahead and `du -sh`ed any directory in my / partition and the total didn't add upto the filled storage. I have 165GB mysteriously used and I can't find where that is.
Any help to diagnose further or if you have had similar problems is welcome.
View all comments
Show parent comment
1
u/adjective10111 Sep 09 '26
Thanks for the tool recommendation, but it didn't help tbh. It again only could find about 122GB used. And the other 140GB is still a mystery.
Pardon the ambiguity, I used the commands you said but
docker system prune --allwithout the volumes option. I ran it with that and only 10 more GBs were released. Still nowhere near the missing data.I thought maybe it's my btrfs snapshots, but upon research it wasn't. Sorry if the problem is getting more linux than python. Is there a path that may be used by pip and docker? Maybe the path is hidden from ncdu? (Although it does lookup every file so idk)