Pilerpurge.py increaseing data usage.
Issue #1092
closed
When i’m trying to remove the aged email by pilerpurge.py, the size of the disk is increasing even when the pilerpurge.py is finish the task, the size of data still consume and growth. and right now im facing that when i'm using the pilerpurge.py, my disk is increase for like 50 GB (from 5 TB of disk, 4.7 TB of data) im not sure what happen.
Piler version: 1.3.1
OS: CentOS 7
Comments (7)
-
repo owner
-
reporter
I've test by stop sending mail to piler. But the size of disk still growth.
My suspect that when the pilerpurge.py try to delete the email, this may create some temp file in the system. In my opinion that the pilerpurge.py may create some huge temp file in somewhere.
-
reporter
Or do you have anything in mind that some data have create and purge out for intervals?
-
repo owner
No, pilerpurge.py doesn’t create temp files. You need to measure on which part of the filesystem you experience the 50 GB growth. Then based on that data we may figure out what’s going on.
-
reporter
Now i’ve test by stop sending email to piler again. but the data still grow and keep consume disk space. So, I want to find out if it is not pilerpurge.py who consumimg the disk, which any other process keep write something to disk since as of our inspection from 10PM last night it keep growing by around 10 GB per hour, slowing down after midnight then back to 10GB/Hours again from 8AM and suddently around 70 GB of free space came back after around 12 hours passed. assuming that almost of space consuming this way had free up when some of period passed.
-
repo owner
Don’t just blindly check df output or similar. You need to find put which directories grow.
-
repo owner
- changed status to closed
No news is good news.
- Log in to comment
I don’t think it’s the case since pilerpurge removes files from the disk. I suspect that new emails or something else contributes to that extra 50 GB disk.