Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

zeopack taking very long to finalize after replacing old storage #274

Open
zopyx opened this issue Jul 1, 2019 · 1 comment
Open

zeopack taking very long to finalize after replacing old storage #274

zopyx opened this issue Jul 1, 2019 · 1 comment
Labels

Comments

@zopyx
Copy link
Member

zopyx commented Jul 1, 2019

ZODB 5.5.1, Python 3.7.3

I packed a filestorage with 30 GB size down to 11 GB. After replacing the Data.fs with the packed version it took about 30 further minutes until zeopack actually finished. What's happening after replacing the Data.fs? Is this due to writing a new index or just Python garbage collection taking place?

Local resource issues are unlikely the problem (decent CPU, enough RM, SSD, no swapping)

@zopyx zopyx added the question label Jul 1, 2019
@zopyx
Copy link
Member Author

zopyx commented Jul 1, 2019

Likely related to generating the index file (created 32 minutes after replacing the Data.fs).

s -la  var/filestorage/
total 41311940
drwxr-xr-x 2 ajung users        4096 Jul  1 10:20 .
drwxr-xr-x 6 ajung users        4096 Jun 29 07:58 ..
-rw-r--r-- 1 ajung users 11540432977 Jul  1 09:48 Data.fs
-rw-r--r-- 1 ajung users    22226481 Jul  1 10:20 Data.fs.index
-rw-r--r-- 1 ajung users           7 Jun 29 07:58 Data.fs.lock
-rw-r--r-- 1 ajung users 30726274928 Jul  1 08:42 Data.fs.old
-rw-r--r-- 1 ajung users    14460445 Jul  1 08:29 Data.fs.tmp

The site contains one fresh Plone installation (result of a full export-import migration) with about 100.000 content objects and 25.000 blobs..The blob storage is mounted on NFS..perhaps that might be the issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant