Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Slow download all results #135

Open
PaulRambags opened this issue Sep 8, 2020 · 0 comments
Open

Slow download all results #135

PaulRambags opened this issue Sep 8, 2020 · 0 comments

Comments

@PaulRambags
Copy link

As a user of the Web UI, I would like that file results.zip appears within seconds after I've pushed the Download all results button, so that I don't have to wait for minutes.

I processed a large DTBook - it is 2.5 MB in size and produces a PEF with 63 volumes and more than 3700 pages. Then when I push the Download all results button I have to wait more than 5 minutes before I receive the results.zip. In the meanwhile, the Web UI takes maximum CPU.
If I get the results from the Pipeline 2 with dp2 results, then ZIP the results with 7-Zip and transfer the resulting ZIP file with copy-and-paste to my local machine, it takes me only a few seconds.

I suspect that the Web UI uses an inefficient ZIP library.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants