Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Shutdown taking forever #922

Closed
MaazBinMusa opened this issue May 11, 2021 · 2 comments
Closed

Shutdown taking forever #922

MaazBinMusa opened this issue May 11, 2021 · 2 comments
Labels
bug needs-investigation

Comments

@MaazBinMusa
Copy link
Contributor

I created the docker image and in it I am using 30 browser instances. If I crawl 100 sites it completes the crawl and shuts down. However if I move up to 250 or 500 crawls. The crawls complete. I get this message as well:

storage_controller - INFO - Received shutdown signal!

But it takes hours and still the program does not terminate.
@vringar
Copy link
Contributor

vringar commented May 12, 2021

Could you check in log file if the storage_controller logs any useful debug messages there?
The logs are always written to in debug mode, so there might be more useful info there.

@vringar vringar mentioned this issue Jul 9, 2021
Open
@vringar vringar mentioned this issue Dec 16, 2021
Closed
@vringar
Copy link
Contributor

vringar commented Oct 21, 2023

Hopefully fixed by #1057

@vringar vringar closed this as completed Oct 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug needs-investigation
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@vringar @MaazBinMusa