Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to scrape as background work? #209

Closed
acowdont opened this issue Mar 15, 2021 · 1 comment
Closed

Is it possible to scrape as background work? #209

acowdont opened this issue Mar 15, 2021 · 1 comment
Labels
duplicate This issue or pull request already exists

Comments

@acowdont
Copy link

If the capture window is not focused, the capturing operation will not proceed. When making multiple scraping, I have to focus the windows one by one. What codes do I need to modify to make it work in the background?

Thanks

@danny0838
Copy link
Owner

This issue is a duplicate of #191 and we'll trace it there.

Although it's technically possible to run the capture in the background, there are still many issues preventing it, and the code has to be largely refactored to support it.

According to our tests in both Firefox and Chrome, captures in non-active windows will eventually finish, so you probably don't need to focus them one by one, though the browser may somehow slow down their execution.

It's less encouraged to run multiple captures in the same time, as they would block each other when uploading to the backend server. To capture multiple pages you can select multiple tabs and run a batch capture task to capture them one by one in a queue.

@danny0838 danny0838 added the duplicate This issue or pull request already exists label Mar 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
duplicate This issue or pull request already exists
Projects
None yet
Development

No branches or pull requests

2 participants