Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Async: Started Async Porting #22

Open
wants to merge 7 commits into
base: master
Choose a base branch
from
Open

Async: Started Async Porting #22

wants to merge 7 commits into from

Conversation

MeNsaaH
Copy link
Member

@MeNsaaH MeNsaaH commented Apr 3, 2020

Use colly's Async(true) to make scrapers run on different goroutines to improve performance.

engine/engines.go Outdated Show resolved Hide resolved
@MeNsaaH MeNsaaH force-pushed the async-support branch 6 times, most recently from 8ba1d74 to 9e039d5 Compare April 6, 2020 18:05
@MeNsaaH
Copy link
Member Author

MeNsaaH commented Sep 23, 2020

Should we close this? @deven96

@deven96
Copy link
Member

deven96 commented Sep 23, 2020

Yeah screw this for now

@Go-phie Go-phie locked and limited conversation to collaborators Sep 24, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants