Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decouple scraper from v1 API #395

Open
bepetersn opened this issue May 20, 2014 · 3 comments
Open

Decouple scraper from v1 API #395

bepetersn opened this issue May 20, 2014 · 3 comments

Comments

@bepetersn
Copy link
Member

This is a multi-part task. The first part is to pull the ng_scraper command out of django's management (done with #343) and to modify the scraper to archive the results of a scrape (see #432).

The scraper will no longer need to deal with "discharging" inmates. To the extent this still needs to be done, it will be handled by client APIs (see #419). Some amount of work still needs to be done in extracting the old database-related functionality from the scraper (see future issue).

@bepetersn bepetersn added this to the v2.0 API milestone May 20, 2014
@bepetersn bepetersn changed the title Decouple scraper from v1 DB and API Decouple scraper from v1 API May 20, 2014
@bepetersn bepetersn added scraper and removed scraper labels May 21, 2014
@bepetersn
Copy link
Member Author

#343 is done.

@bepetersn
Copy link
Member Author

It would be best to get #406 and also #419 done on the v2 branch before any of these other issues are deployed to the server. However, work can now continue on the master branch on these remaining modifications to the scraper.

As soon as it does, we will be in the midst of merging v1 and v2!!!! @wilbertom

@wilbertom
Copy link
Member

Check out the new repository. Almost working. We should migrate scraper issues over to that repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants