Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

create base for scraper integration #29

Open
kggold4 opened this issue May 25, 2023 · 0 comments
Open

create base for scraper integration #29

kggold4 opened this issue May 25, 2023 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@kggold4
Copy link
Member

kggold4 commented May 25, 2023

Branch name: 1.0.0-250523_create_base_for_scraper_integration

@kggold4 kggold4 self-assigned this May 25, 2023
@kggold4 kggold4 added the enhancement New feature or request label May 25, 2023
kggold4 added a commit that referenced this issue May 25, 2023
Create base file for integration of scraper component
kggold4 added a commit that referenced this issue Jun 2, 2023
* Fix API logger problem
* Add API logic for logic methods of API response
* Add more methods for `ArticleUtils` and `ClusterUtils`
* Create object `ArticleApiData` for api response object to extension
* Add `Cluster` dataclass
kggold4 added a commit that referenced this issue Jun 4, 2023
* Improve `get_similar_articles_data` method at `APILogic` class
* Improve `get_article` method at `ArticleUtils` class
* Add `set_page_load_timeout` at chrome driver
* Fix `element` logs
* Fix `mongodb_driver` logs
* Improve `get_similar_articles` route
* Add exceptions file for API
kggold4 added a commit that referenced this issue Jun 7, 2023
* Improve `Article` __repr__ method
* Improve logs
* Modify attributes names in `Cluster`
* Add function create_new_cluster into `ClusterUtils`
* Improve `get_similar_articles` route
kggold4 added a commit that referenced this issue Jun 8, 2023
* Separate `get_article` function to `get_article_by_id` and `get_article_by_url`
* Fix `get_many` function in `mongodb_driver`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant