Releases: softonic/laravel-intelligent-scraper
Add log information for better tracing and understanding
Added logs in different levels to be able to trace and debug in runtime.
Fix bug in reconfiguration
0.0.9 master Fix invalid variant value
Unify update dataset management
Now the configurator uses an special event to trigger the update dataset listener. This will unify the update dataset behaviour being predictable.
Fix infinite recursive resolution in Dependency Injector Container
0.0.7 bugfix/Infinite-DIC-loop Fix infitie DIC loop (#7)
Reuse old configuration when trying to find a new one
Now the package tries to reuse the old configuration before trying to find a new one, this will do the variants more static.
Page variant detection
Now the scraper store the dataset based in the different xpaths used, so it generates a hash to identify the page variation for that scrape.
This allows the scrapper to store different dataset based in the variation to avoid lose page variations that are useful for the reconfiguration step.
This means that the scraper is now more stable.
Bugfixing
Moved to a event system
Now all the actions are based in events. Check the README.md for mor information.
Fix dataset generation
Add Scraped event with the corresponding listener to allow the scraper to store the data that is being scraped
Initial Release
Basic Scraper
Features:
- Build Xpath Configuration from a dataset
- Scrape URL using Xpath Configuration