Skip to content
This repository has been archived by the owner. It is now read-only.

Releases: softonic/laravel-intelligent-scraper

Add log information for better tracing and understanding

07 Nov 15:35
1d9702b
Compare
Choose a tag to compare

Added logs in different levels to be able to trace and debug in runtime.

Fix bug in reconfiguration

10 Oct 14:49
Compare
Choose a tag to compare
Pre-release
0.0.9

master Fix invalid variant value

Unify update dataset management

10 Oct 13:30
de45387
Compare
Choose a tag to compare
Pre-release

Now the configurator uses an special event to trigger the update dataset listener. This will unify the update dataset behaviour being predictable.

Fix infinite recursive resolution in Dependency Injector Container

10 Oct 10:14
6cbda18
Compare
Choose a tag to compare
0.0.7

bugfix/Infinite-DIC-loop Fix infitie DIC loop (#7)

Reuse old configuration when trying to find a new one

09 Oct 17:01
1242893
Compare
Choose a tag to compare

Now the package tries to reuse the old configuration before trying to find a new one, this will do the variants more static.

Page variant detection

09 Oct 14:26
30430cd
Compare
Choose a tag to compare
Pre-release

Now the scraper store the dataset based in the different xpaths used, so it generates a hash to identify the page variation for that scrape.

This allows the scrapper to store different dataset based in the variation to avoid lose page variations that are useful for the reconfiguration step.

This means that the scraper is now more stable.

Bugfixing

10 Sep 11:30
e551ba6
Compare
Choose a tag to compare
Bugfixing Pre-release
Pre-release

When calculate the configuration it is stored in cache to avoid repeated configurations in a short time. Now it takes into account the type to avoid conflicts.

Moved to a event system

07 Sep 10:01
c2dae0c
Compare
Choose a tag to compare
Pre-release

Now all the actions are based in events. Check the README.md for mor information.

Fix dataset generation

10 Aug 07:14
Compare
Choose a tag to compare
Pre-release

Add Scraped event with the corresponding listener to allow the scraper to store the data that is being scraped

Initial Release

09 Aug 13:55
Compare
Choose a tag to compare
Initial Release Pre-release
Pre-release

Basic Scraper

Features:

  • Build Xpath Configuration from a dataset
  • Scrape URL using Xpath Configuration