Skip to content
This repository has been archived by the owner. It is now read-only.

Page variant detection

Pre-release
Pre-release
Compare
Choose a tag to compare
@joskfg joskfg released this 09 Oct 14:26
· 25 commits to master since this release
0.0.5
30430cd
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Now the scraper store the dataset based in the different xpaths used, so it generates a hash to identify the page variation for that scrape.

This allows the scrapper to store different dataset based in the variation to avoid lose page variations that are useful for the reconfiguration step.

This means that the scraper is now more stable.

Assets 2
Loading