Skip to content

Releases: bda-research/node-crawler

Fix

14 Nov 05:55
Compare
Choose a tag to compare
  • Fixed issue where no callback was called when the 'skipDuplicates' option is active and only one URL is to be crawled. Also added the related test case. #124
  • Fixed issue when crawler.queue(undefined) #126

0.4.0 Cheerio is here

08 Nov 03:19
Compare
Choose a tag to compare

Crawler use now Cheerio by default.
Avoid compiling C++ when installing crawler by removing Jsdom from deps.
Jsdom is still supported, see the doc.

Hot Fix

23 Oct 06:03
Compare
Choose a tag to compare

Fix for #120

Restructuration and last release before cheerio support

22 Oct 00:47
Compare
Choose a tag to compare
  • require('crawler') instead of require('crawler').Crawler
  • New option rateLimits (see doc)
  • Re-organized the code structure

Next big release will be for Cheerio Support

Fixed recurrent windows Issues

04 Sep 08:15
Compare
Choose a tag to compare

Load Jquery File in a windows context
Update README to build Contextify https://github.com/sylvinus/node-crawler#contextify

Spring Cleaning

03 Jul 15:29
Compare
Choose a tag to compare

Cleaning in package.json
Update packages to new versions
First use of HttpBin for testing