Skip to content

Releases: scrapy-plugins/scrapy-zyte-smartproxy

v2.3.5

05 Aug 12:37
Compare
Choose a tag to compare

Ban and throttling responses from Zyte API proxy mode are now handled in line with matching responses from Zyte Smart Proxy Manager.

Full Changelog: https://scrapy-zyte-smartproxy.readthedocs.io/en/latest/news.html

v2.3.4

09 May 08:26
Compare
Choose a tag to compare

2.3.3

22 Feb 20:52
Compare
Choose a tag to compare

2.3.2

14 Feb 11:24
Compare
Choose a tag to compare

Detect scenarios where the proxy Request.meta key has probably been accidentally copied from an earlier response, warn about it, and fix the value.

The Zyte-Client header is again sent when using Zyte API proxy mode, now that Zyte API supports it.

Full Changelog: https://scrapy-zyte-smartproxy.readthedocs.io/en/latest/news.html

2.3.1

20 Nov 14:54
Compare
Choose a tag to compare

Fixed support for the proxy mode of Zyte API.

Full Changelog: https://scrapy-zyte-smartproxy.readthedocs.io/en/latest/news.html

v2.3.0

20 Oct 10:26
Compare
Choose a tag to compare

Support for the upcoming proxy API of Zyte API.

Full Changelog: https://scrapy-zyte-smartproxy.readthedocs.io/en/latest/news.html

v2.2.0

05 Aug 07:39
Compare
Choose a tag to compare

Support Scrapy 2.6.2. Scrapy 1.4+ is now required.

v2.1.0

16 Jun 21:49
v2.1.0
eb7946e
Compare
Choose a tag to compare

Use a custom logger instead of the root one

v2.0.0

12 May 07:37
Compare
Choose a tag to compare

Following the upstream rebranding of Crawlera as Zyte Smart Proxy Manager, scrapy-crawlera has been renamed as scrapy-zyte-smartproxy, with the following backward-incompatible changes:

  • The repository name and Python Package Index (PyPI) name are now scrapy-zyte-smartproxy.
  • Setting prefixes have switched from CRAWLERA_ to ZYTE_SMARTPROXY_.
  • Spider attribute prefixes and request meta key prefixes have switched from crawlera_ to zyte_smartproxy_.
  • scrapy_crawlera is now scrapy_zyte_smartproxy.
  • CrawleraMiddleware is now ZyteSmartProxyMiddleware, and its default url is now http://proxy.zyte.com:8011.
  • Stat prefixes have switched from crawlera/ to zyte_smartproxy/.
  • The online documentation is moving to https://scrapy-zyte-smartproxy.readthedocs.io/

Note: Zyte Smart Proxy Manager headers continue to use the X-Crawlera- prefix.

  • In addition to that, the X-Crawlera-Client header is now automatically included in all requests.

v1.7.0

01 Apr 17:02
Compare
Choose a tag to compare
  • Added more stats to better understanding the internal states.
  • Log warning when using https:// protocol.
  • Add default http:// protocol in case of none provided, and log warning about it.
  • Fix duplicated request when the response is not from crawlera, this was causing an infinite loop of retries when dont_filter=True.