Home
Proxy List Scrapper from various websites. They gives the free proxies for temporary use.
you can download the chrome extension "Free Proxy List Scrapper Chrome Extension" folder and load in the extension.
Goto Chrome Extension click here.
Web_Scrapper Module here
Web Scrapper is proxy web scraper using proxy rotating api https://scrape.do
you can check official documentation from here
## How to use Proxy List Scrapper You can clone this project from github. or use
pip install Proxy-List-Scrapper
Make sure you have installed the requests and urllib3 in python
in import add
from Proxy_List_Scrapper import Scrapper, Proxy, ScrapperException
After that simply create an object of Scrapper class as "scrapper"
scrapper = Scrapper(category=Category, print_err_trace=False)
Here Your need to specify category defined as below:
'SSL': 'https://www.sslproxies.org/',
'GOOGLE': 'https://www.google-proxy.net/',
'ANANY': 'https://free-proxy-list.net/anonymous-proxy.html',
'UK': 'https://free-proxy-list.net/uk-proxy.html',
'US': 'https://www.us-proxy.org/',
'NEW': 'https://free-proxy-list.net/',
'SPYS.ME': 'http://spys.me/proxy.txt',
'proxyscrape': 'https://api.proxyscrape.com/?request=getproxies&proxytype=all&country=all&ssl=all&anonymity=all',
'ALL': 'ALL'
These are all categories.
After you have to call a function named "getProxies"
# Get ALL Proxies According to your Choice
data = scrapper.getProxies()
the data will be returned by the above function the data is having the response data of function.
in data having proxies,len,category
- @proxies is the list of Proxy Class which has actual proxy.
- @len is the count of total proxies in @proxies.
- @category is the category of proxies defined above.
# Print These Scrapped Proxies
print("Scrapped Proxies:")
for item in data.proxies:
print('{}:{}'.format(item.ip, item.port))
# Print the size of proxies scrapped
print("Total Proxies")
print(data.len)
# Print the Category of proxy from which you scrapped
print("Category of the Proxy")
print(data.category)
Sameer Narkhede
Profile : https://github.com/narkhedesam
Website : https://narkhedesam.github.io/
- https://www.sslproxies.org/
- https://www.google-proxy.net/
- https://free-proxy-list.net/anonymous-proxy.html
- https://free-proxy-list.net/uk-proxy.html
- https://www.us-proxy.org/
- https://free-proxy-list.net/
- http://spys.me/proxy.txt
-
https://proxyscrape.com/
If this project help you reduce time to develop, you can give me a cup of coffee
