Skip to content

Commit

Permalink
updated COUNTER_Robots_list.txt based on the latest changes of COUNTE…
Browse files Browse the repository at this point in the history
…R_Robots_list.json
  • Loading branch information
Atmire-github committed Jul 22, 2020
1 parent b98e29c commit 8d73f98
Showing 1 changed file with 11 additions and 4 deletions.
15 changes: 11 additions & 4 deletions generated/COUNTER_Robots_list.txt
Original file line number Diff line number Diff line change
Expand Up @@ -49,6 +49,7 @@ cfnetwork
checklink
checkprivacy
China\sLocal\sBrowse\s2\.6
Citoid
cloakDetect
coccoc\/1\.0
Code\sSample\sWeb\sClient
Expand All @@ -73,6 +74,7 @@ Dispatch\/\d
Docoloc
docomo
Download\+Master
Drupal
DSurf
DTS Agent
EasyBib[\+\s]AutoCite[\+\s]
Expand Down Expand Up @@ -158,7 +160,7 @@ LongURL.API
ltx71
lwp
lycos[_+]
mail.ru
mail\.ru
MarcEdit
mediapartners-google
megite
Expand Down Expand Up @@ -196,14 +198,15 @@ nutch
ocelli
Offline(\s|\+)Navigator
OgScrper
^okhttp$
okhttp
onetszukaj
^Opera\/4$
OurBrowser
panscient
parsijoo
^Pattern\/\d
Pcore-HTTP
pear.php.net
pear\.php\.net
perman
PHP\/
pidcheck
Expand Down Expand Up @@ -236,6 +239,7 @@ SkypeUriPreview
slurp
sogou
speedy
sqlmap
Strider
summify
sunrise
Expand All @@ -248,7 +252,9 @@ The\+Knowledge\+AI
titan
^Traackr\.com$
Trove
Turnitin
twiceler
Typhoeus
ucsd
ultraseek
^undefined$
Expand All @@ -264,7 +270,7 @@ virus.detector
voila
^voltron$
voyager\/
w3af.org
w3af\.org
Wanadoo
Web(\s|\+)Downloader
WebCloner
Expand Down Expand Up @@ -292,3 +298,4 @@ yandex
Yeti\/\d
zeus
zyborg
7siters

0 comments on commit 8d73f98

Please sign in to comment.