nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-10 10:07:36 +00:00

100 lines
1,004 B
Text

01h4x.com
360Spider
404checker
Alexibot
BLEXBot
BackWeb
Bandit
Blackboard
Brandwatch
Claritybot
Cliqzbot
Collector
CyotekWebCopy
Demon
Devil
Discobot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
Dotbot
EMail Wolf
Ebingbong
Ecxi
Express WebPictures
Ezooms
Foobot
G-i-g-a-b-o-t
GermCrawler
GetRight
Gigabot
HaosouSpider
Humanlinks
HybridBot
Iblog
IlseBot
JOC Web Spider
JamesBOT
Kozmosbot
MSIECrawler
MauiBot
Microsoft URL Control
Msrabot
Navroad
Nessus
NetLyzer
Netcraft
Niki-bot
Ninja
Piepmatz
PleaseCrawl
Psbot
PyCurl
RankFlex
ReGet
SeekportBot
Semrush
SeoSiteCheckup
SiteSucker
SmartDownload
Sosospider
Sqlworm
Surfbot
Teleport
TheNomad
Turnitin
TurnitinBot
Typhoeus
UnisterBot
Vagabondo
VoidEYE
WWW::Mechanize
WWWOFFLE
Wallpapers
WebCollage
WebImageCollector
WebPix
WebSucker
Whatweb
WiseGuys Robot
YaK
Zermelo
Zeus
Zitebot
ZmEu
ZumBot
arquivo-web-crawler
awario.com
crawler4j
instabid
meanpathbot
muhstik-scan
page scorer
polaris version
seoscanners
seostar
serpstatbot
spyfu
xpymep1.exe
zgrab