nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-03-20 10:07:33 +00:00

100 lines
1 KiB
Text

Alexibot
Anarchie
Anthill
Apexoo
Asterias
AwarioSmartBot
BBBike
BetaBot
Bigfoot
BlowFish
BotALot
BuiltBotTough
Bullseye
Cloud mapping
Collector
CopyRightCheck
Copyscape
CrazyWebCrawler
Custo
Demon
Deusu
Disco
Discoverybot
DomainStatsBot
Ezooms
FrontPage
GetRight
Go!Zilla
GoZilla
GrapeFX
HonoluluBot
HybridBot
IlseBot
InfoNaviRobot
IstellaBot
JikeSpider
Jorgee
JustView
LeechFTP
LexiBot
LinkScan
LinkWalker
Linkbot
LinqiaScrapeBot
MJ12bot
MQQBrowser
MTRobot
Majestic SEO
MegaIndex.ru
Metauri
Navroad
NetAnts
Nimbostratus
Openfind
OutclicksBot
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
PictureFinder
Pimonster
Probethenet
Pu_iN
PyCurl
Quick-Crawler
RSSingBot
RankActiveLinkBot
ReGet
Recorder
ScoutJet
ScrepyBot
SemanticJuice
Sosospider
Sottopop
SpaceBison
SpankBot
Spinn3r
SuperBot
Suzuran
Swiftbot
Telesphoreo
Toata
Toweyabot
Twice
V-BOT
Vacuum
Voil
WASALive-Bot
WWW-Mechanize
WebCollage
WebFuck
WebsiteQuester
ZoominfoBot
arquivo.pt
autoemailspider
backlink-check
check1.exe
netEstate NE Crawler
scan.lol
seobility
sysscan