nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-23 22:07:10 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404checker
404enemy
80legs
Abonti
AhrefsBot
Aipbot
Alligator
AlphaBot
Anarchie
Anarchy
Anthill
Asterias
Atomseobot
AwarioSmartBot
BDCbot
BLEXBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
Badass
BatchFTP
Blackboard
BlowFish
Boardreader
Bolt
BotALot
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CCBot
CSHttp
CheTeam
Citoid
Claritybot
Collector
Copier
Craftbot
CrunchBot
Custo
DBLBot
DataCha0s
DigitalPebble
Dirbuster
Discoverybot
DittoSpyder
DomainAppender
DomainSigmaCrawler
ECCP/1.0
EasyDL
Ebingbong
Exabot
ExtLinksBot
Extractor
Ezooms
FDM
FemtosearchBot
Firefox/7.0
FlashGet
Foobot
Fuzz
GT::WWW
GalaxyBot
GetRight
GetWeb
Gigabot
Go!Zilla
Go-Ahead-Got-It
Gotit
Grabber
HEADMasterSEO
HMView
HTMLparser
Haansoft
HaosouSpider
HonoluluBot
IDBot
IRLbot
Id-search
IlseBot
Image Fetch
Indy Library
InterGET
InternetSeer
IstellaBot
JetCar
Jetty
JikeSpider
Jorgee
JustView
Kenjin Spider
Keyword Density
Kozmosbot
LWP::Simple
LeechGet
LinkScan
Linkbot
LinkpadBot
LinksManager
Lipperhey
MFC_Tear_Sample
MIDown tool
MIIxpc
MQQBrowser
MSIECrawler
Mail.RU_Bot
Majestic12
MarkMonitor
MarkWatch
Meanpathbot
MicroMessenger
Moblie Safari
MolokaiBot
Musobot
NearSite
Net Vampire
NetLyzer
NetMechanic
NetSpider
NetZIP
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Nimbostratus
Ninja
Not
Nutch
Offline Navigator
OnCrawl
PECL::HTTP
PHPCrawl
PageAnalyzer
PageGrabber
PageThing.com
Petalbot
Picscout
Pixray
Pockey
Pu_iN
PyCurl
RSSingBot
RankingBot2
Rankivabot
Recorder
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SEOkicks
SEOstats
SMTBot
ScanAlert
ScrepyBot
Searchestate
Seekport
SemrushBot
SeobilityBot
SiteSucker
SlySearch
Sociscraper
Sogou web spider
Sosospider
Sottopop
SpankBot
SputnikBot
Sucuri
SuperBot
SurveyBot
Suzuran
Szukacz
T0PHackTeam
TeleportPro
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Titan
Tracemyfile
TwengaBot
URLy.Warning
Upflow
V-BOT
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
Voil
Voltron
WBSearchBot
WEBDAV
WISENutbot
Wallpapers/3.0
Web Auto
Web Fuck
Web Sucker
WebCollage
WebCopier
WebFetch
WebLeacher
WebPix
WebStripper
WebSucker
WebWhacker
Website Quester
Whacker
Whatweb
Who.is Bot
Wotbox
Wprecon
Xaldon WebSpider
Zauba
ZumBot
ZyBorg
archive.org_bot
backlink-check
clark-crawler
coccocbot
crawl.sogou.com
crawler.feedback
facebookscraper
gopher
internetVista monitor
lwp-request
oBot
plumanalytics
scan.lol
seobility
seoscanners
seostar
sexsearcher
sitechecker.pro
siteripz
sp_auditbot
sysscan
tAkeOut
ubermetrics-technologies.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
xpymep1.exe
zgrab