nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-10-29 22:05:20 +00:00

100 lines
1 KiB
Text

404enemy
AlphaBot
Anarchie
AwarioSmartBot
BLEXBot
Badass
Bigfoot
BlowFish
Brandprotect
BuiltBotTough
Cogentbot
CopyRightCheck
Cosmos
Crawling at Home Project
CrunchBot
CyotekWebCopy
DSearch
DTS Agent
Demon
Devil
Dirbuster
Discobot
DittoSpyder
EMail Siphon
EasyDL
ExtLinksBot
FemtosearchBot
FlashGet
FyberSpider
Fyrebot
GPTBot
GT::WWW
GermCrawler
Getintent
Go!Zilla
Gotit
Grafula
HTTP::Lite
HTTrack
Harvest
InfoTekies
Iria
JikeSpider
Joomla
Kenjin Spider
LibWeb
LieBaoFast
LinkextractorPro
Litemage_walker
Ltx71
MFC_Tear_Sample
MSFrontPage
MTRobot
MarkWatch
Mr.4x3
NearSite
Nessus
NetSpider
Netcraft
Ninja
Nmap
Openvas
OrangeBot
OutclicksBot
Page Analyzer
Pimonster
RankingBot
RocketCrawler
ScreenerBot
Siphon
Site Sucker
Sitebeam
Siteimprove
Sitevigil
Snoopy
SocialRankIOBot
Sogou web spider
Sosospider
Sqlworm
Sucuri
Teleport
Telesphoreo
Toata
Turnitin
TwengaBot
URLy Warning
Wallpapers/3.0
Web Auto
WebEnhancer
WebFuck
WebLeacher
WebWhacker
Xenu
YoudaoBot
crawler.feedback
evc-batch
scalaj-http
seostar
serpstatbot
sexsearcher