nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-07-25 20:06:24 +02:00

250 lines
2.6 KiB
Text

404enemy
Abonti
Aboundex
Aboundexbot
Acunetix
ADmantX
AIBOT
AiHitBot
Aipbot
Alexibot
Alligator
AllSubmitter
AlphaBot
Apexoo
backlink-check
BackStreet
BackWeb
Badass
Battleztar Bazinga
BBBike
BetaBot
Bigfoot
Black Hole
BlackWidow
Blow
Bolt
Brandprotect
Brandwatch
Bullseye
CheeseBot
CherryPicker
CheTeam
Claritybot
cognitiveseo
com.plumanalytics
CopyRightCheck
Cosmos
Craftbot
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CrunchBot
Devil
DigitalPebble
DIIbot
Dirbuster
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DSearch
DTS Agent
ECCP/1.0
EroCrawler
evc-batch
ExtLinksBot
Extreme Picture Finder
EyeNetIE
facebookscraper
FDM
FemtosearchBot
FHscan
Fimap
Flunky
Foobot
Freeuploader
FyberSpider
GalaxyBot
GermCrawler
Getintent
GetRight
GetWeb
G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla
GrapeFX
Heritrix
HTTrack
Humanlinks
HybridBot
Iblog
IlseBot
Image Sucker
InfoTekies
Intelliseek
Internet Ninja
InternetSeer
Iria
IRLbot
JikeSpider
JOC Web Spider
Joomla
Kozmosbot
LeechFTP
LexiBot
Likse
Linkdexbot
LinkextractorPro
LinkpadBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Ltx71
Mag-Net
Majestic-SEO
Masscan
MeanPath Bot
Mediatoolkitbot
Metauri
MFC_Tear_Sample
Microsoft URL Control
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
MSIECrawler
Msrabot
MS Web Services Client Protocol
Name Intelligence
Nameprotect
NearSite
netEstate NE Crawler
NetZIP
NextGenSearchBot
Nikto
NimbleCrawler
Nimbostratus
Nutch
oBot
Offline Navigator
OnCrawl
OpenVAS
OutclicksBot
OutfoxBot
PageAnalyzer
Page Analyzer
PageGrabber
page scorer
PageScorer
Pavuk
pcBrowser
PECL::HTTP
PeoplePal
Pi-Monster
PleaseCrawl
Pockey
POE-Component-Client-HTTP
ProWebWalker
PyCurl
QueryN Metasearch
Quick-Crawler
RankFlex
RankingBot
RealDownload
Reaper
RebelMouse
Recorder
ReGet
RepoMonkey
ScanAlert
Scanbot
ScoutJet
Searchestate
Semrush
SemrushBot
SEOlyticsCrawler
SEOstats
Siphon
Sitebeam
SiteExplorer
SiteLockSpider
SiteSucker
Site Sucker
SMTBot
Snake
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Spammen
SputnikBot
spyfu
Sqlworm
Sucker
Sucuri
SuperBot
SuperHTTP
SurveyBot
Swiftbot
sysscan
Szukacz
T8Abot
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
trendiction.com
trendiction.de
True_Robot
TwengaBot
Twice
Typhoeus
URLy Warning
URLy.Warning
Vacuum
VCI
VoidEYE
Voil
Voltron
WASALive-Bot
WebAuto
WebBandit
WebCollage
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebLeacher
WebmasterWorldForumBot
WebReaper
Webshag
WebsiteExtractor
Website Quester
WebStripper
WebSucker
WeSEE
Widow
WinHTTrack
WISENutbot
Wotbox
Wprecon
WWW-Collector-E
WWW-Mechanize
Xenu
xpymep1.exe
Zade
zauba.io
Zermelo
Zeus
zgrab
ZmEu
ZyBorg