nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-06-25 15:16:59 +02:00

250 lines
2.6 KiB
Text

360Spider
Aboundex
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
Alligator
AllSubmitter
Apexoo
archive.org_bot
Asterias
autoemailspider
BackStreet
Badass
Barkrowler
BDFetch
Bigfoot
Bitacle
BLEXBot
Blow
Bolt
Brandprotect
Brandwatch
BuiltWith
BunnySlippers
BuzzSumo
Cegbfeieh
CherryPicker
CheTeam
ChinaClaw
coccocbot-web
cognitiveseo
Copier
Cosmos
Craftbot
crawler4j
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
Demon
Deusu
Digincore
DigitalPebble
Discobot
DittoSpyder
DnyzBot
DomainSigmaCrawler
DomainStatsBot
Download Wonder
DTS Agent
eCatch
ECCP/1.0
Ecxi
EirGrabber
Evil
Exabot
ExtLinksBot
Extreme Picture Finder
FDM
FHscan
Firefox/7.0
FlashGet
Flunky
Foobot
FrontPage
FyberSpider
GetWeb
G-i-g-a-b-o-t
Go-Ahead-Got-It
GrapeFX
HaosouSpider
Havij
HMView
HTTrack
IDBot
Image Fetch
InfoNaviRobot
InfoTekies
Intelliseek
Internet Ninja
IstellaBot
Jbrofuzz
JennyBot
JetCar
JikeSpider
Joomla
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LeechGet
Lftp
LibWeb
Lightspeedsystems
LinkextractorPro
LinksManager
LinkWalker
LNSpiderguy
Ltx71
lwp-request
lwp-trivial
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic-SEO
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
meanpathbot
Meanpathbot
Mediatoolkitbot
mediawords
MegaIndex.ru
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIIxpc
MSIECrawler
Msrabot
Musobot
Name Intelligence
Nameprotect
Needle
NetAnts
netEstate NE Crawler
NetLyzer
NetZIP
NextGenSearchBot
NICErsPRO
NimbleCrawler
Nmap
Nutch
Offline Navigator
OnCrawl
Openfind
OpenVAS
OutclicksBot
PageAnalyzer
Page Analyzer
page scorer
PageScorer
Papa Foto
PECL::HTTP
PHPCrawl
Picscout
Picsearch
Pimonster
Pixray
PleaseCrawl
plumanalytics
ProPowerBot
Psbot
PyCurl
Quick-Crawler
RankActive
RankingBot2
RealDownload
Reaper
Recorder
Ripper
Rogerbot
SBIder
scan.lol
Searchestate
SearchmetricsBot
SemrushBot
SEOkicks
SEOkicks-Robot
seoscanners
SeoSiteCheckup
SEOstats
Shodan
Sitebeam
SiteExplorer
SiteLockSpider
SiteSnagger
SmartDownload
SMTBot
Sociscraper
sogouspider
Sogou web spider
SpaceBison
SpankBot
SputnikBot
Sqlworm
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
sysscan
Szukacz
T0PHackTeam
T8Abot
tAkeOut
Teleport
Telesphoreo
TightTwatBot
Titan
Toata
Trendiction
Trendictionbot
trendiction.de
True_Robot
TurnitinBot
TwengaBot
Typhoeus
UnisterBot
URLy Warning
Vacuum
VCI
VeriCiteCrawler
Wallpapers/3.0
WallpapersHD
WBSearchBot
WebBandit
Web Collage
Web Enhancer
Web Fetch
WebmasterWorldForumBot
WebPix
WebReaper
WebSauger
Webshag
WebsiteExtractor
WebSucker
WebWhacker
WebZIP
WeSEE
Whack
Whatweb
Who.is Bot
Widow
WiseGuys Robot
Wonderbot
Woobot
WWW-Collector-E
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
Zermelo
ZmEu