nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-07-03 15:19:09 +02:00

250 lines
2.5 KiB
Text

360Spider
404checker
80legs
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AIBOT
AiHitBot
Alexibot
Alligator
AllSubmitter
AlphaBot
Anarchie
ASPSeek
Asterias
Attach
BackStreet
BackWeb
Barkrowler
BetaBot
Bitacle
Blackboard
Black Hole
BlackWidow
Blow
BlowFish
Boardreader
Bolt
Brandprotect
Buddy
BuiltWith
BunnySlippers
Calculon
CATExplorador
CazoodleBot
Cegbfeieh
Claritybot
Cliqzbot
Cogentbot
cognitiveseo
CopyRightCheck
Cosmos
crawler4j
CrazyWebCrawler
CrunchBot
CSHttp
Curious
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
DIIbot
Discobot
Discoverybot
Dispatch
DomainCrawler
DTS Agent
EasyDL
Ebingbong
eCatch
EirGrabber
EroCrawler
evc-batch
Exabot
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
facebookscraper
FDM
FHscan
Flunky
FyberSpider
GalaxyBot
Genieo
Gotit
GoZilla
GrabNet
GrapeFX
GrapeshotCrawler
GT::WWW
HaosouSpider
Harvest
Havij
Iblog
IDBot
Id-search
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
instabid
Intelliseek
Iria
IRLbot
Iskanie
IstellaBot
JamesBOT
JetCar
Jetty
JOC Web Spider
Joomla
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LexiBot
Lftp
Lightspeedsystems
Likse
LinkextractorPro
LinkpadBot
LinkScan
LinksManager
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
Mag-Net
magpie-crawler
Majestic12
Majestic-SEO
MarkMonitor
MarkWatch
Masscan
meanpathbot
Meanpathbot
MJ12bot
Morfeus Fucking Scanner
MS Web Services Client Protocol
muhstik-scan
Musobot
Nameprotect
Navroad
NearSite
Nessus
NetAnts
NetSpider
Netvibes
Niki-bot
NPbot
oBot
Openvas
OpenVAS
Page Analyzer
PageGrabber
Papa Foto
pcBrowser
PECL::HTTP
Picscout
Pixray
PleaseCrawl
POE-Component-Client-HTTP
Probethenet
Psbot
QueryN Metasearch
RankActive
RankingBot2
Rankivabot
RankurBot
RealDownload
RebelMouse
Ripper
SBIder
Scanbot
ScoutJet
Screaming
Semrush
SEOkicks
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
serpstatbot
SiteSnagger
SlySearch
Snake
Snapbot
Snoopy
Sosospider
Sottopop
Spammen
Spanner
sp_auditbot
Sqlmap
Sqlworm
Sqworm
Stripper
Sucker
SuperBot
Swiftbot
T0PHackTeam
T8Abot
The Intraformant
TheNomad
TightTwatBot
Titan
Tracemyfile
Trendictionbot
trendiction.de
Turingos
TurnitinBot
TwengaBot
Twice
UnisterBot
Upflow
URLy Warning
URLy.Warning
Vagabondo
VB Project
Virusdie
Wallpapers/3.0
WBSearchBot
Web Collage
WebEnhancer
WebFetch
Web Fetch
WebFuck
WebPix
WebReaper
Web Sauger
Website Quester
Webster
WebStripper
Web Sucker
WebWhacker
Whack
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
WISENutbot
Wonderbot
Wotbox
Wprecon
WPScan
WWW-Mechanize
WWW::Mechanize
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zermelo
ZmEu
ZumBot