nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-10-09 10:30:18 +02:00

250 lines
2.5 KiB
Text

404checker
404enemy
80legs
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AIBOT
Alexibot
Alligator
archive.org_bot
ASPSeek
Attach
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BackWeb
BatchFTP
BDCbot
BDFetch
BetaBot
Blackboard
Black Hole
BlackWidow
BLEXBot
BotALot
Buddy
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CazoodleBot
CherryPicker
ChinaClaw
Cliqzbot
Cloud mapping
Collector
Copyscape
Craftbot
crawl.sogou.com
CrazyWebCrawler
DBLBot
Demon
Deusu
Devil
DigitalPebble
DIIbot
Dirbuster
Discobot
Dispatch
DittoSpyder
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Download Wonder
DTS Agent
EasyDL
eCatch
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
Evil
Exabot
Extractor
facebookscraper
FDM
FlashGet
Foobot
FrontPage
Genieo
GermCrawler
Getintent
GetWeb
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
Grabber
Grafula
Heritrix
Hloader
HMView
HTTP::Lite
HTTrack
Humanlinks
Iblog
IDBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
instabid
InterGET
InternetSeer
internetVista monitor
IRLbot
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jetty
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LexiBot
Lftp
Linkdexbot
LinkScan
LinkWalker
LinqiaScrapeBot
Lmspider
LNSpiderguy
Ltx71
lwp-request
LWP::Simple
Mail.RU_Bot
Majestic12
MarkMonitor
Mata Hari
Mediatoolkitbot
mediawords
Metauri
MFC_Tear_Sample
Microsoft Data Access
Musobot
Navroad
Needle
Nessus
NetAnts
netEstate NE Crawler
NetMechanic
Net Vampire
NICErsPRO
Nikto
Nimbostratus
oBot
Octopus
Offline Navigator
OpenVAS
OutfoxBot
Pandalytics
Panscient
Papa Foto
PECL::HTTP
Picsearch
PictureFinder
Pi-Monster
PleaseCrawl
Probethenet
ProWebWalker
PyCurl
RankActiveLinkBot
RankFlex
RankingBot2
Rankivabot
RealDownload
Recorder
RedesScrapy
RSSingBot
SalesIntelligent
SBIder
scan.lol
Screaming
SEOkicks
seoscanners
SEOstats
serpstatbot
sexsearcher
Shodan
Siphon
Sitebeam
Siteimprove
SiteSnagger
SiteSucker
Site Sucker
SlySearch
Snapbot
Snoopy
Spammen
SpankBot
Spanner
sp_auditbot
spyfu
Sqlmap
Sqlworm
Stripper
SuperHTTP
Surfbot
Swiftbot
sysscan
T0PHackTeam
tAkeOut
Telesoft
TheNomad
Thumbor
TightTwatBot
Titan
Toata
trendiction.de
True_Robot
Turnitin
TwengaBot
Upflow
URLy Warning
Vacuum
VCI
VeriCiteCrawler
VoidEYE
Voltron
WASALive-Bot
Webalta
WebAuto
Web Auto
WebBandit
WebCopier
WebEnhancer
Web Enhancer
Web Fetch
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Pix
WebReaper
WebSauger
Webshag
WebStripper
WebSucker
Web Sucker
WebWhacker
Whack
WiseGuys Robot
Wonderbot
Wotbox
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
x09Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu
zauba.io
Zermelo
Zeus