nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-07-01 10:49:28 +02:00

250 lines
2.6 KiB
Text

Aboundexbot
Acunetix
ADmantX
AiHitBot
Alexibot
AllSubmitter
Anarchie
archive.org_bot
ASPSeek
Attach
autoemailspider
BacklinkCrawler
BackStreet
Badass
Barkrowler
BatchFTP
BDCbot
BetaBot
Bitacle
Black Hole
BlackWidow
BLEXBot
Blow
BlowFish
Boardreader
BotALot
Brandprotect
BuiltBotTough
Bullseye
CATExplorador
Cliqzbot
Collector
com.plumanalytics
Copyscape
Cosmos
Craftbot
crawler4j
CrazyWebCrawler
Curious
Custo
demandbase-bot
Demon
Deusu
DigitalPebble
DIIbot
Disco
Dispatch
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
eCatch
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
Evil
Exabot
Express WebPictures
ExtLinksBot
EyeNetIE
Fimap
FlashGet
Flunky
Foobot
FyberSpider
Fyrebot
GalaxyBot
Getintent
Gigabot
G-i-g-a-b-o-t
Go!Zilla
Grabber
GrabNet
GrapeFX
GridBot
HaosouSpider
Harvest
Havij
HTTrack
Humanlinks
Id-search
Image Fetch
Image Sucker
IndeedBot
InterGET
Internet Ninja
internetVista monitor
ips-agent
Iskanie
IstellaBot
JamesBOT
Jetty
JOC Web Spider
Keyword Density
Kozmosbot
Lftp
Libwhisker
Likse
Linkdexbot
LinkextractorPro
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
LNSpiderguy
lwp-request
lwp-trivial
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic SEO
MarkMonitor
Masscan
Mass Downloader
Mata Hari
Meanpathbot
MeanPath Bot
Metauri
Microsoft Data Access
Microsoft URL Control
MIDown tool
MIIxpc
Mister PiX
MJ12bot
Mojeek
Mr.4x3
MSIECrawler
Name Intelligence
Nameprotect
Navroad
Nessus
netEstate NE Crawler
NetMechanic
NetSpider
Netvibes
NextGenSearchBot
NimbleCrawler
Nmap
oBot
Openfind
OpenLinkProfiler
OpenVAS
OrangeBot
OrangeSpider
OutfoxBot
PageGrabber
page scorer
PageScorer
Panscient
Papa Foto
PECL::HTTP
PeoplePal
PictureFinder
ProWebWalker
PyCurl
RankActive
RankFlex
RankingBot2
Rankivabot
Reaper
Recorder
RedesScrapy
Rogerbot
ScanAlert
scan.lol
ScoutJet
Screaming
Searchestate
SEOkicks-Robot
Seomoz
SEOprofiler
seoscanners
SEOstats
Siphon
SISTRIX
SMTBot
Snake
sogouspider
Sogou web spider
Spammen
Spanner
SputnikBot
Sqlmap
Sqlworm
Sqworm
Stripper
SuperHTTP
Surfbot
Swiftbot
T8Abot
tAkeOut
Telesoft
Telesphorep
Thumbor
TightTwatBot
Titan
Toata
Trendiction
Trendictionbot
trendiction.com
Turingos
TurnitinBot
TwengaBot
URLy Warning
URLy.Warning
Vacuum
Vagabondo
VCI
Virusdie
Wallpapers/3.0
Webalta
WebAuto
Web Auto
WebCollage
Web Enhancer
WebFetch
WebFuck
Web Fuck
WebGo IS
WebLeacher
WebmasterWorldForumBot
Web Pix
WebReaper
WebSauger
Web Sucker
Whack
Widow
WinHTTrack
WiseGuys Robot
Woobot
WPScan
WWW-Collector-E
WWW-Mechanize
x09Mozilla
x22Mozilla
Zade
Zauba
Zermelo
Zitebot
ZmEu