nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2020-12-24 00:50:46 +02:00

250 lines
2.6 KiB
Text

360Spider
404checker
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
AlphaBot
Ankit
Aspiegel
Attach
BackDoorBot
Badass
Barkrowler
BBBike
BDCbot
Bitacle
Blackboard
BLEXBot
BlowFish
BotALot
BuiltBotTough
BuzzSumo
CATExplorador
CheeseBot
CODE87
Copyscape
Cosmos
Craftbot
crawler.feedback
crawl.sogou.com
CrunchBot
Custo
CyotekWebCopy
DataCha0s
DBLBot
Demon
Devil
Digincore
Dirbuster
Discobot
Discoverybot
DomainAppender
DomainCrawler
domainsproject.org
DomainStatsBot
Dotbot
Dragonfly
Drip
DSearch
DTS Agent
eCatch
ExtLinksBot
Extreme Picture Finder
FemtosearchBot
FlashGet
Flunky
Freeuploader
FyberSpider
GalaxyBot
Getintent
GetRight
G-i-g-a-b-o-t
Gotit
GoZilla
Go!Zilla
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
GridBot
Haansoft
Havij
Hloader
HTMLparser
HTTrack
Humanlinks
HybridBot
Iblog
IDBot
Image Fetch
Intelliseek
internetVista monitor
IRLbot
isitwp.com
Jbrofuzz
JennyBot
JetCar
JOC Web Spider
Jorgee
Jyxobot
Keyword Density
Lanshanbot
LeechFTP
LexiBot
Libwhisker
LieBaoFast
Likse
LinkextractorPro
LinkpadBot
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey Spider
LNSpiderguy
LWP::Simple
lwp-trivial
Magnet
magpie-crawler
Mail.RU_Bot
Majestic SEO
Mata Hari
MeanPath Bot
mediawords
Metauri
MFC_Tear_Sample
Microsoft Data Access
MJ12bot
Mojolicious
Morfeus Fucking Scanner
MQQBrowser
MSFrontPage
Msrabot
muhstik-scan
Musobot
Navroad
Nessus
Netcraft
NetMechanic
Nettrack
NetZIP
Niki-bot
NimbleCrawler
NPbot
Octopus
Openfind
OpenLinkProfiler
OpenVAS
OrangeSpider
Page Analyzer
Pavuk
pcBrowser
PECL::HTTP
PeoplePal
Picsearch
plumanalytics
polaris version
ProPowerBot
ProWebWalker
Pump
PyCurl
RankingBot
Rankivabot
RankurBot
RealDownload
Reaper
RebelMouse
Recorder
ReGet
Ripper
RocketCrawler
s1z.ru
satoristudio.net
ScanAlert
scan.lol
Scrapy
Screaming
SearchmetricsBot
Semrush
SemrushBot
seoscanners
SEOstats
serpstatbot
Shodan
Siphon
SiteExplorer
SiteSucker
Sitevigil
SmartDownload
Snapbot
SocialRankIOBot
sogouspider
Sogou web spider
Sosospider
sp_auditbot
SputnikBot
Sqlworm
Sqworm
Stripper
SurveyBot
sysscan
Szukacz
T0PHackTeam
tAkeOut
Teleport
Telesphoreo
Thumbor
Toata
Toweyabot
Trendiction
Trendictionbot
trendiction.de
True_Robot
Turingos
Turnitin
TwengaBot
Twice
Upflow
URLy.Warning
Virusdie
WallpapersHD
WBSearchBot
WebBandit
WEBDAV
WebEnhancer
Web Enhancer
WebFetch
Web Fuck
WebImageCollector
WebLeacher
WebPix
WebSauger
WebsiteQuester
Website Quester
WebStripper
Web Sucker
WebZIP
WeSEE
Whack
Whacker
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
Wprecon
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu
xpymep1.exe
Zade
Zermelo
Zeus
zgrab
ZmEu