nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2021-05-27 07:36:29 +02:00

250 lines
2.5 KiB
Text

360Spider
404checker
Aboundexbot
Acunetix
ADmantX
AiHitBot
Aipbot
Alligator
Anarchie
Anthill
Apexoo
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
BackWeb
Bandit
Barkrowler
BDCbot
BDFetch
Bigfoot
Blackboard
BLEXBot
BotALot
Buddy
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CensysInspect
CheTeam
Chlooe
coccocbot-web
Cocolyzebot
CODE87
Collector
Copier
CopyRightCheck
Cosmos
CrazyWebCrawler
Crescent
Curious
Demon
Dirbuster
Dispatch
DnyzBot
Domains Project
DomainStatsBot
DomCopBot
Dragonfly
Drip
DSearch
Ebingbong
Ecxi
EMail Wolf
EroCrawler
evc-batch
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
facebookscraper
FDM
Flunky
FrontPage
FyberSpider
Fyrebot
Gigablast
Gigabot
Go-Ahead-Got-It
GoZilla
Go!Zilla
Grafula
GrapeFX
GT::WWW
heritrix
HMView
HTMLparser
HTTP::Lite
HybridBot
Iblog
Indy Library
Intelliseek
Internet Ninja
isitwp.com
Iskanie
IstellaBot
JamesBOT
JetCar
Jetty
JikeSpider
Joomla
Jyxobot
Kenjin Spider
Larbin
LeechFTP
Lftp
Libwhisker
LieBaoFast
Linkbot
Linkdexbot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
LNSpiderguy
Ltx71
lwp-request
LWP::Simple
lwp-trivial
Mag-Net
Majestic12
Majestic SEO
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
MeanPath Bot
mediawords
MegaIndex.ru
MFC_Tear_Sample
MicroMessenger
MJ12bot
Mojeek
Mojolicious
Mozlila
Mr.4x3
Nameprotect
Nessus
NetAnts
Netcraft
NetSpider
Net Vampire
NetZIP
Nibbler
Niki-bot
Nikto
Nimbostratus
Ninja
oBot
Octopus
Offline Explorer
Openvas
PageGrabber
PageScorer
PageThing.com
Panscient
PHPCrawl
Picscout
Picsearch
Piepmatz
Pimonster
Pixray
PleaseCrawl
POE-Component-Client-HTTP
Probethenet
ProWebWalker
Pu_iN
PxBroker
Quick-Crawler
RealDownload
Reaper
RebelMouse
Ripper
ripz
RocketCrawler
s1z.ru
SalesIntelligent
satoristudio.net
SBIder
scalaj-http
Scanbot
ScreenerBot
SearchmetricsBot
Semrush
SEOkicks
SEOlyticsCrawler
serpstatbot
sexsearcher
SISTRIX
Sitebeam
SiteCheckerBotCrawler
sitechecker.pro
SiteLockSpider
SiteSucker
SMTBot
Snoopy
Sociscraper
sogouspider
Sogou web spider
Sottopop
Spanner
Spinn3r
Sqworm
Sucker
SuperBot
Surfbot
sysscan
tAkeOut
Telesphorep
TheNomad
Thumbor
TightTwatBot
Tracemyfile
Turingos
Turnitin
Typhoeus
URLy.Warning
Vacuum
Vagabondo
VB Project
VCI
VeriCiteCrawler
Voil
Wallpapers/3.0
Web Auto
WebCollage
WebCopier
WEBDAV
WebEnhancer
Web Enhancer
Web Fetch
WebFuck
WebGo IS
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
WebReaper
Web Sauger
Webshag
WebsiteQuester
WebStripper
WebSucker
WeSEE
Whacker
WinHTTrack
Wonderbot
Wprecon
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
x22Mozilla
zauba.io
Zermelo
Zeus
zgrab
ZoomBot