nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-19 14:23:20 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
80legs
AIBOT
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
Alligator
AlphaBot
Anarchie
Anarchy99
Apexoo
Asterias
AwarioSmartBot
BDFetch
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Bandit
Bitacle
BotALot
Brandprotect
Buddy
CCBot
CSHttp
CazoodleBot
Cegbfeieh
CheeseBot
CherryPicker
Chlooe
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Cosmos
CrazyWebCrawler
DBLBot
DIIbot
DataCha0s
Devil
Digincore
Discoverybot
Dispatch
DnyzBot
DomCopBot
DomainAppender
DomainSigmaCrawler
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EMail Wolf
Ecxi
EirGrabber
EroCrawler
Exabot
ExtractorPro
Fuzz
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GetRight
GetWeb
Gigabot
GrapeFX
GrapeshotCrawler
HEADMasterSEO
Haansoft
Hloader
IRLbot
Iblog
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
InterGET
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
Jbrofuzz
Jetty
JustView
Kenjin Spider
Keyword Density
Kinza
Lanshanbot
LexiBot
LibWeb
Lightspeedsystems
Likse
Linkbot
Linkdexbot
LinkpadBot
LinksManager
Lipperhey Spider
MFC_Tear_Sample
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkMonitor
Masscan
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Morfeus Fucking Scanner
Mozlila
Msrabot
Name Intelligence
Nameprotect
Navroad
NearSite
Net Vampire
NetMechanic
NetSpider
NetZIP
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Nimbostratus
Nuclei
OPPO A33
Offline Explorer
Openfind
Openvas
OrangeSpider
OutfoxBot
PHPCrawl
Page Analyzer
PageThing.com
Pi-Monster
PictureFinder
Pixray
ProPowerBot
ProWebWalker
Pu_iN
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot
Rankivabot
ReGet
RealDownload
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks-Robot
SISTRIX
ScoutJet
ScreenerBot
Semrush
Site Sucker
SiteExplorer
SiteLockSpider
SiteSucker
Siteimprove
Sitevigil
Snapbot
Sogou web spider
Sosospider
SpaceBison
Spammen
Spbot
Sqlworm
Sqworm
Stripper
Sucuri
SuperBot
Suzuran
Swiftbot
Teleport
The Intraformant
TightTwatBot
Toata
True_Robot
Turnitin
Twice
UnisterBot
Upflow
VCI
VoidEYE
Voil
WASALive-Bot
WISENutbot
WWW-Mechanize
WWWOFFLE
WeSEE
Web Fuck
Web Pix
Web Sauger
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebSucker
WebWhacker
Webshag
Website Quester
WebsiteQuester
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
ZoomBot
arquivo-web-crawler
arquivo.pt
autoemailspider
crawler.feedback
gopher
internetVista monitor
lwp-request
lwp-trivial
mediawords
pcBrowser
plumanalytics
ripz
s1z.ru
scalaj-http
seobility
seoscanners
seostar
siteripz
sp_auditbot
trendiction.com
zauba.io
zgrab