nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-25 02:51:07 +00:00

250 lines
2.6 KiB
Text

80legs
AIBOT
ALittle Client
Abonti
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AlphaBot
Anarchy99
Ankit
Apexoo
Aspiegel
Attach
BLEXBot
Backlink-Ceck
BacklinkCrawler
BetaBot
Black Hole
BlackWidow
Bolt
BotALot
Brandprotect
BuiltBotTough
BuiltWith
CATExplorador
CCBot
CODE87
CheeseBot
CherryPicker
ChinaClaw
Collector
Craftbot
CrunchBot
Custo
DIIbot
DTS Agent
Demon
DigitalPebble
Discobot
DomainCrawler
DomainStatsBot
EasyDL
Ebingbong
EirGrabber
Express WebPictures
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Fimap
Flunky
Freeuploader
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GetWeb
Go-Ahead-Got-It
GrabNet
Grafula
GrapeFX
GridBot
HTMLparser
HTTP::Lite
Harvest
Havij
Hloader
Humanlinks
HybridBot
IDBot
Image Fetch
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
IstellaBot
JamesBOT
JikeSpider
Jyxobot
Kenjin Spider
LWP::Simple
Leap
LeechFTP
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
LinkWalker
LinkpadBot
LinksManager
Litemage_walker
MIDown tool
MIIxpc
Mag-Net
Masscan
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
Metauri
MicroMessenger
Minefield
Mojeek
Mozlila
Mr.4x3
Msrabot
Musobot
NICErsPRO
NPbot
Nameprotect
Navroad
NearSite
Needle
Nessus
NetAnts
NetLyzer
NetSpider
NetZIP
Netcraft
Nibbler
Nimbostratus
OpenVAS
Openfind
Openvas
OrangeBot
POE-Component-Client-HTTP
PageGrabber
PageScorer
PageThing.com
Pandalytics
PeoplePal
Petalbot
Pi-Monster
Picsearch
Piepmatz
Pimonster
Pixray
Pump
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RankurBot
Reaper
RedesScrapy
RepoMonkey
Rogerbot
SBIder
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
Scanbot
ScrepyBot
Searchestate
SemrushBot
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
SocialRankIOBot
Sociscraper
Sqlmap
Sqworm
Stripper
Sucker
SurveyBot
Teleport
TeleportPro
Telesoft
Telesphorep
The Intraformant
TheNomad
Toweyabot
Trendiction
True_Robot
TurnitinBot
URLy.Warning
Upflow
V-BOT
VB Project
VeriCiteCrawler
VidibleScraper
VoidEYE
WASALive-Bot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
WeSEE
Web Collage
Web Pix
Web Sauger
WebAuto
WebBandit
WebCopier
WebFuck
WebGo IS
WebImageCollector
WebLeacher
WebSauger
WebZIP
Webalta
WebsiteQuester
Whacker
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Xenu
Zauba
Zermelo
ZoominfoBot
ZumBot
ZyBorg
adscanner
archive.org_bot
arquivo.pt
backlink-check
cognitiveseo
crawl.sogou.com
dataforseo.com
domainsproject.org
evc-batch
heritrix
instabid
magpie-crawler
meanpathbot
mediawords
oBot
s1z.ru
scalaj-http
scan.lol
seobility
seocompany.store
seostar
serpstatbot
sitechecker.pro
sogouspider
spyfu
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
x09Mozilla
x22Mozilla
xpymep1.exe
zgrab