nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-10 10:09:18 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
80legs
AIBOT
ALittle Client
ASPSeek
Abonti
AiHitBot
Aipbot
Alexibot
Alligator
Anarchy
Anthill
Asterias
Attach
AwarioRssBot
BackStreet
BackWeb
Badass
Barkrowler
Battleztar Bazinga
BlackWidow
Blackboard
Bolt
BotALot
Buddy
BuiltBotTough
CazoodleBot
CheeseBot
Claritybot
Cloud mapping
Cogentbot
CopyRightCheck
Curious
DBLBot
DTS Agent
DatabaseDriverMysqli
Dirbuster
Disco
DittoSpyder
DnyzBot
DomCopBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Ebingbong
Ecxi
Evil
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
FlashGet
Fuzz
FyberSpider
Genieo
GetRight
Go!Zilla
Go-Ahead-Got-It
GrabNet
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
HTTrack
Harvest
Hloader
HonoluluBot
Humanlinks
HybridBot
IDBTE4M
IDBot
Image Fetch
Image Sucker
InfoTekies
Intelliseek
InternetSeer
Iria
JOC Web Spider
JamesBOT
JennyBot
JetCar
Joomla
Jorgee
Jyxobot
Keyword Density
LNSpiderguy
Larbin
Leap
LeechGet
Libwhisker
LieBaoFast
Likse
Linkbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
Lmspider
Ltx71
MJ12bot
MSIECrawler
Majestic12
MarkWatch
MeanPath Bot
MegaIndex.ru
Mozlila
Mr.4x3
NPbot
Name Intelligence
NetAnts
NetLyzer
NetMechanic
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Not
Octopus
OnCrawl
OpenVAS
Openfind
OrangeBot
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
Pandalytics
Panscient
Pavuk
Pi-Monster
Piepmatz
Pimonster
Pixray
PleaseCrawl
ProPowerBot
Pu_iN
PxBroker
PyCurl
Quick-Crawler
ReGet
RealDownload
Reaper
RebelMouse
RedesScrapy
RepoMonkey
SEOlyticsCrawler
SEOstats
SMTBot
ScanAlert
Searchestate
Semrush
SemrushBot
SeobilityBot
Site Sucker
SiteCheckerBotCrawler
Siteimprove
Snake
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider
SpaceBison
Spammen
SpankBot
Sqworm
Stripper
Sucuri
SurveyBot
Szukacz
Teleport
Telesoft
Telesphoreo
TheNomad
Thumbor
Trendiction
True_Robot
URLy Warning
URLy.Warning
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
Virusdie
WASALive-Bot
WBSearchBot
WISENutbot
WWW-Collector-E
Wallpapers/3.0
Web Collage
Web Fetch
Web Pix
WebAuto
WebCopier
WebFetch
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSucker
Webalta
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
Wonderbot
Woobot
Zeus
Zitebot
ZoomBot
adscanner
arquivo.pt
backlink-check
coccocbot
cognitiveseo
crawl.sogou.com
domainsproject.org
internetVista monitor
ips-agent
magpie-crawler
meanpathbot
page scorer
polaris version
ripz
satoristudio.net
seobility
seostar
sexsearcher
sp_auditbot
spyfu
sysscan
trendiction.de
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webprosbot
x22Mozilla
zauba.io
zgrab