nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-27 22:04:55 +00:00

100 lines
1.1 KiB
Text

01h4x.com
Aboundexbot
Anarchy
Backlink-Ceck
Battleztar Bazinga
Boardreader
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
Copyscape
Cosmos
DTS Agent
DatabaseDriverMysqli
DittoSpyder
Domains Project
Drip
ECCP/1.0
FacebookBot
GetWeb
Grafula
GrapeFX
HMView
HaosouSpider
InternetMeasurement
InternetSeer
JOC Web Spider
Keyword Density
Kinza
LNSpiderguy
LeechFTP
LinkWalker
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lmspider
Ltx71
MFC_Tear_Sample
MQQBrowser
Mail.RU_Bot
Majestic-SEO
MauiBot
MicroMessenger
Mojeek
Musobot
Name Intelligence
Nameprotect
Needle
Netcraft
Nuclei
Nutch
Offline Navigator
OpenLinkProfiler
Openvas
PageAnalyzer
PictureFinder
Probethenet
Pu_iN
RankingBot2
Rankivabot
RankurBot
ReGet
RealDownload
Rogerbot
SEOlyticsCrawler
Scanbot
Searchestate
SemrushBot
Sitebeam
Sqlworm
Stripper
Turnitin
Twice
URLy.Warning
V-BOT
VCI
VoidEYE
Voil
WWW-Mechanize
WWW::Mechanize
WebFetch
WebLeacher
WebReaper
WebWhacker
WebZIP
WebmasterWorldForumBot
Webster
Whack
WiseGuys Robot
Zade
ZumBot
arquivo-web-crawler
imagesift.com
omgili
s1z.ru
scalaj-http
seocompany.store
sp_auditbot
voyagerx.com
webmeup-crawler