nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-12 10:09:11 +00:00

250 lines
2.6 KiB
Text

360Spider
AIBOT
ALittle Client
ASPSeek
Abonti
Aboundexbot
AiHitBot
Aipbot
Alexibot
AllSubmitter
Anarchy99
Aspiegel
BDCbot
BDFetch
BackStreet
BackWeb
BacklinkCrawler
BetaBot
BlackWidow
Boardreader
Bolt
BuzzSumo
CATExplorador
Calculon
CazoodleBot
CheTeam
CherryPicker
Chlooe
Claritybot
Cliqzbot
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
Crescent
Custo
DSearch
DataCha0s
Deusu
Devil
Digincore
DigitalPebble
Dispatch
DittoSpyder
DomCopBot
DomainStatsBot
Domains Project
Download Wonder
EasyDL
Ecxi
Express WebPictures
Extractor
Extreme Picture Finder
Ezooms
FDM
FyberSpider
G-i-g-a-b-o-t
Genieo
GermCrawler
GetRight
GetWeb
Getintent
Go!Zilla
Grabber
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
Haansoft
Heritrix
Hloader
Humanlinks
HybridBot
IRLbot
Iblog
IlseBot
Image Fetch
InfoNaviRobot
Intelliseek
InterGET
IstellaBot
JOC Web Spider
Jbrofuzz
JennyBot
JetCar
Jetty
Joomla
Jorgee
JustView
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
Larbin
Lftp
LibWeb
Likse
LinkScan
Linkbot
Linkdexbot
LinkpadBot
LinksManager
Lipperhey Spider
Lmspider
MJ12bot
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
Mass Downloader
Masscan
Meanpathbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mister PiX
Morfeus Fucking Scanner
Mozlila
Msrabot
Musobot
NICErsPRO
Nameprotect
NearSite
NetAnts
NetZIP
NextGenSearchBot
Nibbler
Nutch
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openfind
Openvas
OrangeSpider
OutclicksBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
Pandalytics
Pavuk
Petalbot
Pi-Monster
Piepmatz
ProPowerBot
ProWebWalker
Probethenet
Psbot
Pu_iN
PyCurl
RankActive
Re-re
RebelMouse
Recorder
Ripper
RocketCrawler
SEOkicks
SEOlyticsCrawler
ScanAlert
Scrapy
Screaming
ScrepyBot
SearchmetricsBot
SemrushBot
SentiBot
SeoSiteCheckup
SiteExplorer
SiteLockSpider
SiteSnagger
Siteimprove
SlySearch
Snapbot
SocialRankIOBot
Sogou web spider
Spammen
SpankBot
Spbot
Spinn3r
Sqlworm
Sucker
SuperHTTP
Surfbot
Suzuran
Szukacz
TeleportPro
Telesphoreo
TheNomad
TightTwatBot
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turingos
TwengaBot
Vagabondo
VelenPublicWebCrawler
Virusdie
Voil
Voltron
WASALive-Bot
WWW-Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
WeSEE
Web Auto
Web Fetch
Web Fuck
Web Pix
WebAuto
WebCollage
WebFuck
WebSucker
WebmasterWorldForumBot
Whacker
Whatweb
WinHTTrack
WiseGuys Robot
Wonderbot
Xenu
Zermelo
Zeus
ZoomBot
cah.io.community
coccocbot-web
cognitiveseo
crawler.feedback
evc-batch
facebookscraper
gopher
internetVista monitor
ips-agent
isitwp.com
lwp-trivial
mediawords
muhstik-scan
oBot
page scorer
polaris version
s1z.ru
seobility
seocompany.store
serpstatbot
sexsearcher
sp_auditbot
tAkeOut
x09Mozilla
x22Mozilla