nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-12-15 22:07:30 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
ADmantX
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Anarchie
Anarchy
Anarchy99
Ankit
Anthill
Apexoo
Asterias
AwarioSmartBot
BBBike
Bandit
Battleztar Bazinga
BlackWidow
BlowFish
Boardreader
Brandprotect
Buck
BuiltBotTough
BuiltWith
BunnySlippers
CCBot
CODE87
CSHttp
Calculon
CheeseBot
Chlooe
Cloud mapping
Cocolyzebot
CopyRightCheck
Cosmos
Crescent
Curious
DSearch
DataCha0s
Devil
Dirbuster
Discoverybot
Dispatch
DomainAppender
DomainCrawler
Domains Project
Dotbot
Download Wonder
Drip
ECCP/1.0
EasyDL
Ecxi
EroCrawler
Ezooms
FDM
Fimap
Flunky
FyberSpider
G-i-g-a-b-o-t
Gigabot
Go-Ahead-Got-It
Grafula
GrapeFX
GridBot
HTMLparser
HonoluluBot
HybridBot
IRLbot
Iblog
Image Fetch
Image Sucker
InfoTekies
Internet Ninja
InternetSeer
Iria
IstellaBot
JOC Web Spider
JennyBot
Jetty
JikeSpider
Kinza
LNSpiderguy
LWP::Simple
Linkbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
MQQBrowser
MSFrontPage
Majestic SEO
Majestic-SEO
MarkWatch
Masscan
Mata Hari
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Mister PiX
Morfeus Fucking Scanner
NICErsPRO
Name Intelligence
NearSite
Needle
NetMechanic
NetZIP
Niki-bot
Ninja
Nmap
Not
OnCrawl
Openfind
Openvas
PECL::HTTP
PHPCrawl
Page Analyzer
PageAnalyzer
Pandalytics
Panscient
Papa Foto
Pi-Monster
Picscout
PictureFinder
Piepmatz
Pimonster
PleaseCrawl
ProPowerBot
ProWebWalker
Probethenet
Pump
RSSingBot
RankFlex
RankingBot2
RankurBot
RedesScrapy
RepoMonkey
Ripper
Rogerbot
SBIder
SEOkicks
SMTBot
SalesIntelligent
ScrepyBot
Searchestate
SemanticJuice
SentiBot
SeoSiteCheckup
SeobilityBot
Siphon
Site Sucker
SiteCheckerBotCrawler
Sitevigil
SpaceBison
Spanner
Spbot
Steeler
Stripper
Surfbot
Szukacz
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesoft
Telesphoreo
Telesphorep
Titan
Toweyabot
Trendiction
TurnitinBot
Twice
URLy Warning
URLy.Warning
UnisterBot
VB Project
VCI
VeriCiteCrawler
Virusdie
VoidEYE
WASALive-Bot
WEBDAV
WISENutbot
WWW::Mechanize
Wallpapers
WeSEE
Web Pix
Web Sucker
WebAuto
WebCopier
WebEnhancer
WebGo IS
WebImageCollector
WebLeacher
WebSauger
WebmasterWorldForumBot
Website Quester
Webster
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
YoudaoBot
Zade
Zauba
Zeus
ZmEu
ZoomBot
ZumBot
adscanner
arquivo-web-crawler
arquivo.pt
backlink-check
cah.io.community
coccocbot
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
gopher
heritrix
isitwp.com
lwp-request
mediawords
oBot
page scorer
probe-image-size
ripz
s1z.ru
scalaj-http
seobility
seocompany.store
seoscanners
seostar
sexsearcher
sitechecker.pro
siteripz
sogouspider
ubermetrics-technologies.com
voyagerx.com
webprosbot
xpymep1.exe