nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-21 10:09:23 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
AIBOT
ASPSeek
Abonti
AiHitBot
Alligator
Anarchie
Anarchy
Anthill
Aspiegel
Atomseobot
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
BlackWidow
Blackboard
Buck
BuiltBotTough
CODE87
CSHttp
Calculon
Cegbfeieh
CheTeam
CheeseBot
ChinaClaw
Claritybot
Cliqzbot
CopyRightCheck
Cosmos
Crescent
Curious
DIIbot
DSearch
DatabaseDriverMysqli
Digincore
Disco
Discoverybot
DomainAppender
DomainCrawler
Domains Project
Dotbot
ECCP/1.0
EMail Wolf
Ecxi
EirGrabber
Ezooms
FlashGet
Flunky
Freeuploader
Fuzz
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetWeb
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
Grafula
GridBot
HMView
HTMLparser
HTTP::Lite
Harvest
Hloader
HybridBot
Iblog
IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek
Internet Ninja
Iria
Jetty
JikeSpider
Jorgee
Jyxobot
Kenjin Spider
Kozmosbot
LNSpiderguy
Larbin
Lightspeedsystems
Likse
LinksManager
LinqiaScrapeBot
Lmspider
MIDown tool
MJ12bot
MQQBrowser
MSIECrawler
Magnet
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
Mass Downloader
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft URL Control
Moblie Safari
NICErsPRO
Nameprotect
Needle
Net Vampire
NetLyzer
Netcraft
Nettrack
NextGenSearchBot
Nikto
Nimbostratus
Ninja
Not
Openfind
OrangeBot
OutfoxBot
PECL::HTTP
PageScorer
Panscient
Pavuk
Picscout
Picsearch
PleaseCrawl
ProWebWalker
Pu_iN
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot2
ReGet
Reaper
Recorder
RedesScrapy
Ripper
Rogerbot
SBIder
SEOlyticsCrawler
SEOstats
SISTRIX
SMTBot
SalesIntelligent
ScrepyBot
SemanticJuice
Semrush
SeoSiteCheckup
Seomoz
Siphon
Site Sucker
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Snake
Snapbot
SocialRankIOBot
SpaceBison
SpankBot
Spinn3r
Sqlworm
Sqworm
Sucker
Sucuri
SuperHTTP
Surfbot
Suzuran
Swiftbot
T0PHackTeam
T8Abot
TightTwatBot
Titan
True_Robot
Turingos
V-BOT
VelenPublicWebCrawler
VeriCiteCrawler
WASALive-Bot
WISENutbot
WWW::Mechanize
WeSEE
Web Pix
Web Sucker
WebAuto
WebBandit
WebCopier
WebFetch
Webshag
Website Quester
Webster
Whacker
Whatweb
WinHTTrack
WiseGuys Robot
Wonderbot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zauba
Zermelo
ZumBot
adscanner
archive.org_bot
arquivo.pt
backlink-check
check1.exe
cognitiveseo
crawl.sogou.com
crawler.feedback
crawler4j
eCatch
facebookscraper
gopher
heritrix
internetVista monitor
ips-agent
linkdexbot
lwp-request
lwp-trivial
muhstik-scan
netEstate NE Crawler
pcBrowser
satoristudio.net
scan.lol
seobility
seoscanners
seostar
sexsearcher
sp_auditbot
sysscan
tAkeOut
trendiction.com
trendiction.de
x22Mozilla
zgrab