nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-04 22:07:28 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
AIBOT
ALittle Client
ASPSeek
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
AllSubmitter
Anarchy99
Anthill
Apexoo
BDFetch
BLEXBot
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
Blackboard
Blow
BlowFish
Brandwatch
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CazoodleBot
CheTeam
Chlooe
Claritybot
Cloud mapping
Cocolyzebot
Copier
CopyRightCheck
Crawling at Home Project
Crescent
CrunchBot
Curious
Custo
CyotekWebCopy
DBLBot
DIIbot
DSearch
Demon
Digincore
Dirbuster
DittoSpyder
DomCopBot
DomainAppender
DomainSigmaCrawler
EMail Siphon
EirGrabber
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
FDM
Fimap
Firefox/7.0
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GetWeb
Getintent
Go!Zilla
Gotit
Grabber
Grafula
GrapeshotCrawler
HMView
Harvest
Heritrix
Humanlinks
HybridBot
IRLbot
Iblog
IndeedBot
InfoNaviRobot
Intelliseek
InternetSeer
Iria
IstellaBot
JamesBOT
Joomla
Jorgee
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
Larbin
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
LinkWalker
LinkextractorPro
LinqiaRSSBot
Lipperhey
Lipperhey Spider
MIDown tool
MIIxpc
MSFrontPage
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic-SEO
MarkWatch
MauiBot
MeanPath Bot
Mediatoolkitbot
Metauri
MicroMessenger
Mister PiX
Mojolicious
Musobot
NetSpider
Nettrack
NextGenSearchBot
NimbleCrawler
Ninja
Offline Explorer
Offline Navigator
Openvas
PECL::HTTP
Page Analyzer
PageAnalyzer
Pandalytics
PeoplePal
PictureFinder
Pu_iN
RSSingBot
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
RankurBot
Re-re
RealDownload
Reaper
RebelMouse
Recorder
RepoMonkey
Ripper
SBIder
SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot
ScanAlert
ScrepyBot
SeobilityBot
Seomoz
SiteExplorer
Snoopy
SocialRankIOBot
Sociscraper
SpaceBison
Spammen
Spinn3r
Sqlmap
SuperHTTP
Szukacz
T8Abot
TeleportPro
Telesoft
Telesphoreo
The Intraformant
TheNomad
TightTwatBot
Toata
Tracemyfile
Trendictionbot
Twice
VB Project
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WBSearchBot
WISENutbot
WPScan
WWW::Mechanize
Wallpapers
Web Auto
Web Enhancer
Web Fetch
Web Fuck
WebBandit
WebEnhancer
WebFuck
WebGo IS
WebImageCollector
WebPix
WebReaper
WebSauger
WebWhacker
WebmasterWorldForumBot
Webshag
Website Quester
Webster
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wotbox
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
Zermelo
Zitebot
ZumBot
ZyBorg
adscanner
arquivo.pt
autoemailspider
backlink-check
cah.io.community
crawl.sogou.com
crawler.feedback
crawler4j
demandbase-bot
evc-batch
instabid
meanpathbot
seocompany.store
seoscanners
sitechecker.pro
siteripz
sp_auditbot
spyfu
trendiction.com
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com
webprosbot
zgrab