nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-15 22:06:54 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
ALittle Client
Aboundex
AhrefsBot
Alexibot
AlphaBot
Anarchie
Anarchy99
Ankit
Aspiegel
Asterias
Attach
AwarioSmartBot
BDCbot
BDFetch
BLEXBot
BackDoorBot
BacklinkCrawler
Bandit
BetaBot
Bitacle
Blackboard
BotALot
Brandprotect
Brandwatch
Buck
BuzzSumo
CATExplorador
CODE87
CazoodleBot
CensysInspect
CheTeam
ChinaClaw
Cliqzbot
Collector
CopyRightCheck
Copyscape
Crawling at Home Project
CrazyWebCrawler
Crescent
CyotekWebCopy
DBLBot
DIIbot
DatabaseDriverMysqli
Devil
Digincore
Dirbuster
Discobot
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
Domains Project
Dotbot
Dragonfly
Drip
EMail Siphon
EroCrawler
Express WebPictures
ExtractorPro
EyeNetIE
Foobot
FyberSpider
GT::WWW
GermCrawler
GetWeb
Getintent
GoZilla
Grafula
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
HTTrack
HaosouSpider
Hloader
IDBTE4M
Iblog
IlseBot
Image Sucker
InfoNaviRobot
Internet Ninja
Iskanie
JOC Web Spider
JamesBOT
JennyBot
JikeSpider
Jorgee
JustView
Jyxobot
Kenjin Spider
LNSpiderguy
Larbin
LeechFTP
Lftp
Libwhisker
LinkextractorPro
LinkpadBot
LinqiaRSSBot
Lipperhey
Litemage_walker
Lmspider
MFC_Tear_Sample
MQQBrowser
MTRobot
Mag-Net
Magnet
Majestic-SEO
Majestic12
MarkWatch
Mediatoolkitbot
Microsoft URL Control
Minefield
MolokaiBot
Msrabot
Name Intelligence
Net Vampire
NetLyzer
NetZIP
Nettrack
Netvibes
Niki-bot
Nikto
Nimbostratus
Ninja
OpenLinkProfiler
Openfind
Openvas
OrangeBot
OutclicksBot
OutfoxBot
PageGrabber
Pixray
Pockey
ProWebWalker
Pu_iN
Pump
PxBroker
RSSingBot
RankActive
RankFlex
RankingBot2
Rankivabot
RankurBot
Re-re
ReGet
Reaper
Recorder
RedesScrapy
Ripper
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
SMTBot
SalesIntelligent
ScoutJet
ScrepyBot
SearchmetricsBot
SeoSiteCheckup
Seomoz
SiteExplorer
Siteimprove
SlySearch
Snapbot
Snoopy
Sociscraper
Sottopop
SpaceBison
Sqlworm
Sucker
SuperHTTP
Surfbot
SurveyBot
Suzuran
T0PHackTeam
TheNomad
TightTwatBot
Titan
Trendictionbot
True_Robot
Twice
Typhoeus
UnisterBot
V-BOT
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voil
WBSearchBot
WISENutbot
WPScan
WWW-Mechanize
Wallpapers
Web Auto
Web Enhancer
Web Sauger
WebEnhancer
WebFetch
WebGo IS
WebPix
WebReaper
WebSauger
WebStripper
Website Quester
WebsiteQuester
Webster
Whacker
Widow
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zermelo
Zeus
ZmEu
ZyBorg
adscanner
arquivo-web-crawler
check1.exe
clark-crawler
com.plumanalytics
crawler.feedback
dataforseo.com
domainsproject.org
eCatch
gopher
heritrix
instabid
internetVista monitor
ips-agent
iubenda-radar
lwp-trivial
oBot
ripz
satoristudio.net
scan.lol
sexsearcher
sitechecker.pro
sp_auditbot
spyfu
tAkeOut
voyagerx.com
x09Mozilla
xpymep1.exe