nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-23 10:09:28 +00:00

250 lines
2.6 KiB
Text

404enemy
ALittle Client
ASPSeek
Aboundexbot
Acunetix
Aipbot
Alexibot
Alligator
Anarchy99
Apexoo
Asterias
BBBike
BLEXBot
Backlink-Ceck
BatchFTP
Battleztar Bazinga
BetaBot
Black Hole
Blackboard
Blow
BlowFish
Bolt
BotALot
Brandprotect
Buddy
BuzzSumo
CATExplorador
CODE87
CSHttp
CensysInspect
CheTeam
ChinaClaw
Chlooe
Cogentbot
Collector
Copyscape
Crawling at Home Project
Crescent
Custo
DIIbot
DataCha0s
Digincore
DigitalPebble
Discobot
Discoverybot
DnBCrawler-Analytics
DomCopBot
DomainCrawler
Dotbot
Download Wonder
ECCP/1.0
EMail Siphon
EasyDL
EirGrabber
Exabot
ExtractorPro
Extreme Picture Finder
EyeNetIE
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Foobot
Fuzz
Genieo
GetWeb
Getintent
Go!Zilla
GrapeshotCrawler
GridBot
HTMLparser
Harvest
Havij
Heritrix
HonoluluBot
Humanlinks
IDBTE4M
IRLbot
IndeedBot
Indy Library
InfoTekies
InterGET
InternetSeer
Iria
Jbrofuzz
Joomla
Jorgee
Kenjin Spider
Keyword Density
LNSpiderguy
LWP::Simple
LeechFTP
LexiBot
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Likse
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
MFC_Tear_Sample
Magnet
Majestic-SEO
Masscan
MeanPath Bot
Meanpathbot
MegaIndex.ru
Microsoft URL Control
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Navroad
NearSite
Net Vampire
NetMechanic
Netcraft
Nibbler
Niki-bot
Nikto
Nimbostratus
Ninja
Nmap
Nuclei
Octopus
OpenVAS
OrangeBot
OutclicksBot
PHPCrawl
PageAnalyzer
PeoplePal
Petalbot
Pi-Monster
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
ProPowerBot
Psbot
Pump
PyCurl
QueryN Metasearch
RSSingBot
RankingBot
Rankivabot
ReGet
RealDownload
RepoMonkey
SBIder
SEOkicks
SMTBot
ScoutJet
Scrapy
Screaming
Semrush
SentiBot
SeobilityBot
Seomoz
Siphon
Site Sucker
SiteLockSpider
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
SmartDownload
Snapbot
Sociscraper
SpankBot
Spbot
Steeler
Stripper
Sucker
Suzuran
Szukacz
T0PHackTeam
Teleport
Telesphoreo
The Intraformant
TheNomad
Thumbor
Toata
Tracemyfile
UnisterBot
Upflow
VB Project
Vagabondo
VelenPublicWebCrawler
Virusdie
WASALive-Bot
WEBDAV
WISENutbot
WPScan
WWW::Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
WeSEE
Web Fuck
Web Pix
WebBandit
WebCollage
WebEnhancer
WebGo IS
WebSauger
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
Whack
Whacker
Widow
Wonderbot
Woobot
Wprecon
Zeus
ZmEu
ZoomBot
adscanner
arquivo-web-crawler
arquivo.pt
cah.io.community
clark-crawler
cognitiveseo
crawl.sogou.com
dataforseo.com
demandbase-bot
eCatch
facebookscraper
isitwp.com
linkdexbot
lwp-trivial
magpie-crawler
plumanalytics
satoristudio.net
seobility
seostar
sp_auditbot
tAkeOut
trendiction.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla
zauba.io