nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2022-05-01 22:07:08 +00:00

250 lines
2.6 KiB
Text

80legs
AIBOT
Aboundex
Aboundexbot
Acunetix
Alligator
AlphaBot
Anarchy
Apexoo
Aspiegel
AwarioRssBot
BatchFTP
BetaBot
Bigfoot
BlackWidow
Blackboard
Boardreader
Bolt
Brandprotect
Buddy
BuiltWith
CCBot
CazoodleBot
ChinaClaw
Claritybot
Cocolyzebot
Collector
Cosmos
Crawling at Home Project
CrazyWebCrawler
Custo
DBLBot
DataCha0s
Demon
Deusu
DigitalPebble
Dirbuster
Discobot
DittoSpyder
DnyzBot
DomCopBot
DomainSigmaCrawler
ECCP/1.0
EMail Wolf
EasyDL
Evil
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
Ezooms
FDM
FHscan
Fimap
FlashGet
Foobot
FrontPage
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GetRight
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
Grafula
GrapeshotCrawler
HMView
HTTrack
Haansoft
Heritrix
HonoluluBot
Humanlinks
HybridBot
IDBTE4M
IDBot
Iblog
Id-search
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
InterGET
Internet Ninja
IstellaBot
Joomla
Jorgee
Keyword Density
Kozmosbot
Lanshanbot
Leap
LeechFTP
Libwhisker
LinkScan
LinkpadBot
LinqiaScrapeBot
Litemage_walker
Lmspider
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Magnet
Majestic-SEO
MarkMonitor
MarkWatch
Mata Hari
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mister PiX
Moblie Safari
Mojolicious
MolokaiBot
Mr.4x3
Musobot
Name Intelligence
Navroad
NearSite
Needle
Net Vampire
NetSpider
Netcraft
Nibbler
Nmap
Octopus
OpenVAS
OrangeBot
OutfoxBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageScorer
PageThing.com
Panscient
Papa Foto
Picsearch
ProPowerBot
Pu_iN
Pump
QueryN Metasearch
RSSingBot
RankingBot2
RankurBot
Re-re
RedesScrapy
Ripper
SBIder
SEOlyticsCrawler
SMTBot
SalesIntelligent
Scanbot
ScoutJet
Scrapy
ScrepyBot
SemanticJuice
SeobilityBot
Siphon
SiteExplorer
SiteSucker
Siteimprove
SmartDownload
Snake
Snoopy
Sociscraper
Spanner
Spbot
Sqlworm
Steeler
Sucker
SuperHTTP
Surfbot
Teleport
Telesphoreo
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Titan
Toata
Toweyabot
Trendictionbot
True_Robot
Turnitin
Twice
Typhoeus
UnisterBot
V-BOT
Vagabondo
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
Web Fetch
Web Sauger
Web Sucker
WebAuto
WebCopier
WebFetch
WebFuck
WebLeacher
WebReaper
WebStripper
WebSucker
WebmasterWorldForumBot
WebsiteExtractor
Webster
Who.is Bot
WinHTTrack
Wotbox
Xaldon_WebSpider
YoudaoBot
Zade
Zermelo
ZoomBot
ZumBot
ZyBorg
archive.org_bot
check1.exe
coccocbot
cognitiveseo
crawl.sogou.com
crawler.feedback
crawler4j
evc-batch
facebookscraper
meanpathbot
netEstate NE Crawler
page scorer
polaris version
probe-image-size
satoristudio.net
seobility
seostar
sexsearcher
sitechecker.pro
spyfu
voyagerx.com
webgains-bot
webprosbot
x22Mozilla
zgrab