nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2023-02-03 22:07:13 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404enemy
ADmantX
Aboundex
Anarchie
Anarchy
Anarchy99
Apexoo
Asterias
AwarioRssBot
BDFetch
BLEXBot
BackStreet
Backlink-Ceck
Badass
Barkrowler
Black Hole
BlackWidow
Blackboard
Boardreader
Bolt
BotALot
Brandprotect
CODE87
CSHttp
Calculon
CheTeam
CherryPicker
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
CopyRightCheck
Copyscape
Cosmos
Craftbot
Crawling at Home Project
CyotekWebCopy
Demon
Digincore
DigitalPebble
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainSigmaCrawler
Dotbot
Dragonfly
Drip
EMail Wolf
EasyDL
Ebingbong
Ecxi
EirGrabber
Express WebPictures
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Flunky
Foobot
Fuzz
FyberSpider
Fyrebot
GT::WWW
Go!Zilla
GrabNet
GrapeFX
HEADMasterSEO
HMView
HTMLparser
Haansoft
Heritrix
Hloader
HonoluluBot
Humanlinks
HybridBot
IDBTE4M
Iblog
Id-search
Image Sucker
Indy Library
InterGET
InternetSeer
IstellaBot
JennyBot
JikeSpider
Keyword Density
Larbin
LibWeb
LinkWalker
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
MFC_Tear_Sample
MIIxpc
MJ12bot
MTRobot
Mag-Net
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Mass Downloader
MeanPath Bot
Metauri
Microsoft Data Access
Mojeek
Musobot
Name Intelligence
Navroad
NearSite
Needle
Nessus
Net Vampire
Nettrack
Netvibes
Nibbler
Nikto
Ninja
Nmap
Not
Nutch
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Pandalytics
Pavuk
PeoplePal
Petalbot
Pi-Monster
Pimonster
Pockey
Pump
PyCurl
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
ReGet
RealDownload
Reaper
RebelMouse
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
ScanAlert
Scrapy
SearchmetricsBot
Seekport
SemanticJuice
Semrush
SentiBot
SeobilityBot
Site Sucker
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
Sitevigil
SmartDownload
Snapbot
Sottopop
Spammen
SpankBot
Spanner
Spbot
Spinn3r
Sqlmap
Sqlworm
Sucker
Surfbot
Swiftbot
T8Abot
Telesoft
Telesphoreo
TheNomad
Thumbor
Titan
Toata
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Typhoeus
Upflow
VCI
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
WASALive-Bot
WBSearchBot
WEBDAV
WWW-Collector-E
WallpapersHD
Web Sauger
Web Sucker
WebEnhancer
WebFetch
WebFuck
WebSauger
WebStripper
WebSucker
WebsiteExtractor
Woobot
Xaldon_WebSpider
Xenu
Zauba
Zeus
Zitebot
ZoominfoBot
arquivo-web-crawler
arquivo.pt
backlink-check
cah.io.community
clark-crawler
cognitiveseo
crawl.sogou.com
crawler.feedback
demandbase-bot
domainsproject.org
eCatch
gopher
heritrix
iubenda-radar
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
probe-image-size
ripz
satoristudio.net
sexsearcher
tAkeOut
trendiction.com
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webprosbot
x22Mozilla