nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-07-30 14:14:04 +00:00

250 lines
2.5 KiB
Text

01h4x.com
360Spider
404enemy
80legs
AIBOT
Abonti
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
Anarchie
Anarchy
Ankit
Apexoo
Asterias
BDFetch
BackStreet
Badass
Bandit
BatchFTP
BetaBot
Blow
BlowFish
Boardreader
Bolt
BotALot
Brandprotect
BuiltWith
BunnySlippers
CATExplorador
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CheeseBot
ChinaClaw
Chlooe
Cliqzbot
Collector
Copyscape
Curious
Custo
Demon
Digincore
Disco
Discobot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Drip
EMail Wolf
EasyDL
FHscan
Fimap
FlashGet
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GetRight
GetWeb
Gigablast
Go-Ahead-Got-It
GoZilla
GrabNet
GridBot
HEADMasterSEO
HTTP::Lite
Haansoft
HaosouSpider
Heritrix
Hloader
IDBTE4M
IRLbot
Iblog
Intelliseek
Iria
IstellaBot
Jetty
JikeSpider
Jyxobot
LNSpiderguy
Lanshanbot
Larbin
Leap
Lightspeedsystems
Linkdexbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
MIIxpc
MJ12bot
MQQBrowser
Mass Downloader
Mata Hari
MeanPath Bot
Mediatoolkitbot
Microsoft URL Control
Mojeek
Mojolicious
Mozlila
Musobot
Name Intelligence
Nameprotect
NearSite
Needle
NetSpider
Netcraft
Nibbler
Niki-bot
NimbleCrawler
Ninja
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OrangeSpider
PECL::HTTP
PHPCrawl
PageScorer
Pandalytics
PeoplePal
Petalbot
Picscout
PictureFinder
Pixray
PleaseCrawl
ProWebWalker
Psbot
Pu_iN
Pump
PxBroker
PyCurl
RSSingBot
RankActive
RankFlex
Rankivabot
Recorder
Ripper
Rogerbot
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot
ScanAlert
Scanbot
ScoutJet
Scrapy
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SentiBot
SeobilityBot
Seomoz
Site Sucker
SiteExplorer
SiteLockSpider
SiteSucker
Sitevigil
SlySearch
SmartDownload
Snapbot
Sociscraper
SpaceBison
Spanner
Sqlworm
Steeler
Sucker
Sucuri
SuperHTTP
Surfbot
SurveyBot
Suzuran
T0PHackTeam
T8Abot
Teleport
Telesoft
Telesphorep
TightTwatBot
Titan
Tracemyfile
Trendiction
Trendictionbot
TurnitinBot
TwengaBot
Twice
URLy.Warning
Vagabondo
VidibleScraper
Virusdie
VoidEYE
WEBDAV
WallpapersHD
WeSEE
Web Auto
Web Fetch
Web Sucker
WebBandit
WebCopier
WebFuck
WebGo IS
WebPix
WebStripper
WebSucker
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Who.is Bot
Widow
WinHTTrack
Wonderbot
Xenu
YoudaoBot
Zermelo
Zeus
Zitebot
ZumBot
arquivo.pt
autoemailspider
check1.exe
coccocbot-web
com.plumanalytics
crawl.sogou.com
heritrix
ips-agent
magpie-crawler
meanpathbot
mediawords
page scorer
plumanalytics
probe-image-size
scan.lol
seoscanners
seostar
serpstatbot
sexsearcher
sitechecker.pro
sp_auditbot
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
zgrab