nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-test.list
2021-11-10 22:07:17 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
Aboundexbot
AiHitBot
Aipbot
Anarchy
Anarchy99
Anthill
Aspiegel
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
Backlink-Ceck
BacklinkCrawler
Battleztar Bazinga
Bitacle
Black Hole
BlowFish
Boardreader
Bolt
Brandprotect
Buddy
BuiltBotTough
Bullseye
CATExplorador
CODE87
Calculon
Cegbfeieh
CensysInspect
CherryPicker
ChinaClaw
Chlooe
Claritybot
CopyRightCheck
Copyscape
Crawling at Home Project
DBLBot
DIIbot
DatabaseDriverMysqli
Demon
Dirbuster
DomainAppender
DomainSigmaCrawler
Domains Project
Dotbot
Download Wonder
Dragonfly
ECCP/1.0
Ecxi
EirGrabber
Evil
Express WebPictures
FemtosearchBot
Firefox/7.0
FlashGet
Fuzz
FyberSpider
Fyrebot
GetWeb
Go-Ahead-Got-It
Grabber
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
HTTP::Lite
Haansoft
Havij
Humanlinks
IDBot
IlseBot
Indy Library
InfoNaviRobot
Intelliseek
InterGET
Iskanie
IstellaBot
Jetty
JikeSpider
Joomla
Jorgee
Kenjin Spider
Kozmosbot
LNSpiderguy
LWP::Simple
LeechGet
LieBaoFast
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Ltx71
MFC_Tear_Sample
MIDown tool
MSFrontPage
Majestic SEO
MarkMonitor
Mass Downloader
MauiBot
MeanPath Bot
MegaIndex.ru
Mojeek
Musobot
NICErsPRO
Needle
NetAnts
NetMechanic
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Nibbler
Nmap
Nuclei
Nutch
Octopus
Offline Explorer
Openfind
Openvas
PECL::HTTP
PHPCrawl
Page Analyzer
PageThing.com
Pandalytics
Panscient
Pavuk
PeoplePal
Picsearch
Pixray
ProWebWalker
Pu_iN
PyCurl
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
ReGet
RedesScrapy
RepoMonkey
Ripper
Rogerbot
SEOstats
Scanbot
Scrapy
Screaming
ScrepyBot
Searchestate
SearchmetricsBot
Semrush
SentiBot
Seomoz
Siphon
Site Sucker
SiteSucker
Sitevigil
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
Sottopop
SpaceBison
Spbot
Sqlworm
Sqworm
Steeler
Stripper
Sucuri
SuperBot
Surfbot
Suzuran
T8Abot
Teleport
TeleportPro
Telesoft
The Intraformant
Tracemyfile
Trendictionbot
TurnitinBot
Typhoeus
URLy Warning
UnisterBot
Upflow
Vagabondo
VeriCiteCrawler
Voil
WASALive-Bot
WWWOFFLE
Wallpapers
WallpapersHD
Web Fuck
WebBandit
WebCollage
WebFuck
WebPix
WebStripper
WebWhacker
WebZIP
Webshag
Website Quester
WebsiteExtractor
Whack
Whacker
Whatweb
Widow
WiseGuys Robot
Woobot
Wprecon
Xaldon WebSpider
YoudaoBot
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZumBot
arquivo.pt
autoemailspider
coccocbot-web
crawler4j
demandbase-bot
eCatch
evc-batch
gopher
heritrix
ips-agent
lwp-request
mediawords
muhstik-scan
netEstate NE Crawler
oBot
page scorer
pcBrowser
plumanalytics
polaris version
probe-image-size
satoristudio.net
sitechecker.pro
sp_auditbot
trendiction.com
webmeup-crawler
webprosbot
x22Mozilla
xpymep1.exe
zauba.io
zgrab