nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-06 10:09:42 +00:00

250 lines
2.5 KiB
Text

360Spider
AIBOT
ASPSeek
Acunetix
Aipbot
Alexibot
Alligator
AlphaBot
Ankit
Apexoo
BDCbot
BDFetch
Backlink-Ceck
Badass
Bigfoot
Blow
Buck
Buddy
BuiltWith
Bullseye
BuzzSumo
CATExplorador
CCBot
CODE87
CSHttp
Calculon
Cegbfeieh
CheTeam
CheeseBot
Chlooe
Citoid
Claritybot
Cloud mapping
Cocolyzebot
CopyRightCheck
Copyscape
Crawling at Home Project
Crescent
Custo
DBLBot
DIIbot
DSearch
DatabaseDriverMysqli
Dirbuster
DnBCrawler-Analytics
DomainSigmaCrawler
Domains Project
Dotbot
Download Wonder
Drip
ECCP/1.0
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
FHscan
Fuzz
GalaxyBot
GermCrawler
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrabNet
GrapeFX
HMView
HTTP::Lite
HTTrack
Havij
Iblog
Id-search
InfoTekies
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
Jetty
JikeSpider
Joomla
Jyxobot
Kenjin Spider
Keyword Density
Kinza
LWP::Simple
Larbin
Leap
LeechGet
Lftp
LibWeb
Libwhisker
LieBaoFast
LinkScan
LinkWalker
Linkbot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
MSIECrawler
MTRobot
Majestic SEO
Majestic12
MarkMonitor
MeanPath Bot
Meanpathbot
MegaIndex.ru
Metauri
Minefield
Mojolicious
Mozlila
Navroad
NearSite
Needle
Nessus
NetAnts
NetMechanic
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nikto
Nimbostratus
Not
Nuclei
Nutch
Octopus
OnCrawl
Openfind
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
PageAnalyzer
Pandalytics
Papa Foto
Petalbot
Pixray
PleaseCrawl
Pockey
ProPowerBot
Probethenet
PxBroker
PyCurl
RSSingBot
RankFlex
Rankivabot
Reaper
RepoMonkey
RocketCrawler
SISTRIX
SMTBot
SalesIntelligent
ScoutJet
ScreenerBot
Seekport
SemanticJuice
Seomoz
Shodan
SiteCheckerBotCrawler
SiteLockSpider
SlySearch
SmartDownload
Snake
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider
SpankBot
Spinn3r
Sqlmap
Sqlworm
Steeler
Stripper
SuperHTTP
Suzuran
Swiftbot
Szukacz
T8Abot
Teleport
Telesoft
Telesphoreo
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
Turingos
TurnitinBot
TwengaBot
Twice
UnisterBot
V-BOT
VCI
Vagabondo
Voil
WISENutbot
WWW-Mechanize
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fetch
Web Sucker
WebAuto
WebEnhancer
WebFetch
WebFuck
WebLeacher
WebZIP
WebmasterWorldForumBot
Whack
Whacker
Who.is Bot
WiseGuys Robot
Woobot
Zauba
Zermelo
Zitebot
ZoomBot
ZoominfoBot
ZumBot
adscanner
clark-crawler
cognitiveseo
com.plumanalytics
crawl.sogou.com
heritrix
instabid
iubenda-radar
linkdexbot
lwp-trivial
magpie-crawler
netEstate NE Crawler
plumanalytics
satoristudio.net
seocompany.store
seoscanners
sogouspider
spyfu
sysscan
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla
xpymep1.exe
zauba.io