nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-30 22:10:08 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Acunetix
AiHitBot
Alexibot
Alligator
Anarchy
Anarchy99
Apexoo
Asterias
BDFetch
BackDoorBot
Backlink-Ceck
BatchFTP
Battleztar Bazinga
Blackboard
BotALot
Brandwatch
CODE87
Calculon
CazoodleBot
CheTeam
ChinaClaw
Citoid
Claritybot
Cliqzbot
Cloud mapping
Copier
Copyscape
CrunchBot
DIIbot
DTS Agent
Demon
Devil
DittoSpyder
DomainAppender
Domains Project
Dotbot
Dragonfly
Drip
ECCP/1.0
EMail Wolf
EasyDL
EirGrabber
Evil
Exabot
Express WebPictures
FHscan
Fimap
Freeuploader
FrontPage
Fuzz
GT::WWW
GalaxyBot
Go!Zilla
GrabNet
Grabber
GridBot
HEADMasterSEO
HMView
HTTP::Lite
HaosouSpider
Heritrix
Hloader
HybridBot
IDBTE4M
IRLbot
IlseBot
Image Fetch
Image Sucker
Indy Library
InterGET
Internet Ninja
Iria
JOC Web Spider
JamesBOT
Jetty
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
LibWeb
Libwhisker
LieBaoFast
LinkScan
LinkWalker
Linkbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
MQQBrowser
MSIECrawler
MTRobot
Majestic12
Mata Hari
MauiBot
MeanPath Bot
Metauri
Mozlila
Msrabot
Musobot
NPbot
Name Intelligence
Navroad
NearSite
Needle
NetMechanic
Netcraft
Netvibes
NimbleCrawler
Nimbostratus
Ninja
Octopus
OnCrawl
OpenVAS
Openvas
OrangeBot
OrangeSpider
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
Pandalytics
Panscient
Papa Foto
Petalbot
Pi-Monster
Picscout
PictureFinder
Probethenet
Pump
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
Rankivabot
RealDownload
Recorder
Rogerbot
SEOkicks
SEOlyticsCrawler
SEOstats
Scrapy
Screaming
Searchestate
Seekport
SemanticJuice
Semrush
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
Siteimprove
Snake
Snapbot
Sosospider
SpankBot
Spanner
Sqlmap
Sucuri
Surfbot
SurveyBot
Swiftbot
T0PHackTeam
Teleport
TeleportPro
Telesoft
Telesphorep
The Intraformant
Titan
True_Robot
Turingos
TurnitinBot
VCI
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Voil
Voltron
WASALive-Bot
WEBDAV
WWW::Mechanize
Wallpapers
WeSEE
Web Collage
Web Enhancer
Web Fetch
Web Pix
Web Sucker
WebAuto
WebBandit
WebCollage
WebFetch
WebGo IS
WebImageCollector
WebPix
WebZIP
WebsiteQuester
Webster
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zermelo
ZmEu
ZoominfoBot
archive.org_bot
autoemailspider
check1.exe
crawler.feedback
crawler4j
demandbase-bot
eCatch
facebookscraper
gopher
heritrix
instabid
internetVista monitor
ips-agent
lwp-request
netEstate NE Crawler
plumanalytics
ripz
scalaj-http
serpstatbot
sexsearcher
siteripz
sysscan
trendiction.com
trendiction.de
voyagerx.com
x22Mozilla