nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-11 10:09:29 +00:00

250 lines
2.6 KiB
Text

01h4x.com
80legs
AIBOT
ALittle Client
ASPSeek
Aboundex
Aboundexbot
Acunetix
AhrefsBot
Aipbot
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Ankit
Anthill
Asterias
AwarioRssBot
BLEXBot
BackStreet
BetaBot
Bigfoot
BlowFish
Boardreader
BotALot
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CODE87
CSHttp
CazoodleBot
Claritybot
Cliqzbot
Collector
Cosmos
CrunchBot
Custo
DBLBot
DSearch
DTS Agent
DataCha0s
Devil
DigitalPebble
Dispatch
DittoSpyder
DomCopBot
DomainAppender
DomainSigmaCrawler
Domains Project
Dotbot
EMail Siphon
EMail Wolf
EroCrawler
Evil
Express WebPictures
Ezooms
FDM
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Freeuploader
FrontPage
Fyrebot
Genieo
Gigabot
GoZilla
GrabNet
Grabber
Grafula
HEADMasterSEO
HMView
HTTP::Lite
Haansoft
HaosouSpider
Harvest
Heritrix
Hloader
IDBTE4M
IDBot
IRLbot
Iblog
Id-search
IlseBot
Image Sucker
IndeedBot
Indy Library
IstellaBot
Jbrofuzz
JetCar
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LWP::Simple
Leap
LeechFTP
Lftp
LibWeb
Libwhisker
LinkextractorPro
LinqiaRSSBot
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Majestic-SEO
MarkWatch
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
Metauri
Microsoft URL Control
Morfeus Fucking Scanner
NICErsPRO
Name Intelligence
Nameprotect
Nessus
Netcraft
NextGenSearchBot
Niki-bot
NimbleCrawler
Ninja
Nmap
Offline Explorer
Offline Navigator
OpenLinkProfiler
OrangeSpider
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Petalbot
PictureFinder
Pixray
Pockey
Pu_iN
Pump
PyCurl
Quick-Crawler
RSSingBot
RankActive
RankFlex
RankingBot2
RealDownload
Reaper
Recorder
RedesScrapy
Ripper
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
ScoutJet
Searchestate
SearchmetricsBot
SentiBot
SeoSiteCheckup
SeobilityBot
Shodan
SiteSucker
Sitebeam
Siteimprove
SlySearch
Snake
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
Spanner
Sqlmap
Sqlworm
Surfbot
SurveyBot
T0PHackTeam
Titan
Turnitin
TurnitinBot
URLy.Warning
UnisterBot
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
WASALive-Bot
WISENutbot
WWW-Collector-E
WWW-Mechanize
Wallpapers/3.0
Web Auto
Web Pix
Web Sauger
WebFuck
WebLeacher
WebReaper
WebSucker
WebmasterWorldForumBot
Webshag
Widow
WinHTTrack
Wprecon
YoudaoBot
Zade
Zauba
Zeus
ZmEu
ZumBot
autoemailspider
coccocbot-web
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
eCatch
evc-batch
gopher
heritrix
instabid
internetVista monitor
magpie-crawler
meanpathbot
netEstate NE Crawler
page scorer
pcBrowser
polaris version
probe-image-size
ripz
scalaj-http
sexsearcher
siteripz
sogouspider
trendiction.de
voyagerx.com
x09Mozilla
zgrab