nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-29 22:07:17 +00:00

250 lines
2.6 KiB
Text

404enemy
ADmantX
ALittle Client
Abonti
Acunetix
Alligator
Anarchie
Anarchy
Ankit
Attach
BBBike
BDCbot
BLEXBot
BackStreet
BackWeb
BacklinkCrawler
Bandit
Barkrowler
BetaBot
BlackWidow
Bolt
BotALot
Brandprotect
Buck
BuiltBotTough
CCBot
CODE87
CSHttp
Cegbfeieh
CensysInspect
CherryPicker
ChinaClaw
Citoid
Cocolyzebot
Cogentbot
Cosmos
Craftbot
Crawling at Home Project
Crescent
Curious
DBLBot
DSearch
DataCha0s
Demon
Digincore
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
Dotbot
EMail Siphon
EasyDL
ExtLinksBot
Ezooms
FHscan
Firefox/7.0
FlashGet
Flunky
Fuzz
Fyrebot
Getintent
Go-Ahead-Got-It
GoZilla
GrabNet
Grabber
GrapeFX
GridBot
HTMLparser
Haansoft
Harvest
Hloader
HybridBot
IDBTE4M
IndeedBot
InterGET
Internet Ninja
Iria
Iskanie
IstellaBot
JennyBot
Jetty
JikeSpider
JustView
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
LWP::Simple
Larbin
LexiBot
Libwhisker
Lightspeedsystems
LinkScan
Linkbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
MIIxpc
MSIECrawler
Mag-Net
Majestic SEO
Majestic-SEO
Majestic12
Mass Downloader
Masscan
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Mozlila
Msrabot
Musobot
Nameprotect
NearSite
Nessus
NetAnts
NetLyzer
NetMechanic
NetSpider
NetZIP
Nibbler
Niki-bot
Nikto
NimbleCrawler
Not
Nutch
Octopus
Offline Navigator
OnCrawl
Openfind
Openvas
OrangeBot
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Panscient
Papa Foto
Petalbot
Picsearch
Pimonster
Probethenet
Pu_iN
RankFlex
RankingBot
RankingBot2
Reaper
RedesScrapy
Ripper
RocketCrawler
SEOlyticsCrawler
SISTRIX
SMTBot
SalesIntelligent
Scanbot
Scrapy
ScrepyBot
SearchmetricsBot
SentiBot
Shodan
Siphon
Site Sucker
SlySearch
Snoopy
Sociscraper
Sogou web spider
SpaceBison
SpankBot
SputnikBot
Surfbot
Suzuran
T8Abot
TeleportPro
Telesphorep
The Intraformant
Thumbor
Titan
Toata
Toweyabot
Turingos
TurnitinBot
TwengaBot
URLy Warning
UnisterBot
Vacuum
Vagabondo
Virusdie
Voltron
WASALive-Bot
WWW-Collector-E
Wallpapers/3.0
WallpapersHD
Web Auto
Web Enhancer
Web Sauger
WebBandit
WebGo IS
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Webster
Who.is Bot
Xaldon WebSpider
Xenu
YoudaoBot
Zade
Zermelo
Zeus
Zitebot
ZmEu
ZoominfoBot
ZumBot
adscanner
archive.org_bot
cah.io.community
check1.exe
coccocbot
crawl.sogou.com
crawler4j
eCatch
evc-batch
facebookscraper
lwp-request
magpie-crawler
netEstate NE Crawler
polaris version
probe-image-size
ripz
seobility
seocompany.store
seostar
serpstatbot
sogouspider
sysscan
trendiction.de
voyagerx.com
webpros.com
x22Mozilla
xpymep1.exe