nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-10 22:07:07 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
80legs
ADmantX
Aboundex
Acunetix
AfD-Verbotsverfahren
AiHitBot
AlphaBot
Anarchie
Anarchy
Apexoo
Aspiegel
Asterias
BBBike
BDCbot
BLEXBot
BackStreet
BackWeb
Barkrowler
BatchFTP
BetaBot
BlackWidow
Blow
BlowFish
Brandprotect
Brandwatch
Bullseye
CODE87
Cegbfeieh
CheTeam
CherryPicker
Claritybot
Collector
Cosmos
Crescent
Custo
CyotekWebCopy
DBLBot
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
Digincore
DigitalPebble
DnyzBot
DomCopBot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Drip
ECCP/1.0
EMail Siphon
Express WebPictures
ExtLinksBot
Ezooms
FHscan
FemtosearchBot
FlashGet
Foobot
FrontPage
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
GetRight
Gotit
HMView
HTMLparser
HTTP::Lite
Haansoft
Harvest
Heritrix
HonoluluBot
HybridBot
Iblog
IlseBot
Image Fetch
Image Sucker
IndeedBot
Intelliseek
Internet Ninja
Iria
IstellaBot
JamesBOT
Jbrofuzz
JustView
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
Lanshanbot
LibWeb
Libwhisker
LieBaoFast
Likse
LinkWalker
LinkpadBot
LinksManager
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Ltx71
MJ12bot
MQQBrowser
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
Mass Downloader
Microsoft Data Access
Minefield
Mister PiX
Mojeek
Mozlila
NPbot
Name Intelligence
Navroad
Nessus
Net Vampire
NetAnts
NetLyzer
Netcraft
Nibbler
NimbleCrawler
Not
Offline Explorer
Offline Navigator
OpenLinkProfiler
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Panscient
Picscout
ProWebWalker
Probethenet
Pu_iN
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
ReGet
Reaper
RebelMouse
Ripper
RocketCrawler
SBIder
SEOkicks
SEOkicks-Robot
SEOprofiler
SISTRIX
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
Screaming
ScrepyBot
Semrush
SemrushBot
SentiBot
Seomoz
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
Snoopy
Sosospider
Sottopop
Spanner
Sqlmap
Sqlworm
Steeler
SuperHTTP
Swiftbot
T0PHackTeam
Thumbor
Titan
Turnitin
TurnitinBot
Typhoeus
URLy Warning
UnisterBot
V-BOT
VB Project
Vacuum
VelenPublicWebCrawler
VidibleScraper
Virusdie
VoidEYE
Voil
Voltron
WBSearchBot
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
Web Pix
WebCopier
WebFetch
WebSucker
Webalta
WebsiteExtractor
Webster
Who.is Bot
Widow
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xaldon_WebSpider
Zauba
ZoomBot
ZyBorg
backlink-check
clark-crawler
coccocbot
cognitiveseo
crawl.sogou.com
crawler4j
dataforseo.com
domainsproject.org
heritrix
linkdexbot
lwp-request
lwp-trivial
magpie-crawler
muhstik-scan
netEstate NE Crawler
oBot
plumanalytics
polaris version
satoristudio.net
seocompany.store
seostar
sitechecker.pro
sysscan
trendiction.de
ubermetrics-technologies.com
webpros.com
webprosbot
x09Mozilla
x22Mozilla