nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-10 10:18:46 +00:00

250 lines
2.7 KiB
Text

01h4x.com
AIBOT
ALittle Client
Abonti
Alligator
AlphaBot
Anarchy
Anthill
Apexoo
Aspiegel
Asterias
Attach
BBBike
BLEXBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
Battleztar Bazinga
Bigfoot
Black Hole
Blackboard
Boardreader
BotALot
Brandprotect
Buck
Buddy
CATExplorador
CazoodleBot
CheTeam
CherryPicker
ChinaClaw
Citoid
Claritybot
Copyscape
Craftbot
Crawling at Home Project
Custo
DBLBot
DIIbot
DSearch
DTS Agent
Digincore
DigitalPebble
Dirbuster
Disco
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
Domains Project
Download Wonder
Dragonfly
EMail Siphon
EasyDL
EirGrabber
Exabot
Express WebPictures
Extractor
ExtractorPro
FHscan
Firefox/7.0
Flunky
Freeuploader
FrontPage
Fyrebot
GetRight
Go-Ahead-Got-It
HEADMasterSEO
Harvest
HonoluluBot
HybridBot
IRLbot
Id-search
Image Sucker
IndeedBot
InfoNaviRobot
Internet Ninja
JamesBOT
JennyBot
JetCar
Jetty
JikeSpider
Jorgee
LeechFTP
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Lmspider
MJ12bot
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Majestic SEO
MarkMonitor
Masscan
Mata Hari
MauiBot
Meanpathbot
MicroMessenger
Moblie Safari
Mojolicious
Mozlila
Mr.4x3
Musobot
NPbot
Nameprotect
NearSite
Nessus
NetAnts
Netcraft
Netvibes
Niki-bot
Ninja
Not
Offline Explorer
OpenLinkProfiler
OpenVAS
Openfind
OrangeBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageThing.com
Panscient
Papa Foto
Pavuk
Pi-Monster
PleaseCrawl
ProPowerBot
ProWebWalker
RSSingBot
RankActive
RankActiveLinkBot
Rankivabot
ReGet
RebelMouse
RocketCrawler
SEOlyticsCrawler
SISTRIX
SMTBot
Scanbot
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
SearchmetricsBot
SemrushBot
SeobilityBot
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SlySearch
SmartDownload
Snapbot
Sociscraper
Sosospider
Sottopop
SpaceBison
Stripper
Sucker
Sucuri
Szukacz
T0PHackTeam
Telesphorep
The Intraformant
TheNomad
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
Twice
URLy Warning
VoidEYE
Voltron
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Auto
Web Fetch
Web Pix
Web Sauger
WebBandit
WebEnhancer
WebLeacher
WebPix
WebSauger
WebStripper
WebmasterWorldForumBot
Webshag
WebsiteQuester
Webster
Whack
Whacker
Widow
Wotbox
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zeus
Zitebot
ZmEu
ZoominfoBot
ZumBot
backlink-check
clark-crawler
com.plumanalytics
demandbase-bot
domainsproject.org
facebookscraper
internetVista monitor
isitwp.com
magpie-crawler
mediawords
muhstik-scan
oBot
page scorer
polaris version
s1z.ru
scalaj-http
seocompany.store
serpstatbot
sitechecker.pro
siteripz
voyagerx.com
webgains-bot
webpros.com
x22Mozilla
zgrab