nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-11 10:18:34 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
ASPSeek
Aboundex
Acunetix
Aipbot
Ankit
Apexoo
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BackWeb
Badass
Barkrowler
BatchFTP
Bitacle
Boardreader
Brandprotect
Buck
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CODE87
Cegbfeieh
CheeseBot
Chlooe
Claritybot
CopyRightCheck
Copyscape
Cosmos
Craftbot
Crawling at Home Project
Crescent
Curious
DBLBot
DTS Agent
DataCha0s
Devil
Discoverybot
DomCopBot
DomainAppender
DomainCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
ECCP/1.0
Ecxi
Evil
Exabot
ExtractorPro
FDM
FHscan
FemtosearchBot
FlashGet
Flunky
Freeuploader
G-i-g-a-b-o-t
GalaxyBot
Genieo
GetRight
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrabNet
Grafula
GridBot
HTMLparser
Haansoft
HaosouSpider
Harvest
Havij
Image Fetch
Indy Library
InfoNaviRobot
InterGET
Internet Ninja
JamesBOT
JikeSpider
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
LWP::Simple
Leap
LeechFTP
LeechGet
LibWeb
LieBaoFast
Lightspeedsystems
Likse
Linkbot
Linkdexbot
LinqiaScrapeBot
Lipperhey
Litemage_walker
MJ12bot
MQQBrowser
Mail.RU_Bot
Majestic12
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft URL Control
Mister PiX
Mojolicious
Mr.4x3
Msrabot
NPbot
Name Intelligence
Net Vampire
NetLyzer
NetMechanic
NetZIP
Nibbler
Nikto
Ninja
Octopus
Offline Explorer
OpenVAS
Openvas
OutclicksBot
POE-Component-Client-HTTP
PageAnalyzer
Pandalytics
Petalbot
PictureFinder
PleaseCrawl
Pockey
Pu_iN
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
Reaper
RepoMonkey
SEOkicks
SEOlyticsCrawler
SEOprofiler
SMTBot
Scrapy
ScrepyBot
Semrush
SemrushBot
SeoSiteCheckup
Seomoz
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSucker
Sitevigil
SlySearch
SmartDownload
SocialRankIOBot
Sociscraper
Sottopop
SpaceBison
Spammen
Spbot
Steeler
Stripper
Sucuri
SuperBot
T8Abot
Teleport
The Intraformant
TheNomad
Thumbor
Trendiction
True_Robot
Turingos
Upflow
VB Project
Vagabondo
VelenPublicWebCrawler
WBSearchBot
WISENutbot
WPScan
WWW-Collector-E
WWWOFFLE
WallpapersHD
Web Collage
Web Pix
Web Sucker
WebAuto
WebFetch
WebImageCollector
WebSucker
WebWhacker
Webalta
Webshag
WebsiteQuester
Webster
Whack
Whacker
Who.is Bot
WinHTTrack
Wonderbot
Wotbox
Xaldon WebSpider
Zade
Zauba
Zitebot
ZoomBot
ZoominfoBot
ZumBot
arquivo.pt
cah.io.community
check1.exe
clark-crawler
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler.feedback
evc-batch
facebookscraper
instabid
internetVista monitor
meanpathbot
mediawords
muhstik-scan
oBot
ripz
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seobility
sitechecker.pro
siteripz
sp_auditbot
sysscan
trendiction.com
webpros.com
webprosbot
x09Mozilla
x22Mozilla
zgrab