nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-09 07:06:17 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ADmantX
ALittle Client
Abonti
Acunetix
AhrefsBot
Aipbot
AllSubmitter
Alligator
AlphaBot
Apexoo
Aspiegel
Attach
BDFetch
BLEXBot
Backlink-Ceck
Battleztar Bazinga
BetaBot
Bitacle
Black Hole
Blow
Bolt
Buck
Buddy
BuiltBotTough
BunnySlippers
CATExplorador
CCBot
CODE87
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
Cloud mapping
Cogentbot
Copyscape
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
DIIbot
DSearch
DatabaseDriverMysqli
Demon
Digincore
Dirbuster
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
EMail Siphon
EMail Wolf
EroCrawler
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FemtosearchBot
FlashGet
Foobot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GetRight
GetWeb
Go!Zilla
GoZilla
GrapeshotCrawler
HTMLparser
HTTP::Lite
HybridBot
IDBTE4M
IDBot
IRLbot
Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
Indy Library
Internet Ninja
Iria
IstellaBot
JOC Web Spider
Jbrofuzz
Jetty
JikeSpider
Joomla
Jorgee
LNSpiderguy
LWP::Simple
Larbin
Lftp
LibWeb
Libwhisker
Lightspeedsystems
Likse
Linkdexbot
LinqiaMetadataDownloaderBot
Lipperhey
Ltx71
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
MauiBot
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft URL Control
Mr.4x3
Needle
NetAnts
NetSpider
NetZIP
Netvibes
NimbleCrawler
Not
Offline Explorer
OnCrawl
Openfind
OrangeBot
PHPCrawl
Page Analyzer
PageAnalyzer
Panscient
PeoplePal
Petalbot
Pi-Monster
PictureFinder
Pimonster
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Psbot
Pu_iN
PyCurl
QueryN Metasearch
RSSingBot
Re-re
ReGet
RealDownload
Reaper
RebelMouse
Rogerbot
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
Scanbot
Scrapy
Screaming
ScreenerBot
Seekport
SentiBot
SeoSiteCheckup
Shodan
Site Sucker
SiteLockSpider
Sitebeam
Siteimprove
Snake
Sociscraper
Sottopop
Spinn3r
Sqlworm
Steeler
Stripper
Sucuri
SuperHTTP
Surfbot
Suzuran
Telesphoreo
TheNomad
Thumbor
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
TwengaBot
Typhoeus
VCI
Vacuum
Vagabondo
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WWW-Mechanize
WWW::Mechanize
Wallpapers
Wallpapers/3.0
Web Auto
Web Collage
Web Pix
Web Sauger
Web Sucker
WebLeacher
WebPix
WebReaper
WebWhacker
Webshag
WebsiteExtractor
Webster
WinHTTrack
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zeus
Zitebot
ZyBorg
adscanner
backlink-check
cah.io.community
coccocbot-web
cognitiveseo
crawler4j
domainsproject.org
eCatch
evc-batch
gopher
internetVista monitor
meanpathbot
plumanalytics
satoristudio.net
scalaj-http
seocompany.store
sogouspider
spyfu
tAkeOut
trendiction.com
trendiction.de
webpros.com
zgrab