nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-11 22:07:20 +00:00

250 lines
2.7 KiB
Text

360Spider
80legs
ADmantX
ALittle Client
Aboundex
AiHitBot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Ankit
Aspiegel
Asterias
Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BackStreet
BackWeb
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Black Hole
Boardreader
Brandprotect
Brandwatch
Buck
BunnySlippers
CCBot
CODE87
CSHttp
CazoodleBot
CensysInspect
ChinaClaw
Cloud mapping
Cosmos
CrazyWebCrawler
Custo
CyotekWebCopy
DBLBot
DTS Agent
DataCha0s
Deusu
Dirbuster
DnBCrawler-Analytics
DnyzBot
DomainCrawler
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
Drip
EMail Siphon
Ecxi
Evil
Extreme Picture Finder
FemtosearchBot
Fimap
Flunky
Foobot
Freeuploader
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
GermCrawler
GetRight
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrapeshotCrawler
GridBot
HEADMasterSEO
HMView
Haansoft
Harvest
Hloader
Humanlinks
Id-search
IlseBot
Image Fetch
Indy Library
InterGET
Iskanie
IstellaBot
JOC Web Spider
JetCar
JikeSpider
Kenjin Spider
LNSpiderguy
Lanshanbot
Larbin
LibWeb
LieBaoFast
Likse
LinkScan
LinkpadBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
MIIxpc
MQQBrowser
MTRobot
Magnet
Majestic SEO
MarkWatch
Masscan
Metauri
MicroMessenger
Microsoft URL Control
Moblie Safari
Mojolicious
Nameprotect
Navroad
NetSpider
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nikto
NimbleCrawler
Ninja
Nuclei
Octopus
OpenVAS
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Petalbot
Pi-Monster
Picsearch
Pimonster
Pixray
PleaseCrawl
ProWebWalker
PxBroker
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
Ripper
SEOkicks-Robot
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
ScoutJet
Scrapy
Searchestate
SemanticJuice
SeoSiteCheckup
Shodan
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
Snapbot
Snoopy
Sosospider
Sottopop
SpaceBison
Spammen
Spbot
Sqlmap
Sqlworm
Sqworm
Stripper
Sucuri
SuperBot
Surfbot
Suzuran
T8Abot
TeleportPro
Telesoft
Telesphoreo
Telesphorep
The Intraformant
Toata
Tracemyfile
True_Robot
URLy Warning
UnisterBot
Upflow
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voltron
WASALive-Bot
WBSearchBot
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
WeSEE
Web Auto
Web Collage
Web Sucker
WebBandit
WebReaper
WebSucker
Webalta
WebmasterWorldForumBot
Webshag
Who.is Bot
Woobot
Xaldon_WebSpider
Zauba
Zeus
Zitebot
ZoomBot
archive.org_bot
coccocbot
cognitiveseo
crawl.sogou.com
crawler.feedback
eCatch
facebookscraper
iubenda-radar
magpie-crawler
netEstate NE Crawler
page scorer
seobility
serpstatbot
sitechecker.pro
spyfu
sysscan
trendiction.com
webgains-bot
webmeup-crawler
x09Mozilla
zauba.io