nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-04-24 12:37:23 +00:00

100 lines
1.1 KiB
Text

ADmantX
Aboundex
Apexoo
BacklinkCrawler
Black Hole
Blackboard
BuiltBotTough
Bullseye
CSHttp
CensysInspect
Cloud mapping
Cogentbot
CopyRightCheck
Discoverybot
Dispatch
EyeNetIE
Fimap
FrontPage
Genieo
GetRight
Go!Zilla
GrabNet
GrapeshotCrawler
HTMLparser
IRLbot
Internet Ninja
Iskanie
IstellaBot
LWP::Simple
Libwhisker
Lightspeedsystems
LinqiaRSSBot
LinqiaScrapeBot
MJ12bot
MarkMonitor
MauiBot
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft URL Control
Nessus
NetMechanic
NextGenSearchBot
Nibbler
Nutch
OpenVAS
Openfind
PageScorer
PageThing.com
Pavuk
Pixray
ProPowerBot
RankActive
RankFlex
RebelMouse
RepoMonkey
SEOprofiler
SEOstats
SeobilityBot
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SocialRankIOBot
Spinn3r
Stripper
SuperHTTP
Surfbot
SurveyBot
Teleport
Telesphoreo
The Intraformant
TinyTestBot
Titan
URLy Warning
V-BOT
VoidEYE
WWW::Mechanize
Web Fuck
WebEnhancer
WebFuck
WebReaper
Webshag
Who.is Bot
Widow
YoudaoBot
ZoomBot
arquivo-web-crawler
arquivo.pt
clark-crawler
facebookscraper
gopher
isitwp.com
linkfluence
oBot
pcBrowser
sogouspider
webmeup-crawler
webpros.com
x22Mozilla