nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-07 11:07:02 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
Abonti
Aboundexbot
AhrefsBot
AiHitBot
Alexibot
Alligator
Anarchie
Anarchy
Aspiegel
Attach
AwarioSmartBot
BLEXBot
BackWeb
BacklinkCrawler
Badass
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
BlackWidow
Boardreader
Bolt
BotALot
Brandwatch
Buck
BuzzSumo
CATExplorador
CCBot
CODE87
Cegbfeieh
CheeseBot
CherryPicker
Claritybot
Cloud mapping
Cocolyzebot
Copier
CopyRightCheck
Cosmos
Custo
DSearch
DTS Agent
Deusu
Devil
DigitalPebble
Dirbuster
Disco
Discoverybot
DomainAppender
Dotbot
Download Wonder
ECCP/1.0
EMail Siphon
EMail Wolf
Ecxi
EroCrawler
Evil
ExtractorPro
Ezooms
FHscan
FlashGet
FrontPage
Fuzz
Fyrebot
GT::WWW
GermCrawler
Getintent
Gigablast
GoZilla
GrabNet
GrapeFX
HaosouSpider
Harvest
Hloader
HybridBot
Id-search
IlseBot
IndeedBot
Intelliseek
InternetSeer
Iskanie
IstellaBot
Jbrofuzz
JetCar
Jorgee
Jyxobot
Kenjin Spider
LNSpiderguy
Lanshanbot
Leap
LeechFTP
LeechGet
LexiBot
Likse
LinkWalker
Linkbot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MSIECrawler
Majestic SEO
Mass Downloader
MauiBot
MeanPath Bot
Meanpathbot
MegaIndex.ru
Microsoft URL Control
Moblie Safari
Mojeek
Msrabot
NPbot
Nameprotect
NearSite
Needle
Nessus
NetAnts
NetMechanic
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nimbostratus
Nuclei
Offline Explorer
Offline Navigator
OpenVAS
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageScorer
Petalbot
Picsearch
Pimonster
ProPowerBot
Probethenet
Psbot
Pump
PxBroker
QueryN Metasearch
RankFlex
RankingBot
Rankivabot
ReGet
RealDownload
RebelMouse
RocketCrawler
Rogerbot
SBIder
SEOlyticsCrawler
SISTRIX
SMTBot
ScanAlert
ScrepyBot
SearchmetricsBot
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Sitebeam
SlySearch
Snake
Spammen
Spanner
Sqlmap
Sqlworm
Sqworm
Steeler
Sucuri
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
TeleportPro
Telesphorep
Tracemyfile
True_Robot
Turnitin
TwengaBot
UnisterBot
Upflow
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WBSearchBot
WPScan
WWW-Collector-E
WWW::Mechanize
Wallpapers
Wallpapers/3.0
Web Auto
Web Collage
Web Fetch
Web Sucker
WebEnhancer
WebImageCollector
WebLeacher
WebPix
WebReaper
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
Whack
Whacker
Whatweb
Wprecon
Zade
Zermelo
Zeus
ZmEu
archive.org_bot
autoemailspider
crawler.feedback
demandbase-bot
facebookscraper
ips-agent
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
muhstik-scan
plumanalytics
s1z.ru
scan.lol
seobility
seostar
sexsearcher
sitechecker.pro
siteripz
tAkeOut
trendiction.com
voyagerx.com
x09Mozilla
xpymep1.exe
zauba.io