nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-19 10:11:36 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
80legs
AfD-Verbotsverfahren
AhrefsBot
Alexibot
Alligator
Anarchy
Anthill
Apexoo
Aspiegel
Atomseobot
Attach
BLEXBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
Barkrowler
Battleztar Bazinga
Bigfoot
BlackWidow
Bolt
Brandwatch
Buck
Buddy
BuiltWith
Bullseye
BuzzSumo
CATExplorador
CazoodleBot
Cegbfeieh
CheeseBot
ChinaClaw
Chlooe
Citoid
Claritybot
Collector
Copier
CopyRightCheck
CrunchBot
DIIbot
DSearch
DTS Agent
DigitalPebble
Disco
Dispatch
DomCopBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
ECCP/1.0
EMail Siphon
EMail Wolf
Evil
Exabot
EyeNetIE
FHscan
FemtosearchBot
FlashGet
Foobot
Freeuploader
Fuzz
G-i-g-a-b-o-t
GT::WWW
GetRight
Grafula
GrapeshotCrawler
HTTP::Lite
HTTrack
HaosouSpider
HonoluluBot
IDBTE4M
Iblog
Id-search
Image Fetch
InfoTekies
IstellaBot
JOC Web Spider
Jetty
Jorgee
Keybot Translation-Search-Machine
Keyword Density
Leap
LexiBot
Lftp
LieBaoFast
Lightspeedsystems
LinkScan
LinkWalker
Linkbot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSIECrawler
Magnet
Mail.RU_Bot
Majestic12
MarkWatch
Mass Downloader
MauiBot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Minefield
Moblie Safari
Morfeus Fucking Scanner
Name Intelligence
NearSite
Needle
NetAnts
NetMechanic
NetSpider
Netcraft
NextGenSearchBot
Nibbler
Niki-bot
Nuclei
OpenVAS
Openvas
OutclicksBot
PECL::HTTP
PHPCrawl
PageAnalyzer
PageThing.com
Pandalytics
Pavuk
PeoplePal
Petalbot
Pi-Monster
Picsearch
Piepmatz
PleaseCrawl
Pockey
ProWebWalker
Probethenet
Pu_iN
Pump
PyCurl
RSSingBot
RankActive
RankActiveLinkBot
RankFlex
Rankivabot
RankurBot
Re-re
Ripper
RocketCrawler
SEOkicks-Robot
SalesIntelligent
ScanAlert
Screaming
ScrepyBot
Searchestate
SearchmetricsBot
Seekport
SemanticJuice
Semrush
Seomoz
SiteLockSpider
Sitevigil
Sociscraper
Sogou web spider
SpaceBison
Spbot
Spinn3r
Sqworm
Sucker
Szukacz
TeleportPro
Trendiction
True_Robot
Turingos
Turnitin
TwengaBot
Typhoeus
URLy.Warning
UnisterBot
Upflow
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
WBSearchBot
WWW-Mechanize
WWW::Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Auto
Web Fetch
WebCopier
WebFetch
WebGo IS
WebStripper
Webalta
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Whatweb
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Xenu
Zauba
Zeus
ZmEu
ZoomBot
clark-crawler
coccocbot
cognitiveseo
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
evc-batch
facebookscraper
internetVista monitor
ips-agent
linkdexbot
magpie-crawler
meanpathbot
muhstik-scan
oBot
page scorer
plumanalytics
polaris version
s1z.ru
seobility
sitechecker.pro
spyfu
sysscan
tAkeOut
trendiction.de
webgains-bot
webmeup-crawler
webprosbot
x09Mozilla
xpymep1.exe
zauba.io