nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-10 10:09:14 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
ADmantX
AIBOT
ALittle Client
ASPSeek
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AlphaBot
Anarchy99
Anthill
AwarioRssBot
BBBike
Backlink-Ceck
BacklinkCrawler
BetaBot
Bigfoot
Blackboard
Boardreader
Bolt
Brandprotect
Brandwatch
Buddy
BuiltBotTough
Bullseye
CCBot
CODE87
CazoodleBot
CheTeam
CheeseBot
CherryPicker
Claritybot
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
DIIbot
DSearch
DTS Agent
DataCha0s
Devil
Digincore
DigitalPebble
Dirbuster
Disco
Dispatch
DnyzBot
DomainCrawler
DomainSigmaCrawler
Download Wonder
Drip
EMail Wolf
Ebingbong
Ecxi
EirGrabber
Evil
ExtLinksBot
FHscan
Fimap
Firefox/7.0
Flunky
Fuzz
Fyrebot
GT::WWW
GetWeb
Gigabot
Go!Zilla
GoZilla
Gotit
Grabber
GrapeshotCrawler
GridBot
HTTrack
Harvest
Humanlinks
IRLbot
Iblog
IlseBot
IndeedBot
InterGET
Internet Ninja
Iria
Iskanie
JOC Web Spider
JamesBOT
JikeSpider
Jyxobot
Kinza
Larbin
Leap
LeechFTP
LexiBot
Lftp
Libwhisker
Lightspeedsystems
LinkScan
Linkdexbot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Masscan
MauiBot
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Metauri
Microsoft Data Access
Mr.4x3
Needle
Netvibes
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nutch
Octopus
Offline Navigator
Openfind
OrangeSpider
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageScorer
PageThing.com
Papa Foto
Picsearch
Piepmatz
PleaseCrawl
ProPowerBot
Probethenet
PxBroker
QueryN Metasearch
RankActive
RedesScrapy
RepoMonkey
Ripper
SEOlyticsCrawler
SEOprofiler
SalesIntelligent
ScanAlert
Scanbot
Screaming
ScrepyBot
SearchmetricsBot
SentiBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
SlySearch
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider
SpaceBison
Spammen
Spanner
Spinn3r
SputnikBot
Sqlworm
Steeler
Sucker
SuperHTTP
Suzuran
T8Abot
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Turingos
TurnitinBot
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
V-BOT
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
WBSearchBot
WWW-Collector-E
WWWOFFLE
Wallpapers
WallpapersHD
Web Pix
Web Sauger
WebBandit
WebCollage
WebCopier
WebFuck
WebReaper
Webalta
WebmasterWorldForumBot
Webster
Whack
Who.is Bot
WinHTTrack
Wonderbot
YoudaoBot
Zade
Zermelo
Zitebot
ZoominfoBot
ZyBorg
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
coccocbot-web
cognitiveseo
com.plumanalytics
crawler4j
facebookscraper
gopher
internetVista monitor
lwp-request
lwp-trivial
magpie-crawler
mediawords
page scorer
pcBrowser
probe-image-size
satoristudio.net
serpstatbot
sexsearcher
sitechecker.pro
tAkeOut
trendiction.de
voyagerx.com
x09Mozilla