nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-21 22:07:21 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
ALittle Client
ASPSeek
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
Anarchie
Anarchy
Anarchy99
Anthill
Aspiegel
BBBike
BDFetch
BackWeb
Barkrowler
BatchFTP
BetaBot
Bitacle
Black Hole
Blackboard
Boardreader
Brandprotect
Brandwatch
Buck
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CCBot
CODE87
CazoodleBot
CheTeam
CherryPicker
ChinaClaw
Cliqzbot
Cloud mapping
Copier
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
Deusu
Devil
Disco
Discoverybot
Dispatch
DittoSpyder
DnyzBot
Dotbot
Download Wonder
ECCP/1.0
EirGrabber
EroCrawler
Evil
Extreme Picture Finder
EyeNetIE
Ezooms
Firefox/7.0
Foobot
FrontPage
FyberSpider
G-i-g-a-b-o-t
GT::WWW
Gigablast
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
GrapeFX
GrapeshotCrawler
GridBot
HTTrack
HaosouSpider
Hloader
Humanlinks
Iblog
Id-search
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
InfoTekies
Internet Ninja
Iskanie
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Lftp
LieBaoFast
Lightspeedsystems
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
MIDown tool
MJ12bot
MQQBrowser
Majestic SEO
Majestic-SEO
MarkWatch
Mass Downloader
Mb2345Browser
MeanPath Bot
Mozlila
Musobot
NICErsPRO
Navroad
NearSite
Net Vampire
NetLyzer
NetSpider
Nettrack
NextGenSearchBot
NimbleCrawler
Offline Explorer
OpenVAS
Openfind
OrangeSpider
OutfoxBot
PECL::HTTP
Page Analyzer
PageAnalyzer
Pandalytics
Pavuk
PeoplePal
Pi-Monster
Piepmatz
Pixray
Pockey
ProPowerBot
Psbot
Quick-Crawler
RankActiveLinkBot
RankingBot
Rankivabot
Re-re
ReGet
RealDownload
Recorder
RedesScrapy
RepoMonkey
SBIder
SEOkicks-Robot
SEOstats
SMTBot
ScanAlert
Scanbot
ScoutJet
Screaming
ScreenerBot
ScrepyBot
Searchestate
Semrush
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
Snapbot
Snoopy
Spanner
Spbot
Sqworm
Sucker
Sucuri
SuperBot
SuperHTTP
SurveyBot
Szukacz
TeleportPro
Telesphorep
TheNomad
Thumbor
TightTwatBot
Tracemyfile
Trendiction
Trendictionbot
TurnitinBot
TwengaBot
Twice
Typhoeus
V-BOT
VB Project
Vagabondo
VoidEYE
Voil
Voltron
WASALive-Bot
WISENutbot
WWW-Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Fuck
WebCollage
WebFetch
WebImageCollector
WebLeacher
WebStripper
WebWhacker
WebZIP
Webalta
WebsiteExtractor
WebsiteQuester
Whack
Whacker
WinHTTrack
Woobot
Wprecon
Xaldon_WebSpider
Zeus
Zitebot
ZmEu
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check
clark-crawler
coccocbot-web
domainsproject.org
eCatch
gopher
internetVista monitor
lwp-request
meanpathbot
muhstik-scan
page scorer
pcBrowser
polaris version
probe-image-size
satoristudio.net
seostar
sogouspider
sysscan
tAkeOut
trendiction.com
webmeup-crawler
webprosbot
xpymep1.exe