nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-26 22:07:15 +00:00

250 lines
2.6 KiB
Text

ALittle Client
AiHitBot
AllSubmitter
Alligator
Anarchie
Ankit
Anthill
Asterias
Atomseobot
BBBike
BDCbot
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
BatchFTP
Bigfoot
Black Hole
Buck
BuiltWith
BuzzSumo
CATExplorador
CCBot
CheTeam
Cloud mapping
Cocolyzebot
Collector
CrazyWebCrawler
Custo
CyotekWebCopy
DBLBot
DTS Agent
Disco
Discoverybot
DittoSpyder
EasyDL
Ecxi
EirGrabber
Evil
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
Flunky
Foobot
FrontPage
Fyrebot
GalaxyBot
Genieo
GermCrawler
Getintent
Gigabot
Grabber
GrapeshotCrawler
Haansoft
Havij
Heritrix
IDBTE4M
IlseBot
Image Fetch
Image Sucker
InfoNaviRobot
Intelliseek
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
JennyBot
JetCar
Jetty
JikeSpider
JustView
Keybot Translation-Search-Machine
Keyword Density
LWP::Simple
LeechFTP
Libwhisker
Likse
LinkWalker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
Ltx71
MIIxpc
MQQBrowser
Magnet
Majestic SEO
Majestic-SEO
Mata Hari
MauiBot
Mediatoolkitbot
Microsoft Data Access
Minefield
Moblie Safari
Mojeek
Mojolicious
Mozlila
NPbot
Nessus
Net Vampire
NetAnts
NetLyzer
NetMechanic
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Nibbler
NimbleCrawler
Openvas
OrangeBot
OutclicksBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
Panscient
Papa Foto
Pavuk
Petalbot
Pi-Monster
Picscout
Pimonster
Pixray
Pockey
ProPowerBot
Probethenet
QueryN Metasearch
RankingBot2
RankurBot
Re-re
RebelMouse
Recorder
RocketCrawler
SBIder
SEOkicks-Robot
SalesIntelligent
ScoutJet
Seekport
SemanticJuice
SemrushBot
SeoSiteCheckup
Seomoz
Siphon
Sitebeam
Sitevigil
SmartDownload
Snake
Snoopy
Sociscraper
Sosospider
Sottopop
SpaceBison
Spammen
SpankBot
Spanner
Sqworm
Steeler
Sucuri
Surfbot
Szukacz
T0PHackTeam
Telesoft
TheNomad
TightTwatBot
Toata
Toweyabot
Trendiction
Trendictionbot
Turingos
Turnitin
TwengaBot
Twice
Typhoeus
UnisterBot
V-BOT
VCI
Vagabondo
VelenPublicWebCrawler
VoidEYE
Voil
WBSearchBot
WWW-Mechanize
Wallpapers
WallpapersHD
Web Collage
Web Fetch
Web Pix
Web Sauger
Web Sucker
WebAuto
WebBandit
WebCollage
WebCopier
WebEnhancer
WebLeacher
WebReaper
WebSucker
WebmasterWorldForumBot
Website Quester
WebsiteQuester
Webster
Whack
Whacker
Widow
Woobot
Wprecon
Zermelo
Zeus
Zitebot
ZmEu
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
cognitiveseo
crawler.feedback
eCatch
evc-batch
gopher
instabid
meanpathbot
mediawords
netEstate NE Crawler
oBot
ripz
s1z.ru
scan.lol
seocompany.store
serpstatbot
sitechecker.pro
sogouspider
sp_auditbot
tAkeOut
trendiction.de
voyagerx.com
webgains-bot
webpros.com
x09Mozilla
xpymep1.exe
zauba.io
zgrab