nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-26 22:07:24 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
AIBOT
ALittle Client
Alexibot
AllSubmitter
Alligator
AlphaBot
Ankit
Asterias
BLEXBot
BacklinkCrawler
Battleztar Bazinga
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
CATExplorador
Calculon
CensysInspect
Cocolyzebot
Cogentbot
Cosmos
Curious
DBLBot
DSearch
DatabaseDriverMysqli
Devil
Digincore
DnyzBot
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Dragonfly
ECCP/1.0
EasyDL
Ebingbong
EirGrabber
EroCrawler
Evil
Express WebPictures
ExtractorPro
FDM
Firefox/7.0
Flunky
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
Genieo
GetWeb
Go!Zilla
Gotit
GrabNet
Grafula
HMView
HTMLparser
HaosouSpider
Havij
Hloader
HonoluluBot
HybridBot
IRLbot
Iblog
Image Fetch
InfoTekies
Internet Ninja
JamesBOT
JikeSpider
JustView
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
LeechFTP
LeechGet
Lftp
LibWeb
Libwhisker
LinkWalker
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
Lmspider
MFC_Tear_Sample
MIDown tool
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
Masscan
MauiBot
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Moblie Safari
Musobot
NPbot
Needle
NetSpider
Netvibes
NextGenSearchBot
Nibbler
Nimbostratus
Ninja
Not
OpenVAS
Openvas
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
Page Analyzer
Pandalytics
Pavuk
PeoplePal
Picscout
PictureFinder
Piepmatz
Pixray
Pockey
ProPowerBot
Probethenet
Psbot
PyCurl
RankActiveLinkBot
RankingBot2
RankurBot
Re-re
RealDownload
Recorder
RocketCrawler
Rogerbot
SEOstats
ScanAlert
ScoutJet
Screaming
ScrepyBot
SemanticJuice
SemrushBot
SentiBot
SeoSiteCheckup
Seomoz
Siphon
SiteLockSpider
Sitebeam
Sitevigil
SlySearch
SmartDownload
Snake
Snapbot
Snoopy
Sogou web spider
Sosospider
SpaceBison
SpankBot
Spbot
SputnikBot
Sucker
SuperBot
T8Abot
Teleport
Telesoft
The Intraformant
Thumbor
Titan
Trendictionbot
Turnitin
Twice
Typhoeus
URLy.Warning
Upflow
VB Project
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
Voltron
WASALive-Bot
WBSearchBot
Wallpapers
WeSEE
Web Collage
Web Enhancer
Web Fuck
Web Sauger
WebAuto
WebFetch
WebFuck
WebGo IS
WebReaper
WebStripper
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
Webster
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
Wprecon
Xenu
ZoominfoBot
adscanner
archive.org_bot
arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community
clark-crawler
cognitiveseo
crawler4j
demandbase-bot
domainsproject.org
isitwp.com
iubenda-radar
lwp-request
meanpathbot
probe-image-size
seobility
seoscanners
sitechecker.pro
sogouspider
sysscan
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
x09Mozilla
zauba.io