nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-31 22:07:35 +00:00

250 lines
2.6 KiB
Text

404checker
80legs
ALittle Client
ASPSeek
Abonti
Aboundex
AiHitBot
Alexibot
AlphaBot
Anarchy99
Ankit
Aspiegel
Attach
BDCbot
BLEXBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
BetaBot
Bigfoot
BlackWidow
Blow
Boardreader
Bolt
BotALot
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CATExplorador
CCBot
CSHttp
Calculon
CheTeam
CherryPicker
ChinaClaw
Cloud mapping
Cocolyzebot
CopyRightCheck
Cosmos
Curious
DataCha0s
DatabaseDriverMysqli
Demon
Devil
Digincore
Dirbuster
Discobot
Discoverybot
Dispatch
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dragonfly
EMail Wolf
EasyDL
Ebingbong
Ecxi
EirGrabber
Exabot
ExtractorPro
FemtosearchBot
Firefox/7.0
Flunky
FrontPage
G-i-g-a-b-o-t
GetRight
Go-Ahead-Got-It
GoZilla
GrabNet
GrapeFX
GridBot
HTMLparser
Heritrix
Hloader
HybridBot
IDBot
Iblog
IndeedBot
InfoNaviRobot
InterGET
Internet Ninja
InternetSeer
Iria
JOC Web Spider
JamesBOT
Jetty
Joomla
Keyword Density
Kinza
LNSpiderguy
Larbin
LeechFTP
LeechGet
LibWeb
LinkWalker
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
MJ12bot
MQQBrowser
MSIECrawler
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkWatch
Masscan
MauiBot
Mb2345Browser
Meanpathbot
MegaIndex.ru
Metauri
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Musobot
NICErsPRO
NPbot
NetLyzer
NetSpider
NetZIP
Nettrack
NextGenSearchBot
Nmap
Not
Nutch
OnCrawl
Openvas
OrangeSpider
PHPCrawl
PageAnalyzer
PageGrabber
Papa Foto
Petalbot
Picscout
Pixray
PleaseCrawl
Pockey
PxBroker
QueryN Metasearch
RankActiveLinkBot
RankFlex
RankurBot
RebelMouse
Recorder
RepoMonkey
Ripper
Rogerbot
SEOkicks
SEOkicks-Robot
SEOprofiler
SEOstats
SISTRIX
SMTBot
Scrapy
ScreenerBot
ScrepyBot
Seekport
SemanticJuice
SemrushBot
Site Sucker
SiteExplorer
SiteSnagger
Sitebeam
SlySearch
Sogou web spider
Sosospider
Sottopop
SputnikBot
Sqlworm
SuperBot
Suzuran
Szukacz
T0PHackTeam
Telesoft
Telesphorep
The Intraformant
TheNomad
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
TwengaBot
Twice
V-BOT
Vacuum
VelenPublicWebCrawler
Voltron
WEBDAV
Wallpapers/3.0
Web Auto
Web Sauger
WebAuto
WebFetch
WebGo IS
WebImageCollector
WebPix
WebSauger
WebStripper
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
Zitebot
ZoomBot
archive.org_bot
arquivo.pt
backlink-check
cah.io.community
check1.exe
crawler.feedback
crawler4j
dataforseo.com
gopher
internetVista monitor
isitwp.com
linkdexbot
muhstik-scan
page scorer
probe-image-size
ripz
satoristudio.net
scalaj-http
seobility
seocompany.store
seostar
sexsearcher
sitechecker.pro
sogouspider
spyfu
tAkeOut
ubermetrics-technologies.com
webprosbot
x09Mozilla
x22Mozilla
xpymep1.exe