nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-02-26 10:09:18 +00:00

250 lines
2.5 KiB
Text

01h4x.com
360Spider
Alligator
AlphaBot
Anarchie
Anthill
Atomseobot
AwarioSmartBot
BDCbot
BDFetch
BLEXBot
BackDoorBot
BackWeb
Backlink-Ceck
Badass
Barkrowler
Bigfoot
Black Hole
BlowFish
Bolt
BotALot
Brandprotect
Brandwatch
Buddy
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CODE87
CSHttp
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Citoid
Cocolyzebot
Copier
Cosmos
Craftbot
Crescent
DIIbot
DSearch
DTS Agent
Discobot
Discoverybot
Dispatch
DomainAppender
DomainCrawler
DomainSigmaCrawler
Domains Project
Dotbot
EMail Siphon
EasyDL
ExtLinksBot
ExtractorPro
Ezooms
FDM
Foobot
Freeuploader
GT::WWW
GetRight
GetWeb
Go!Zilla
Go-Ahead-Got-It
GrabNet
Grafula
GrapeFX
HEADMasterSEO
HMView
HTTP::Lite
Harvest
HonoluluBot
IDBTE4M
IDBot
Iblog
Id-search
IlseBot
IndeedBot
Indy Library
InterGET
Internet Ninja
Iria
Jetty
JikeSpider
Joomla
JustView
Keyword Density
Kinza
LWP::Simple
LeechGet
LibWeb
Libwhisker
Likse
LinkextractorPro
LinksManager
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
MSIECrawler
Mag-Net
Magnet
Majestic SEO
Majestic12
Mass Downloader
MauiBot
Mediatoolkitbot
Metauri
Minefield
Mojolicious
Msrabot
NICErsPRO
NPbot
Name Intelligence
Navroad
Net Vampire
NetLyzer
NetSpider
NetZIP
Netcraft
NextGenSearchBot
Nmap
Nuclei
Nutch
Offline Explorer
OnCrawl
OpenVAS
Openfind
Openvas
OrangeBot
PECL::HTTP
PHPCrawl
PageGrabber
PageScorer
PageThing.com
Papa Foto
Pavuk
Piepmatz
Pimonster
Pixray
Pockey
ProWebWalker
Pu_iN
RSSingBot
RankFlex
RankurBot
Re-re
Reaper
RebelMouse
RepoMonkey
SBIder
SEOlyticsCrawler
SEOprofiler
SalesIntelligent
ScanAlert
Scanbot
Screaming
SearchmetricsBot
SemrushBot
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Siteimprove
Snapbot
SocialRankIOBot
SpaceBison
Spammen
Sqlworm
Steeler
Sucker
Sucuri
Surfbot
Swiftbot
Teleport
Telesoft
The Intraformant
Titan
Toata
Toweyabot
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
VB Project
VCI
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voltron
WISENutbot
WWW-Collector-E
WWW-Mechanize
Web Auto
Web Fetch
Web Fuck
Web Sauger
WebAuto
WebBandit
WebCollage
WebCopier
WebEnhancer
WebPix
WebSauger
WebSucker
Webshag
Website Quester
WebsiteExtractor
Webster
Whacker
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xaldon_WebSpider
YoudaoBot
Zermelo
Zeus
Zitebot
ZoomBot
adscanner
arquivo-web-crawler
backlink-check
cah.io.community
demandbase-bot
domainsproject.org
evc-batch
heritrix
internetVista monitor
isitwp.com
lwp-request
mediawords
netEstate NE Crawler
pcBrowser
plumanalytics
polaris version
ripz
scalaj-http
sexsearcher
sitechecker.pro
sogouspider
spyfu
x22Mozilla
xpymep1.exe