nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-15 10:09:09 +00:00

250 lines
2.6 KiB
Text

01h4x.com
AIBOT
ALittle Client
Aboundex
AhrefsBot
AiHitBot
Aipbot
Alexibot
AllSubmitter
Ankit
Apexoo
Atomseobot
AwarioRssBot
BDCbot
BDFetch
BLEXBot
BackDoorBot
Backlink-Ceck
Badass
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
Blow
Bolt
Buck
Buddy
BuiltWith
Bullseye
BuzzSumo
CATExplorador
CODE87
CensysInspect
CheTeam
Citoid
Cliqzbot
Copier
CrazyWebCrawler
Crescent
CrunchBot
Curious
Custo
DBLBot
DTS Agent
DigitalPebble
Dirbuster
Disco
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainCrawler
DomainStatsBot
Domains Project
EMail Siphon
EasyDL
EroCrawler
ExtLinksBot
ExtractorPro
FHscan
FemtosearchBot
FlashGet
Foobot
Fuzz
Fyrebot
G-i-g-a-b-o-t
GetRight
GetWeb
GrabNet
GridBot
HTMLparser
Hloader
HybridBot
IDBTE4M
IDBot
Id-search
Indy Library
InfoTekies
InterGET
Iskanie
JOC Web Spider
JennyBot
Jetty
Joomla
Jyxobot
Kenjin Spider
Keyword Density
LNSpiderguy
Larbin
LeechFTP
LeechGet
Lftp
Linkbot
LinksManager
LinqiaRSSBot
Lipperhey Spider
Lmspider
MIDown tool
MIIxpc
MJ12bot
MSIECrawler
Mag-Net
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Mata Hari
MauiBot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
Minefield
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Musobot
Name Intelligence
NetAnts
NetZIP
Nettrack
Nibbler
Nimbostratus
Not
Nuclei
Nutch
Offline Explorer
OnCrawl
OpenVAS
Openfind
OutclicksBot
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
Papa Foto
Petalbot
Pi-Monster
Pimonster
Pixray
PleaseCrawl
Psbot
Pu_iN
PxBroker
RSSingBot
RankurBot
Re-re
RebelMouse
Recorder
RepoMonkey
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
SalesIntelligent
ScreenerBot
SemanticJuice
Shodan
Siphon
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
Siteimprove
Sitevigil
Snake
Snapbot
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
Sqlworm
Steeler
Stripper
Sucuri
Surfbot
Szukacz
T0PHackTeam
T8Abot
Telesoft
Telesphoreo
Telesphorep
The Intraformant
Thumbor
Toweyabot
True_Robot
Turnitin
Twice
URLy Warning
VeriCiteCrawler
Voil
Voltron
WBSearchBot
WEBDAV
WPScan
WWW-Collector-E
WWW::Mechanize
WallpapersHD
Web Enhancer
Web Fuck
Web Sauger
WebCollage
WebCopier
WebEnhancer
WebGo IS
WebReaper
WebWhacker
WebZIP
WebmasterWorldForumBot
Webster
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Xaldon_WebSpider
Zade
Zermelo
Zitebot
ZmEu
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check
cah.io.community
clark-crawler
coccocbot
cognitiveseo
dataforseo.com
demandbase-bot
eCatch
gopher
instabid
iubenda-radar
linkdexbot
magpie-crawler
muhstik-scan
plumanalytics
s1z.ru
satoristudio.net
sexsearcher
siteripz
sp_auditbot
sysscan
tAkeOut
trendiction.com
webgains-bot
x09Mozilla
xpymep1.exe
zgrab