nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-21 22:07:01 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Aboundex
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
Anarchie
Anarchy99
Aspiegel
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BLEXBot
Backlink-Ceck
Bigfoot
BlackWidow
Blow
Boardreader
Bolt
Brandprotect
BuiltWith
CATExplorador
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CheTeam
ChinaClaw
Chlooe
Cogentbot
Cosmos
CrazyWebCrawler
Curious
DBLBot
DIIbot
DSearch
Demon
Deusu
Digincore
Dirbuster
Disco
Dispatch
DittoSpyder
DomCopBot
DomainStatsBot
Domains Project
Drip
Ebingbong
EroCrawler
Exabot
Extractor
EyeNetIE
FDM
FHscan
Fimap
FlashGet
Foobot
Freeuploader
Fuzz
Fyrebot
GT::WWW
Genieo
GermCrawler
GetRight
Getintent
Gigabot
Go!Zilla
GrabNet
Grabber
GrapeFX
GridBot
HEADMasterSEO
HMView
HTMLparser
HonoluluBot
HybridBot
Iblog
Id-search
IlseBot
Image Sucker
IndeedBot
InfoTekies
InterGET
Internet Ninja
InternetSeer
Iskanie
IstellaBot
Jetty
JikeSpider
Jorgee
Keybot Translation-Search-Machine
Kozmosbot
LNSpiderguy
LexiBot
Lightspeedsystems
LinqiaRSSBot
Lipperhey Spider
Lmspider
MJ12bot
MQQBrowser
MSFrontPage
MarkMonitor
MarkWatch
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Metauri
Mozlila
Mr.4x3
Name Intelligence
Nameprotect
NetLyzer
NimbleCrawler
Nimbostratus
Nuclei
Nutch
Octopus
Offline Explorer
Offline Navigator
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
Petalbot
Pimonster
Pixray
PleaseCrawl
ProPowerBot
Psbot
PxBroker
Quick-Crawler
RSSingBot
RankActiveLinkBot
Rankivabot
RealDownload
Reaper
Recorder
RedesScrapy
RepoMonkey
SEOkicks
SEOlyticsCrawler
SEOprofiler
SISTRIX
SalesIntelligent
ScanAlert
Scanbot
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
Seekport
SeoSiteCheckup
Shodan
Site Sucker
SiteExplorer
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SmartDownload
Snoopy
Spammen
Spinn3r
Sqlworm
Sqworm
Steeler
SuperHTTP
SurveyBot
Swiftbot
Szukacz
T8Abot
TeleportPro
Telesphorep
The Intraformant
TheNomad
Thumbor
TightTwatBot
Toweyabot
Trendictionbot
Turnitin
TurnitinBot
Typhoeus
Vagabondo
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WeSEE
Web Auto
Web Fetch
Web Sauger
Web Sucker
WebCopier
WebEnhancer
WebFetch
WebGo IS
WebPix
WebReaper
WebSucker
WebWhacker
Webalta
WiseGuys Robot
Wonderbot
Xenu
ZoomBot
archive.org_bot
arquivo-web-crawler
backlink-check
cah.io.community
check1.exe
clark-crawler
coccocbot
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
facebookscraper
gopher
heritrix
instabid
internetVista monitor
iubenda-radar
linkdexbot
lwp-trivial
meanpathbot
pcBrowser
polaris version
seobility
seostar
siteripz
sogouspider
sp_auditbot
spyfu
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
x09Mozilla