nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-01 22:07:08 +00:00

250 lines
2.6 KiB
Text

80legs
AIBOT
ALittle Client
Abonti
Aboundexbot
Acunetix
AiHitBot
Aipbot
Alexibot
AllSubmitter
Alligator
Anarchy
Anarchy99
Anthill
Aspiegel
Atomseobot
BDCbot
BDFetch
Backlink-Ceck
Badass
Bandit
BatchFTP
BetaBot
Bigfoot
BlackWidow
Boardreader
Brandwatch
Buddy
BuiltBotTough
Bullseye
CCBot
CODE87
CSHttp
CazoodleBot
Cegbfeieh
CensysInspect
Cloud mapping
Copier
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
CrunchBot
Curious
Custo
DSearch
DTS Agent
DataCha0s
Demon
Dirbuster
DnyzBot
DomCopBot
DomainAppender
ECCP/1.0
EasyDL
Ecxi
Exabot
FDM
FHscan
Fimap
Flunky
Foobot
Fuzz
GermCrawler
GetRight
GetWeb
Getintent
Go-Ahead-Got-It
Grabber
HMView
Haansoft
Heritrix
Hloader
HonoluluBot
Humanlinks
IlseBot
Image Sucker
Indy Library
Intelliseek
Internet Ninja
Iria
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
Jetty
JikeSpider
Joomla
Keyword Density
LeechGet
LexiBot
Libwhisker
LieBaoFast
Likse
LinkWalker
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
MFC_Tear_Sample
MIIxpc
MSIECrawler
Majestic SEO
MarkMonitor
Mass Downloader
Masscan
Mata Hari
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Moblie Safari
MolokaiBot
Musobot
Name Intelligence
Nameprotect
NetAnts
NetMechanic
NetZIP
Nettrack
Nimbostratus
Not
Octopus
Offline Explorer
Offline Navigator
OrangeBot
OrangeSpider
PHPCrawl
Page Analyzer
PageScorer
Papa Foto
PeoplePal
Petalbot
Picscout
Picsearch
PleaseCrawl
ProWebWalker
Pu_iN
Pump
PxBroker
RankFlex
RankingBot
RankingBot2
RankurBot
Re-re
ReGet
RedesScrapy
RepoMonkey
RocketCrawler
Rogerbot
SEOlyticsCrawler
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
SemrushBot
Site Sucker
SiteLockSpider
SiteSucker
Siteimprove
Sitevigil
Snake
SocialRankIOBot
SpaceBison
SpankBot
Sqlmap
Sqlworm
Sucuri
SuperHTTP
Surfbot
Swiftbot
T0PHackTeam
Telesoft
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Toata
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turnitin
VCI
VeriCiteCrawler
Virusdie
Voltron
WASALive-Bot
WEBDAV
WPScan
WWW-Collector-E
WeSEE
Web Collage
Web Sucker
WebCopier
WebEnhancer
WebFetch
WebFuck
WebStripper
WebWhacker
Webalta
WebsiteQuester
Whack
Whacker
Who.is Bot
Widow
WiseGuys Robot
Wonderbot
Woobot
Xaldon WebSpider
YoudaoBot
Zauba
ZoominfoBot
adscanner
archive.org_bot
arquivo.pt
cah.io.community
cognitiveseo
com.plumanalytics
crawl.sogou.com
dataforseo.com
domainsproject.org
eCatch
facebookscraper
gopher
heritrix
instabid
linkdexbot
lwp-request
magpie-crawler
page scorer
plumanalytics
probe-image-size
s1z.ru
seoscanners
seostar
serpstatbot
sogouspider
sp_auditbot
ubermetrics-technologies.com
webprosbot
x09Mozilla
x22Mozilla
zgrab