nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-06 10:09:30 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
AiHitBot
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Aspiegel
Asterias
Atomseobot
BDFetch
BLEXBot
Backlink-Ceck
Battleztar Bazinga
BetaBot
Blackboard
BlowFish
Brandprotect
Brandwatch
Buck
Buddy
BuzzSumo
CCBot
CODE87
CensysInspect
CherryPicker
Citoid
Cliqzbot
Cocolyzebot
Copier
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
Custo
Devil
Dirbuster
Disco
DittoSpyder
DnBCrawler-Analytics
DomainCrawler
DomainStatsBot
Dragonfly
Drip
EasyDL
Exabot
Extractor
ExtractorPro
EyeNetIE
Flunky
FyberSpider
Genieo
Getintent
Gigabot
Go!Zilla
GoZilla
GrabNet
GrapeshotCrawler
HTMLparser
Haansoft
HybridBot
Iblog
IlseBot
Image Fetch
Image Sucker
IndeedBot
InterGET
Internet Ninja
Iskanie
JennyBot
Jetty
JikeSpider
Joomla
Jorgee
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
Leap
LeechGet
Lftp
Libwhisker
Likse
LinkpadBot
LinksManager
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIDown tool
MSIECrawler
MTRobot
Majestic SEO
MarkWatch
Mass Downloader
Mata Hari
Meanpathbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Mr.4x3
Musobot
NearSite
Needle
Nessus
NetMechanic
NetSpider
NextGenSearchBot
Nikto
Nmap
Not
OnCrawl
OrangeBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
Pavuk
PeoplePal
Pi-Monster
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
ProWebWalker
Psbot
QueryN Metasearch
RankActiveLinkBot
RankingBot
Re-re
RealDownload
Reaper
RebelMouse
RedesScrapy
RepoMonkey
RocketCrawler
SEOlyticsCrawler
SISTRIX
Scanbot
ScoutJet
ScreenerBot
SearchmetricsBot
SemanticJuice
Semrush
SemrushBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
Siteimprove
SlySearch
Snapbot
SocialRankIOBot
Sociscraper
Spammen
Spbot
Sqlmap
Sqlworm
Steeler
Stripper
SuperBot
SuperHTTP
SurveyBot
T8Abot
Telesphoreo
Telesphorep
TheNomad
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
TurnitinBot
Typhoeus
URLy.Warning
VB Project
VCI
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Voltron
WASALive-Bot
WISENutbot
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Web Fetch
Web Fuck
Web Sauger
WebBandit
WebFetch
WebFuck
WebImageCollector
WebSauger
WebSucker
WebWhacker
Website Quester
WebsiteExtractor
Webster
Whatweb
Who.is Bot
Wonderbot
Wprecon
Xaldon WebSpider
Zermelo
Zitebot
ZmEu
ZumBot
adscanner
archive.org_bot
arquivo.pt
backlink-check
check1.exe
cognitiveseo
crawler.feedback
crawler4j
dataforseo.com
domainsproject.org
gopher
heritrix
mediawords
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
ripz
s1z.ru
satoristudio.net
seocompany.store
seoscanners
siteripz
spyfu
sysscan
tAkeOut
voyagerx.com
webgains-bot
webmeup-crawler
xpymep1.exe
zauba.io