nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-10 10:09:23 +00:00

250 lines
2.7 KiB
Text

ALittle Client
Abonti
Aboundex
Aboundexbot
AfD-Verbotsverfahren
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Ankit
Asterias
BBBike
Bandit
BatchFTP
Bigfoot
BlackWidow
Blackboard
Blow
BlowFish
BotALot
Brandprotect
Buck
Buddy
Calculon
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Claritybot
Cliqzbot
Collector
Copier
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
Custo
DIIbot
Demon
Deusu
Disco
Discoverybot
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Domains Project
Dragonfly
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FHscan
Firefox/7.0
Foobot
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GetRight
Getintent
Go!Zilla
Go-Ahead-Got-It
GrapeFX
GrapeshotCrawler
Haansoft
Harvest
Heritrix
Humanlinks
IDBTE4M
IDBot
Id-search
Image Fetch
Image Sucker
InfoNaviRobot
InterGET
IstellaBot
JOC Web Spider
JamesBOT
JennyBot
Jorgee
JustView
LWP::Simple
Lanshanbot
LeechFTP
LexiBot
Lftp
LinkScan
LinkextractorPro
LinksManager
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MIDown tool
MSIECrawler
Mag-Net
Majestic SEO
Majestic-SEO
Masscan
Mata Hari
Mediatoolkitbot
MicroMessenger
Minefield
Morfeus Fucking Scanner
NPbot
Navroad
Nessus
Net Vampire
NetAnts
NetMechanic
Nettrack
Nibbler
Niki-bot
Ninja
Nuclei
Offline Explorer
OpenVAS
OutclicksBot
PECL::HTTP
Page Analyzer
PageThing.com
Panscient
Petalbot
Picsearch
Pockey
ProWebWalker
Probethenet
Pump
RankingBot
Rankivabot
RealDownload
RebelMouse
Recorder
RocketCrawler
SBIder
SEOlyticsCrawler
SEOprofiler
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
SearchmetricsBot
SemanticJuice
Semrush
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Shodan
Site Sucker
SiteExplorer
Siteimprove
Sitevigil
SlySearch
SmartDownload
Snake
Snoopy
Sociscraper
Sottopop
SpaceBison
Spbot
Spinn3r
SputnikBot
Sqlworm
Steeler
Stripper
Sucker
Sucuri
SurveyBot
Szukacz
T0PHackTeam
Teleport
The Intraformant
TheNomad
Toata
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Typhoeus
URLy Warning
URLy.Warning
V-BOT
VCI
Vagabondo
VeriCiteCrawler
VidibleScraper
VoidEYE
WPScan
WWW-Collector-E
WWW-Mechanize
Web Collage
Web Enhancer
Web Fetch
WebEnhancer
WebImageCollector
WebReaper
WebSauger
WebWhacker
Webster
Whatweb
Who.is Bot
Widow
Xaldon_WebSpider
YoudaoBot
Zauba
Zermelo
Zitebot
ZoomBot
ZoominfoBot
ZyBorg
arquivo-web-crawler
check1.exe
clark-crawler
coccocbot-web
cognitiveseo
com.plumanalytics
crawler.feedback
demandbase-bot
domainsproject.org
facebookscraper
gopher
heritrix
ips-agent
lwp-request
magpie-crawler
mediawords
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
plumanalytics
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seobility
siteripz
ubermetrics-technologies.com
voyagerx.com
webgains-bot
zgrab