nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-20 22:07:20 +00:00

250 lines
2.6 KiB
Text

01h4x.com
80legs
ADmantX
ALittle Client
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
Alligator
Anarchy
Anthill
Aspiegel
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BackStreet
BackWeb
Badass
Barkrowler
BatchFTP
BetaBot
BlowFish
Bullseye
BuzzSumo
CCBot
CODE87
Calculon
CensysInspect
CheeseBot
Cliqzbot
Custo
DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli
Deusu
Disco
Discobot
Discoverybot
DittoSpyder
DomainCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
Dragonfly
EMail Siphon
EasyDL
Ebingbong
Ecxi
EroCrawler
Evil
Extreme Picture Finder
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
FrontPage
FyberSpider
G-i-g-a-b-o-t
Getintent
Gigablast
Go!Zilla
Go-Ahead-Got-It
Grabber
HEADMasterSEO
HMView
Humanlinks
InfoNaviRobot
InfoTekies
InternetSeer
Iskanie
Jetty
Jorgee
Keyword Density
Kinza
Lanshanbot
Leap
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
Linkbot
Linkdexbot
LinkextractorPro
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
MFC_Tear_Sample
MIDown tool
MSIECrawler
MarkMonitor
MarkWatch
Masscan
Mata Hari
MeanPath Bot
Meanpathbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mojeek
Mojolicious
NPbot
NetSpider
NetZIP
Netcraft
NextGenSearchBot
Nibbler
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nmap
Nutch
Offline Navigator
Openfind
Openvas
OrangeBot
PHPCrawl
PageScorer
Pandalytics
Panscient
Petalbot
PictureFinder
Piepmatz
Pixray
ProPowerBot
Psbot
PyCurl
RankFlex
RankingBot2
RankurBot
Re-re
RealDownload
Reaper
RebelMouse
RocketCrawler
Rogerbot
SEOkicks
SEOlyticsCrawler
SEOprofiler
SISTRIX
SMTBot
Scanbot
SearchmetricsBot
Semrush
SeoSiteCheckup
SeobilityBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSucker
Sitebeam
Sitevigil
Snake
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Spammen
SpankBot
Spbot
SputnikBot
Sqlmap
Sucker
Sucuri
SuperBot
Surfbot
SurveyBot
T8Abot
Telesoft
Telesphoreo
TheNomad
Tracemyfile
Trendiction
Turingos
Turnitin
TurnitinBot
UnisterBot
Upflow
VB Project
VCI
Vagabondo
VelenPublicWebCrawler
Voil
Voltron
WASALive-Bot
WBSearchBot
WISENutbot
WWW-Collector-E
WWWOFFLE
WeSEE
Web Sucker
WebEnhancer
WebFuck
WebGo IS
WebSauger
WebStripper
WebZIP
WebsiteExtractor
Webster
Whack
Whatweb
Who.is Bot
WiseGuys Robot
Wonderbot
Wotbox
Wprecon
YoudaoBot
ZmEu
ZoomBot
ZyBorg
archive.org_bot
arquivo-web-crawler
autoemailspider
cah.io.community
check1.exe
cognitiveseo
crawl.sogou.com
crawler.feedback
crawler4j
demandbase-bot
eCatch
evc-batch
ips-agent
lwp-request
lwp-trivial
mediawords
polaris version
probe-image-size
ripz
satoristudio.net
scalaj-http
seobility
sp_auditbot
spyfu
tAkeOut
x09Mozilla
zgrab