nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-27 22:35:41 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
ALittle Client
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alexibot
Anarchie
Apexoo
AwarioRssBot
BDCbot
BackWeb
BacklinkCrawler
Barkrowler
Bigfoot
Brandprotect
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
CCBot
CODE87
CSHttp
Calculon
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Cloud mapping
Cocolyzebot
Collector
CrazyWebCrawler
CrunchBot
DIIbot
DSearch
DTS Agent
DataCha0s
Deusu
Devil
Dirbuster
Dispatch
DomainCrawler
ECCP/1.0
EMail Wolf
Evil
Express WebPictures
Extreme Picture Finder
Ezooms
FemtosearchBot
FlashGet
Flunky
Freeuploader
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetWeb
Getintent
Go-Ahead-Got-It
Gotit
GrabNet
HEADMasterSEO
HMView
HTMLparser
HaosouSpider
Harvest
Havij
Heritrix
Humanlinks
HybridBot
IDBTE4M
IDBot
IRLbot
Image Fetch
InfoTekies
Iskanie
JOC Web Spider
Jbrofuzz
Jetty
JikeSpider
Kenjin Spider
Keyword Density
Kozmosbot
LeechFTP
LeechGet
LibWeb
LinkWalker
Linkdexbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
Magnet
Majestic SEO
Majestic12
MarkWatch
Masscan
MauiBot
Meanpathbot
MegaIndex.ru
Metauri
Mister PiX
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Msrabot
Name Intelligence
Navroad
NetAnts
NetLyzer
NetSpider
Niki-bot
NimbleCrawler
Nimbostratus
Not
Nuclei
OnCrawl
OrangeSpider
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageScorer
Pandalytics
Papa Foto
Picscout
Picsearch
Piepmatz
ProPowerBot
Pump
PyCurl
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RankurBot
Re-re
ReGet
RepoMonkey
Ripper
RocketCrawler
SISTRIX
Scrapy
Screaming
Semrush
SemrushBot
SentiBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
Sitevigil
SlySearch
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
SpankBot
Spbot
Sqlworm
Sqworm
Stripper
Sucker
Sucuri
SuperHTTP
SurveyBot
Suzuran
Swiftbot
Teleport
TeleportPro
TheNomad
True_Robot
Turingos
TwengaBot
Typhoeus
URLy Warning
UnisterBot
Upflow
VCI
VelenPublicWebCrawler
VidibleScraper
Virusdie
VoidEYE
WISENutbot
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Collage
Web Fuck
WebBandit
WebCollage
WebCopier
WebFetch
WebFuck
WebSauger
WebSucker
Webalta
Website Quester
Whack
Whatweb
Who.is Bot
Widow
WiseGuys Robot
Xenu
YoudaoBot
Zade
Zermelo
Zitebot
ZoomBot
ZoominfoBot
ZyBorg
arquivo-web-crawler
backlink-check
check1.exe
coccocbot-web
cognitiveseo
com.plumanalytics
crawl.sogou.com
domainsproject.org
evc-batch
facebookscraper
gopher
heritrix
internetVista monitor
magpie-crawler
meanpathbot
mediawords
netEstate NE Crawler
oBot
pcBrowser
plumanalytics
polaris version
ripz
scan.lol
seobility
seocompany.store
serpstatbot
sexsearcher
sysscan
tAkeOut
trendiction.de
x22Mozilla
xpymep1.exe