nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-31 10:09:07 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ADmantX
AfD-Verbotsverfahren
Alligator
Anarchy
Asterias
AwarioSmartBot
BDCbot
BackStreet
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
BlackWidow
Blackboard
Blow
BotALot
Brandprotect
Brandwatch
Buck
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
CazoodleBot
CherryPicker
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
Copier
Cosmos
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
Custo
DIIbot
DSearch
DTS Agent
DataCha0s
Demon
DigitalPebble
Discoverybot
Dotbot
Dragonfly
Drip
EMail Siphon
EirGrabber
Evil
FHscan
Flunky
Freeuploader
FrontPage
GT::WWW
GalaxyBot
GetRight
Gigabot
Gotit
GrabNet
HMView
HaosouSpider
Heritrix
Humanlinks
HybridBot
IDBot
IRLbot
InfoTekies
Intelliseek
InterGET
Iria
Iskanie
IstellaBot
JamesBOT
JikeSpider
Kinza
Kozmosbot
Lanshanbot
LeechFTP
LexiBot
LibWeb
LinkpadBot
LinqiaMetadataDownloaderBot
Lmspider
MIDown tool
Mag-Net
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkMonitor
MauiBot
MeanPath Bot
MegaIndex.ru
Metauri
MicroMessenger
Mojolicious
Mr.4x3
NICErsPRO
NPbot
Nameprotect
NearSite
Needle
Nessus
NetMechanic
NetSpider
Nibbler
Niki-bot
Nimbostratus
Ninja
Nutch
Offline Explorer
OpenVAS
Openfind
Openvas
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageGrabber
PageScorer
PageThing.com
Pandalytics
Papa Foto
Pavuk
Petalbot
Pi-Monster
Picsearch
Piepmatz
PleaseCrawl
ProWebWalker
Psbot
Pu_iN
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankingBot
RankingBot2
Re-re
ReGet
RealDownload
RebelMouse
Ripper
RocketCrawler
SEOkicks
SISTRIX
SMTBot
Scrapy
ScrepyBot
Searchestate
Semrush
SentiBot
SeoSiteCheckup
Seomoz
SiteSucker
SmartDownload
SocialRankIOBot
Sociscraper
Sottopop
SpankBot
Spanner
Spinn3r
Stripper
Sucker
SuperBot
SuperHTTP
Surfbot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Telesphoreo
TightTwatBot
Toata
Toweyabot
Trendictionbot
True_Robot
TurnitinBot
TwengaBot
UnisterBot
V-BOT
VelenPublicWebCrawler
WASALive-Bot
WPScan
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
Web Collage
Web Enhancer
Web Fetch
Web Fuck
Web Sauger
Web Sucker
WebCollage
WebCopier
WebEnhancer
WebFuck
WebImageCollector
Webalta
Webshag
Website Quester
WebsiteQuester
Webster
Whacker
Who.is Bot
Widow
Wonderbot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zermelo
Zitebot
ZumBot
arquivo.pt
autoemailspider
backlink-check
cah.io.community
coccocbot-web
com.plumanalytics
dataforseo.com
domainsproject.org
gopher
heritrix
ips-agent
isitwp.com
lwp-trivial
meanpathbot
mediawords
oBot
page scorer
probe-image-size
s1z.ru
seoscanners
seostar
serpstatbot
sexsearcher
siteripz
spyfu
sysscan
trendiction.de
ubermetrics-technologies.com
webprosbot
x22Mozilla
zauba.io