nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-28 22:07:15 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
ADmantX
AIBOT
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AllSubmitter
AlphaBot
Anarchy
Apexoo
Attach
BBBike
BackDoorBot
BackStreet
BackWeb
BacklinkCrawler
Bandit
Battleztar Bazinga
BetaBot
Bitacle
Boardreader
Bolt
Buddy
BuiltBotTough
Bullseye
CATExplorador
CODE87
CensysInspect
CheTeam
CheeseBot
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Copier
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Custo
DBLBot
DIIbot
DSearch
DataCha0s
Devil
DigitalPebble
Dirbuster
Disco
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainSigmaCrawler
DomainStatsBot
Dotbot
Ebingbong
Exabot
Extractor
Ezooms
Fimap
FlashGet
FrontPage
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetWeb
Go!Zilla
GoZilla
GrabNet
GrapeshotCrawler
HTMLparser
Haansoft
Heritrix
IDBot
Iblog
IndeedBot
InfoTekies
Internet Ninja
Iria
Iskanie
JetCar
JikeSpider
Joomla
JustView
Kenjin Spider
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
LeechGet
LexiBot
Lftp
Libwhisker
Likse
LinkScan
LinkWalker
Linkdexbot
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Masscan
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Microsoft URL Control
Minefield
Musobot
NICErsPRO
NPbot
Needle
Netcraft
Nettrack
NextGenSearchBot
Niki-bot
Ninja
Nmap
Nutch
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
Openfind
Openvas
OrangeBot
OutfoxBot
PageThing.com
Pavuk
Pi-Monster
PictureFinder
Pimonster
Pockey
ProPowerBot
Psbot
PxBroker
QueryN Metasearch
RankingBot
RankingBot2
ReGet
RealDownload
SBIder
SEOkicks-Robot
SEOprofiler
SEOstats
SMTBot
Screaming
ScrepyBot
Searchestate
SearchmetricsBot
SemanticJuice
Semrush
SentiBot
Seomoz
SiteExplorer
SiteSnagger
Siteimprove
Sitevigil
SmartDownload
SocialRankIOBot
Sottopop
Spanner
SputnikBot
Sucuri
SuperHTTP
Suzuran
T8Abot
Telesoft
Toata
Trendictionbot
Turingos
Twice
Typhoeus
VB Project
VCI
VidibleScraper
VoidEYE
WASALive-Bot
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Fetch
Web Fuck
Web Pix
WebCopier
WebEnhancer
WebFetch
WebLeacher
WebReaper
WebmasterWorldForumBot
WebsiteQuester
Whack
Whacker
Who.is Bot
Widow
WiseGuys Robot
Woobot
YoudaoBot
Zermelo
Zeus
Zitebot
ZoomBot
ZoominfoBot
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
cah.io.community
check1.exe
coccocbot-web
dataforseo.com
facebookscraper
gopher
heritrix
isitwp.com
meanpathbot
mediawords
page scorer
pcBrowser
plumanalytics
polaris version
probe-image-size
ripz
satoristudio.net
seoscanners
sogouspider
sp_auditbot
trendiction.de
ubermetrics-technologies.com
x09Mozilla
xpymep1.exe