nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-03 22:07:11 +00:00

250 lines
2.6 KiB
Text

Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
AlphaBot
Anarchie
Anthill
Apexoo
Aspiegel
AwarioRssBot
AwarioSmartBot
BBBike
BackWeb
Backlink-Ceck
BetaBot
Boardreader
BotALot
Brandprotect
Brandwatch
Buck
BuiltWith
Bullseye
BunnySlippers
CCBot
CheTeam
CheeseBot
Chlooe
Cloud mapping
Cocolyzebot
Collector
Copyscape
Craftbot
Curious
Custo
DatabaseDriverMysqli
Demon
Digincore
DigitalPebble
Dirbuster
Disco
Discoverybot
Dispatch
DittoSpyder
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
Ebingbong
Ecxi
EirGrabber
Exabot
Express WebPictures
ExtLinksBot
EyeNetIE
FDM
Freeuploader
Fuzz
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
Gigabot
Go!Zilla
GoZilla
GrabNet
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
Haansoft
Hloader
HybridBot
IDBTE4M
Iblog
Image Fetch
Indy Library
Iria
IstellaBot
JamesBOT
JetCar
Jetty
JikeSpider
Joomla
JustView
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LexiBot
LieBaoFast
Lightspeedsystems
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MIIxpc
MQQBrowser
MSIECrawler
Mag-Net
Mass Downloader
Mata Hari
Meanpathbot
MegaIndex.ru
Metauri
Microsoft Data Access
Mister PiX
Mojolicious
Musobot
NPbot
Navroad
Nessus
NetLyzer
NetZIP
Netcraft
Nettrack
Niki-bot
NimbleCrawler
Ninja
Nuclei
Nutch
Octopus
OpenLinkProfiler
Openvas
OutclicksBot
OutfoxBot
Page Analyzer
PageAnalyzer
Pandalytics
Panscient
Pavuk
Petalbot
Picsearch
Pockey
Pump
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankActive
RankingBot
RankingBot2
Rankivabot
Re-re
RebelMouse
Recorder
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks-Robot
SEOprofiler
SEOstats
Screaming
ScrepyBot
Searchestate
SemrushBot
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
SiteSucker
SlySearch
Snoopy
SocialRankIOBot
Sociscraper
SpaceBison
Spammen
SpankBot
Spanner
Sqlworm
Sqworm
Sucuri
SurveyBot
T0PHackTeam
Teleport
TeleportPro
Telesphoreo
TheNomad
Titan
Toata
Trendiction
Trendictionbot
Twice
Typhoeus
URLy.Warning
VB Project
VCI
Virusdie
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWW::Mechanize
WeSEE
Web Auto
Web Enhancer
Web Fuck
WebAuto
WebBandit
WebCollage
WebEnhancer
WebFetch
WebGo IS
WebLeacher
WebReaper
WebSauger
WebsiteQuester
Whack
Whatweb
Widow
WinHTTrack
Xaldon WebSpider
Zauba
Zermelo
Zitebot
ZumBot
arquivo-web-crawler
autoemailspider
backlink-check
clark-crawler
coccocbot-web
crawler.feedback
domainsproject.org
evc-batch
internetVista monitor
isitwp.com
magpie-crawler
meanpathbot
probe-image-size
ripz
satoristudio.net
seoscanners
serpstatbot
spyfu
sysscan
trendiction.de
voyagerx.com
webmeup-crawler
webprosbot
zgrab