nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-18 10:08:50 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter
Alligator
Anarchy99
Apexoo
Asterias
AwarioSmartBot
BDCbot
BackStreet
Backlink-Ceck
BacklinkCrawler
BatchFTP
BetaBot
Bigfoot
BotALot
Brandwatch
Buck
Bullseye
BunnySlippers
CODE87
CensysInspect
CheeseBot
CherryPicker
Chlooe
Cogentbot
Collector
Cosmos
Custo
DSearch
DatabaseDriverMysqli
Devil
DigitalPebble
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DnyzBot
DomCopBot
DomainSigmaCrawler
DomainStatsBot
Ebingbong
EirGrabber
Evil
Express WebPictures
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
Foobot
FrontPage
Fuzz
GalaxyBot
GetRight
GetWeb
Gigablast
Go!Zilla
GoZilla
Gotit
GrabNet
GridBot
HTMLparser
HTTrack
Haansoft
Hloader
HybridBot
IDBot
Iblog
Id-search
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek
Internet Ninja
InternetSeer
JOC Web Spider
Jbrofuzz
Jetty
JikeSpider
Joomla
JustView
Kinza
LNSpiderguy
LWP::Simple
Leap
LibWeb
Libwhisker
Lightspeedsystems
LinkScan
LinkWalker
Linkbot
Linkdexbot
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Ltx71
Mail.RU_Bot
MarkWatch
Mass Downloader
Masscan
MauiBot
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Name Intelligence
Nameprotect
Navroad
Needle
Net Vampire
Nettrack
NextGenSearchBot
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Offline Explorer
OnCrawl
OpenLinkProfiler
Openfind
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto
Pavuk
PeoplePal
Piepmatz
Pimonster
Pixray
Probethenet
PxBroker
RankActive
Re-re
ReGet
RedesScrapy
Rogerbot
SBIder
SEOkicks
SEOstats
SISTRIX
Screaming
Semrush
SemrushBot
SeobilityBot
Seomoz
SiteSnagger
Snoopy
SocialRankIOBot
Sogou web spider
Spanner
Spinn3r
Sqlworm
Sucuri
Swiftbot
Telesphoreo
Telesphorep
The Intraformant
Toata
Toweyabot
TurnitinBot
TwengaBot
Twice
URLy.Warning
Vacuum
Vagabondo
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voltron
WISENutbot
WWW::Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
WeSEE
Web Collage
Web Enhancer
Web Fuck
Web Sucker
WebBandit
WebCollage
WebFetch
WebZIP
WebmasterWorldForumBot
Website Quester
Webster
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wprecon
Zermelo
archive.org_bot
backlink-check
cah.io.community
check1.exe
clark-crawler
coccocbot-web
com.plumanalytics
demandbase-bot
evc-batch
instabid
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
mediawords
muhstik-scan
oBot
page scorer
pcBrowser
seoscanners
sitechecker.pro
siteripz
sysscan
tAkeOut
trendiction.de
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla