nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-29 10:18:42 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
404enemy
ALittle Client
Aboundexbot
Acunetix
Aipbot
Anarchie
Anarchy
Anarchy99
Anthill
Aspiegel
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Battleztar Bazinga
Black Hole
Blackboard
Brandprotect
BuiltBotTough
BunnySlippers
BuzzSumo
CazoodleBot
CensysInspect
Chlooe
Cloud mapping
Cogentbot
Collector
Copyscape
Crescent
CrunchBot
CyotekWebCopy
DBLBot
DIIbot
DSearch
DTS Agent
DatabaseDriverMysqli
Digincore
Discoverybot
Dispatch
DittoSpyder
DomainStatsBot
Dotbot
Download Wonder
Drip
ECCP/1.0
EMail Siphon
EMail Wolf
Ecxi
EirGrabber
Evil
Extractor
Extreme Picture Finder
EyeNetIE
Foobot
Freeuploader
Fuzz
G-i-g-a-b-o-t
GalaxyBot
Gotit
GrabNet
HTMLparser
HaosouSpider
Harvest
Heritrix
Hloader
HybridBot
Id-search
IlseBot
Intelliseek
Iria
Iskanie
JetCar
Joomla
Jorgee
JustView
Kenjin Spider
Keyword Density
LWP::Simple
Larbin
Leap
LexiBot
Lftp
Libwhisker
Likse
LinkWalker
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Lmspider
MSFrontPage
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
Mass Downloader
Mata Hari
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
Nessus
NetLyzer
NetZIP
NextGenSearchBot
Nibbler
Niki-bot
Nmap
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
OutclicksBot
OutfoxBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Pandalytics
Panscient
Papa Foto
PeoplePal
Petalbot
Piepmatz
Pimonster
PleaseCrawl
Pockey
Psbot
Pu_iN
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActive
RankingBot
RankingBot2
Rankivabot
RankurBot
ReGet
RealDownload
Recorder
Rogerbot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SMTBot
Scanbot
ScreenerBot
ScrepyBot
SearchmetricsBot
SemrushBot
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
Siteimprove
Snoopy
Sociscraper
Sogou web spider
Sottopop
SpankBot
Spanner
Spbot
Sqlmap
Sqworm
Steeler
Stripper
Sucker
SuperHTTP
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
TeleportPro
Telesphoreo
The Intraformant
TightTwatBot
Turingos
TurnitinBot
UnisterBot
Upflow
VB Project
VCI
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
WBSearchBot
WEBDAV
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers
Web Collage
Web Fuck
Web Pix
WebAuto
WebBandit
WebCopier
WebEnhancer
WebImageCollector
WebLeacher
WebmasterWorldForumBot
Website Quester
WebsiteExtractor
Who.is Bot
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
Zade
Zeus
ZoomBot
ZoominfoBot
ZumBot
archive.org_bot
arquivo.pt
cah.io.community
clark-crawler
cognitiveseo
com.plumanalytics
crawler.feedback
evc-batch
gopher
heritrix
lwp-request
muhstik-scan
netEstate NE Crawler
plumanalytics
probe-image-size
scalaj-http
scan.lol
siteripz
sysscan
trendiction.de
voyagerx.com
webprosbot
x09Mozilla
zauba.io