nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-14 10:09:29 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
404enemy
ALittle Client
Aboundexbot
Acunetix
Aipbot
AllSubmitter
AlphaBot
Anarchie
Anarchy
Anarchy99
Ankit
Apexoo
Asterias
AwarioRssBot
AwarioSmartBot
BackStreet
Backlink-Ceck
Badass
Barkrowler
Bitacle
Black Hole
BotALot
Buck
Buddy
BuiltBotTough
Bullseye
BunnySlippers
CCBot
CODE87
Calculon
Cegbfeieh
CheTeam
Claritybot
CopyRightCheck
Craftbot
Crescent
CrunchBot
Custo
CyotekWebCopy
DIIbot
DataCha0s
Demon
Dirbuster
Discoverybot
DomainAppender
Dragonfly
EMail Siphon
EasyDL
EirGrabber
Evil
Express WebPictures
Extreme Picture Finder
Ezooms
FDM
FHscan
Foobot
Freeuploader
FyberSpider
Fyrebot
GT::WWW
Genieo
GetRight
Go!Zilla
GoZilla
Gotit
Grabber
Grafula
GrapeFX
GrapeshotCrawler
Havij
Humanlinks
HybridBot
IRLbot
IlseBot
Indy Library
InfoNaviRobot
Intelliseek
Internet Ninja
Iria
Iskanie
IstellaBot
JOC Web Spider
Jbrofuzz
JetCar
JikeSpider
JustView
LNSpiderguy
LWP::Simple
Lanshanbot
LibWeb
LieBaoFast
Lightspeedsystems
LinkWalker
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
Ltx71
MIDown tool
MIIxpc
MQQBrowser
MSIECrawler
Mag-Net
Majestic-SEO
MarkMonitor
Mass Downloader
MeanPath Bot
Microsoft Data Access
Moblie Safari
Mojeek
Mozlila
Mr.4x3
Msrabot
Musobot
NPbot
Nameprotect
Navroad
NetAnts
NetLyzer
Nettrack
Netvibes
Nibbler
Niki-bot
Nikto
NimbleCrawler
Ninja
Nuclei
Offline Navigator
OpenVAS
Openfind
OutclicksBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageScorer
Pavuk
PleaseCrawl
Pockey
ProWebWalker
Probethenet
Pump
QueryN Metasearch
RankActive
RankingBot2
Reaper
RedesScrapy
RocketCrawler
Rogerbot
SBIder
SMTBot
ScanAlert
Searchestate
Seekport
SemanticJuice
SemrushBot
SentiBot
SeoSiteCheckup
Site Sucker
SiteSnagger
SiteSucker
Sitebeam
SmartDownload
Snake
Sogou web spider
Sosospider
SpaceBison
Spbot
Sqlworm
Sqworm
Sucker
SuperBot
Surfbot
Szukacz
Teleport
TeleportPro
Telesoft
Telesphoreo
Thumbor
TightTwatBot
Toweyabot
Trendiction
Trendictionbot
True_Robot
Turingos
TurnitinBot
Typhoeus
URLy.Warning
UnisterBot
V-BOT
VidibleScraper
Voltron
WASALive-Bot
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Web Collage
Web Enhancer
WebBandit
WebCopier
WebEnhancer
WebImageCollector
WebLeacher
WebSucker
WebmasterWorldForumBot
Webshag
WebsiteQuester
Webster
Whatweb
WiseGuys Robot
Wprecon
YoudaoBot
Zade
Zeus
ZmEu
ZoomBot
ZyBorg
adscanner
arquivo.pt
autoemailspider
cah.io.community
clark-crawler
domainsproject.org
facebookscraper
instabid
ips-agent
lwp-request
lwp-trivial
magpie-crawler
mediawords
muhstik-scan
oBot
pcBrowser
polaris version
seocompany.store
sexsearcher
sitechecker.pro
sogouspider
sp_auditbot
sysscan
tAkeOut
trendiction.com
webpros.com
xpymep1.exe
zauba.io