nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-15 10:09:07 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ADmantX
ASPSeek
Abonti
Aboundex
Acunetix
AllSubmitter
AlphaBot
Anarchy
Anthill
Attach
BBBike
BDCbot
BDFetch
BackDoorBot
BackStreet
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Black Hole
BlowFish
Bolt
Brandprotect
BunnySlippers
BuzzSumo
CazoodleBot
Cegbfeieh
CherryPicker
Claritybot
Cocolyzebot
Copyscape
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Curious
Custo
CyotekWebCopy
DBLBot
DIIbot
Demon
Disco
Discobot
DittoSpyder
DomCopBot
DomainCrawler
Dotbot
EasyDL
Ebingbong
Exabot
Express WebPictures
FlashGet
Fyrebot
GalaxyBot
Grabber
GrapeshotCrawler
GridBot
HMView
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Harvest
Heritrix
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
Internet Ninja
IstellaBot
Jbrofuzz
JennyBot
Jorgee
JustView
Kenjin Spider
Keyword Density
Kinza
LNSpiderguy
Larbin
Leap
LeechFTP
Lftp
LibWeb
Libwhisker
Lightspeedsystems
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
MIDown tool
MSFrontPage
MTRobot
Mail.RU_Bot
Majestic-SEO
MarkWatch
Masscan
MeanPath Bot
Meanpathbot
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Mr.4x3
Msrabot
Name Intelligence
Needle
Nessus
NetLyzer
NetMechanic
NetZIP
Nettrack
Netvibes
Nibbler
Nikto
Nimbostratus
Not
Offline Explorer
Openfind
OrangeSpider
OutclicksBot
PECL::HTTP
Page Analyzer
PageAnalyzer
PageThing.com
Pandalytics
PeoplePal
Picscout
Piepmatz
Psbot
PxBroker
RankActive
RankingBot
Rankivabot
RealDownload
RebelMouse
RepoMonkey
RocketCrawler
SISTRIX
Scanbot
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
SemanticJuice
SentiBot
SeobilityBot
Shodan
SiteExplorer
SiteLockSpider
SiteSnagger
SlySearch
SmartDownload
Snake
Snapbot
Snoopy
Sogou web spider
Sosospider
Spammen
SpankBot
Spanner
Spinn3r
Steeler
Sucuri
SuperHTTP
Surfbot
Suzuran
Swiftbot
Teleport
TeleportPro
Telesoft
The Intraformant
TheNomad
Toata
Tracemyfile
Trendiction
Trendictionbot
True_Robot
TwengaBot
Twice
Typhoeus
URLy Warning
V-BOT
Vacuum
VelenPublicWebCrawler
Virusdie
WPScan
WWW-Mechanize
WWWOFFLE
WallpapersHD
Web Enhancer
Web Fetch
WebCollage
WebCopier
WebEnhancer
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebReaper
WebSauger
WebStripper
Webalta
Webshag
WebsiteExtractor
WebsiteQuester
Whack
Who.is Bot
WiseGuys Robot
Wonderbot
Wotbox
YoudaoBot
Zade
Zitebot
ZoomBot
archive.org_bot
arquivo.pt
backlink-check
check1.exe
coccocbot
cognitiveseo
crawler.feedback
domainsproject.org
eCatch
heritrix
iubenda-radar
lwp-trivial
magpie-crawler
netEstate NE Crawler
oBot
pcBrowser
polaris version
scalaj-http
seobility
seocompany.store
sitechecker.pro
sysscan
trendiction.de
webgains-bot
webprosbot
xpymep1.exe