nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-04 10:09:43 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
ADmantX
AIBOT
ALittle Client
Aboundex
Aboundexbot
Acunetix
Aipbot
AlphaBot
Anarchy
Anarchy99
Apexoo
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BLEXBot
BackDoorBot
BackStreet
BatchFTP
Battleztar Bazinga
Blackboard
Blow
Bolt
Brandprotect
Buck
CODE87
CheeseBot
CherryPicker
Claritybot
Cloud mapping
Cocolyzebot
Collector
Copyscape
CrazyWebCrawler
CrunchBot
CyotekWebCopy
DataCha0s
DatabaseDriverMysqli
Demon
Deusu
Digincore
Discobot
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
Domains Project
Dotbot
Download Wonder
EMail Siphon
EMail Wolf
EasyDL
EirGrabber
Evil
Exabot
Express WebPictures
ExtractorPro
Ezooms
FDM
FemtosearchBot
Fimap
FlashGet
Flunky
Fuzz
Gigabot
Go-Ahead-Got-It
GoZilla
Grafula
GrapeFX
HTMLparser
Haansoft
Harvest
Heritrix
Hloader
HybridBot
Id-search
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek
InterGET
InternetSeer
Iria
IstellaBot
JamesBOT
Jetty
JikeSpider
Joomla
Jorgee
Lanshanbot
Larbin
LeechFTP
LeechGet
Lftp
LibWeb
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
MIIxpc
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Mail.RU_Bot
Majestic-SEO
MegaIndex.ru
Microsoft URL Control
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Name Intelligence
Navroad
NetLyzer
NetMechanic
NetSpider
Nettrack
Nibbler
Niki-bot
Nikto
NimbleCrawler
Not
Nuclei
Nutch
Octopus
Offline Explorer
Offline Navigator
OrangeBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
Panscient
Papa Foto
Pavuk
PeoplePal
Picsearch
Pimonster
ProPowerBot
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot2
Re-re
ReGet
RebelMouse
Recorder
RedesScrapy
RocketCrawler
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
Screaming
ScreenerBot
SemanticJuice
SemrushBot
SentiBot
SeoSiteCheckup
Seomoz
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
SiteSnagger
Sitevigil
Snake
Snapbot
Sociscraper
Sosospider
Spbot
Sqlmap
Sqlworm
Steeler
Suzuran
Szukacz
Telesoft
Titan
Toata
Trendiction
Trendictionbot
Turnitin
Typhoeus
UnisterBot
Virusdie
Voltron
WEBDAV
WISENutbot
WWW-Collector-E
WWWOFFLE
Web Pix
WebFetch
WebImageCollector
WebLeacher
WebPix
WebSucker
Webalta
Webster
WinHTTrack
Woobot
Wotbox
Wprecon
Xaldon_WebSpider
Xenu
Zeus
ZoomBot
ZumBot
adscanner
archive.org_bot
arquivo.pt
backlink-check
com.plumanalytics
crawler4j
dataforseo.com
domainsproject.org
evc-batch
heritrix
internetVista monitor
ips-agent
lwp-request
lwp-trivial
oBot
page scorer
pcBrowser
plumanalytics
polaris version
probe-image-size
ripz
seobility
seocompany.store
seoscanners
sitechecker.pro
siteripz
sogouspider
sp_auditbot
spyfu
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
x09Mozilla