nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-09 22:06:49 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
ALittle Client
ASPSeek
Aboundex
Aboundexbot
AllSubmitter
Alligator
Anarchy
Anarchy99
Ankit
AwarioSmartBot
BDFetch
BLEXBot
BackStreet
Bandit
Barkrowler
BatchFTP
BlackWidow
Blow
BlowFish
Brandwatch
BunnySlippers
BuzzSumo
CazoodleBot
Cegbfeieh
CheeseBot
CherryPicker
Chlooe
Copier
Craftbot
Crescent
CrunchBot
DBLBot
DTS Agent
DataCha0s
Demon
Deusu
Devil
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainStatsBot
Download Wonder
Evil
Exabot
Express WebPictures
ExtractorPro
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Fimap
Foobot
Freeuploader
Fuzz
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GetRight
Go!Zilla
Gotit
Grabber
Grafula
GridBot
HMView
HTMLparser
HTTrack
Havij
Heritrix
Hloader
HybridBot
IDBot
Iblog
Id-search
Intelliseek
IstellaBot
JamesBOT
Jbrofuzz
JetCar
JikeSpider
Jorgee
Jyxobot
Keyword Density
Kozmosbot
LNSpiderguy
Lanshanbot
LeechFTP
LeechGet
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkWalker
LinkpadBot
LinqiaScrapeBot
Litemage_walker
Lmspider
MIDown tool
MIIxpc
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Mata Hari
MauiBot
Mb2345Browser
Metauri
MicroMessenger
Mojeek
Mozlila
Msrabot
Name Intelligence
Nameprotect
NearSite
Nessus
NetLyzer
NimbleCrawler
Nuclei
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OrangeBot
OutfoxBot
Pandalytics
Papa Foto
Pavuk
PeoplePal
PictureFinder
Piepmatz
Pixray
Pockey
ProWebWalker
Probethenet
Psbot
RankActive
RankActiveLinkBot
RankingBot2
Re-re
Reaper
Recorder
SEOkicks
SEOlyticsCrawler
SISTRIX
SMTBot
Scrapy
ScreenerBot
ScrepyBot
SearchmetricsBot
SemanticJuice
SemrushBot
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
SiteCheckerBotCrawler
Sitebeam
Sitevigil
SlySearch
SmartDownload
SocialRankIOBot
Sottopop
Spanner
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Sucker
SuperBot
Szukacz
T0PHackTeam
Telesphoreo
Telesphorep
Tracemyfile
Trendictionbot
Turingos
Typhoeus
URLy.Warning
V-BOT
VB Project
VCI
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WWW-Mechanize
WWWOFFLE
Web Collage
WebFetch
WebSauger
WebSucker
Webalta
WebmasterWorldForumBot
Webshag
Webster
Widow
WinHTTrack
Wonderbot
Woobot
Wprecon
Xaldon_WebSpider
YoudaoBot
Zade
Zeus
Zitebot
ZoominfoBot
ZyBorg
arquivo.pt
check1.exe
clark-crawler
com.plumanalytics
dataforseo.com
eCatch
evc-batch
instabid
internetVista monitor
ips-agent
isitwp.com
lwp-request
lwp-trivial
mediawords
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
polaris version
probe-image-size
ripz
scalaj-http
scan.lol
seobility
seostar
sitechecker.pro
siteripz
sysscan
tAkeOut
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webpros.com
webprosbot
x09Mozilla