nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-20 07:12:17 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
ADmantX
AIBOT
Aboundexbot
Aipbot
Alligator
AlphaBot
Anarchie
Ankit
Aspiegel
Attach
AwarioSmartBot
BBBike
BackStreet
BacklinkCrawler
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
BlowFish
Brandprotect
Brandwatch
Buck
Bullseye
BuzzSumo
CATExplorador
CazoodleBot
CheTeam
ChinaClaw
Cloud mapping
Crescent
Curious
CyotekWebCopy
DSearch
DataCha0s
DatabaseDriverMysqli
Dirbuster
Disco
Discobot
Dispatch
DnyzBot
DomCopBot
DomainAppender
DomainStatsBot
Domains Project
Dotbot
Download Wonder
EasyDL
Ebingbong
Ecxi
EirGrabber
Exabot
Express WebPictures
FDM
FHscan
FemtosearchBot
Flunky
Freeuploader
FyberSpider
Fyrebot
GetRight
Go-Ahead-Got-It
Gotit
GrabNet
Grabber
Grafula
GrapeFX
GridBot
HEADMasterSEO
HTTP::Lite
HaosouSpider
Heritrix
Humanlinks
IRLbot
Id-search
Image Fetch
Intelliseek
InterGET
Internet Ninja
InternetSeer
Iria
IstellaBot
Jbrofuzz
Jetty
Joomla
Jorgee
JustView
LWP::Simple
Lanshanbot
Larbin
LeechGet
Libwhisker
Likse
LinkScan
Linkbot
Linkdexbot
LinkpadBot
LinksManager
LinqiaRSSBot
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MSFrontPage
MSIECrawler
Mag-Net
Majestic-SEO
MarkWatch
Masscan
MauiBot
Meanpathbot
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Msrabot
Musobot
Name Intelligence
Nameprotect
Navroad
Needle
Net Vampire
NetMechanic
Nettrack
NextGenSearchBot
Ninja
Nuclei
Nutch
Octopus
Offline Explorer
OpenLinkProfiler
Openfind
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
PageThing.com
Panscient
Pavuk
Picscout
Picsearch
Piepmatz
Pimonster
ProWebWalker
Probethenet
Pump
PyCurl
Quick-Crawler
RankActive
RankingBot2
Re-re
ReGet
RealDownload
RebelMouse
Ripper
Rogerbot
SEOlyticsCrawler
ScoutJet
Scrapy
ScreenerBot
SemrushBot
SentiBot
SeoSiteCheckup
SiteCheckerBotCrawler
SiteSucker
Sitebeam
Siteimprove
Snake
Snoopy
SocialRankIOBot
Sottopop
Spammen
Spanner
Spbot
Sqlmap
Sqworm
Suzuran
T0PHackTeam
Telesoft
Telesphorep
The Intraformant
TheNomad
Titan
Trendiction
Trendictionbot
True_Robot
Turnitin
TwengaBot
Typhoeus
URLy.Warning
Upflow
V-BOT
Vagabondo
VelenPublicWebCrawler
Voltron
WASALive-Bot
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Collage
Web Enhancer
Web Fetch
Web Pix
Web Sucker
WebEnhancer
WebFuck
WebImageCollector
WebLeacher
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Whack
WinHTTrack
WiseGuys Robot
Xaldon WebSpider
Xenu
Zeus
arquivo-web-crawler
arquivo.pt
crawl.sogou.com
crawler.feedback
crawler4j
evc-batch
facebookscraper
heritrix
instabid
isitwp.com
lwp-request
magpie-crawler
page scorer
plumanalytics
polaris version
ripz
scalaj-http
seostar
sitechecker.pro
siteripz
sogouspider
sp_auditbot
spyfu
sysscan
xpymep1.exe
zauba.io