nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-06 10:12:52 +00:00

250 lines
2.5 KiB
Text

01h4x.com
360Spider
ADmantX
ALittle Client
ASPSeek
Aboundex
Acunetix
Aipbot
Ankit
Apexoo
Asterias
Attach
BDCbot
BackDoorBot
BackStreet
Backlink-Ceck
Badass
Blackboard
BlowFish
Brandprotect
Buddy
BuiltBotTough
BuiltWith
CODE87
CazoodleBot
CensysInspect
CheTeam
CherryPicker
Chlooe
Citoid
Claritybot
Cocolyzebot
Collector
Copyscape
CrazyWebCrawler
CrunchBot
CyotekWebCopy
DIIbot
DSearch
DTS Agent
Devil
Digincore
Disco
Discoverybot
DomainAppender
DomainStatsBot
Download Wonder
Drip
EMail Siphon
Ecxi
Evil
Express WebPictures
ExtLinksBot
Ezooms
FDM
FHscan
Freeuploader
FrontPage
FyberSpider
GT::WWW
GalaxyBot
GetWeb
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrabNet
HEADMasterSEO
HMView
HTTrack
Harvest
Havij
HybridBot
IRLbot
Image Sucker
InterGET
InternetSeer
IstellaBot
JOC Web Spider
JetCar
Jetty
JustView
Keyword Density
Kozmosbot
LWP::Simple
Lanshanbot
Larbin
Leap
LeechFTP
Lftp
LibWeb
Libwhisker
LinkScan
LinkWalker
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Lmspider
Ltx71
MIIxpc
MQQBrowser
MSFrontPage
MTRobot
Magnet
Mass Downloader
Masscan
MegaIndex.ru
Microsoft URL Control
Minefield
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
NICErsPRO
NPbot
Name Intelligence
Nameprotect
Navroad
Needle
NetAnts
NetZIP
Netcraft
Netvibes
NextGenSearchBot
Ninja
Not
OpenVAS
OrangeBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Petalbot
Pi-Monster
Picsearch
PictureFinder
Piepmatz
PleaseCrawl
Pockey
ProPowerBot
PyCurl
QueryN Metasearch
RSSingBot
RankActive
RankActiveLinkBot
Re-re
ReGet
Recorder
RedesScrapy
RocketCrawler
SBIder
SEOstats
ScanAlert
ScoutJet
SeoSiteCheckup
Shodan
SiteExplorer
SiteSucker
Sitebeam
Sitevigil
Snapbot
SocialRankIOBot
Spammen
Spbot
Spinn3r
SputnikBot
Sqlworm
Steeler
Sucuri
SuperBot
SuperHTTP
Suzuran
Swiftbot
Szukacz
Teleport
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Toata
Toweyabot
Trendiction
True_Robot
Turingos
VCI
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
WASALive-Bot
WBSearchBot
WEBDAV
WPScan
WWW::Mechanize
WWWOFFLE
WeSEE
Web Auto
Web Fetch
WebCopier
WebEnhancer
WebGo IS
WebPix
WebReaper
WebZIP
Webalta
Webshag
Website Quester
Webster
Whatweb
Widow
WinHTTrack
Wonderbot
Woobot
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade
Zermelo
ZmEu
adscanner
arquivo.pt
autoemailspider
cah.io.community
clark-crawler
cognitiveseo
crawl.sogou.com
domainsproject.org
ips-agent
isitwp.com
muhstik-scan
pcBrowser
polaris version
ripz
s1z.ru
satoristudio.net
seobility
seostar
siteripz
spyfu
tAkeOut
voyagerx.com
webmeup-crawler
xpymep1.exe
zauba.io