nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-27 22:06:49 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
404checker
AIBOT
ALittle Client
ASPSeek
Aboundexbot
Aipbot
AllSubmitter
Alligator
Anarchy
Ankit
Anthill
Apexoo
Atomseobot
Attach
BBBike
BDCbot
BackStreet
BackWeb
BacklinkCrawler
Badass
BatchFTP
BlackWidow
Blackboard
Brandwatch
BuzzSumo
CATExplorador
CazoodleBot
Cegbfeieh
CheTeam
ChinaClaw
Chlooe
Citoid
Cloud mapping
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
CyotekWebCopy
DBLBot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Devil
Dirbuster
DnBCrawler-Analytics
DomainStatsBot
Dragonfly
ECCP/1.0
EMail Wolf
Ebingbong
Evil
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
FDM
FHscan
FemtosearchBot
Foobot
Freeuploader
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GermCrawler
GetWeb
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO
Harvest
Havij
Hloader
HonoluluBot
Humanlinks
IDBTE4M
IlseBot
IndeedBot
InfoTekies
Internet Ninja
IstellaBot
JikeSpider
Joomla
Jorgee
LNSpiderguy
LWP::Simple
Larbin
Lftp
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MSIECrawler
Majestic SEO
Majestic-SEO
Mass Downloader
Masscan
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft URL Control
Minefield
Mojeek
Musobot
NICErsPRO
Name Intelligence
Nameprotect
Navroad
NearSite
Net Vampire
NetLyzer
NetMechanic
NetSpider
NetZIP
Nettrack
Nikto
Nmap
Nuclei
Nutch
Offline Explorer
Offline Navigator
OrangeBot
OrangeSpider
OutclicksBot
PECL::HTTP
PHPCrawl
PageAnalyzer
PageGrabber
Panscient
Pavuk
PeoplePal
Pi-Monster
Picscout
PleaseCrawl
ProWebWalker
Pu_iN
Quick-Crawler
RSSingBot
RankActive
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
Re-re
ReGet
Ripper
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SMTBot
ScanAlert
Scanbot
ScoutJet
ScrepyBot
Searchestate
SearchmetricsBot
SemanticJuice
Shodan
SiteExplorer
SiteSucker
Sitevigil
SmartDownload
Snake
Sottopop
Stripper
Sucker
Surfbot
Suzuran
Telesphorep
TheNomad
Toweyabot
Trendictionbot
TurnitinBot
Twice
Typhoeus
UnisterBot
Upflow
Vagabondo
VelenPublicWebCrawler
WEBDAV
WPScan
WWW::Mechanize
Wallpapers/3.0
Web Auto
Web Enhancer
Web Fetch
Web Sauger
WebCopier
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebReaper
WebStripper
WebZIP
WebsiteExtractor
Webster
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Zeus
ZmEu
adscanner
archive.org_bot
backlink-check
crawl.sogou.com
demandbase-bot
evc-batch
internetVista monitor
iubenda-radar
linkdexbot
lwp-request
magpie-crawler
meanpathbot
mediawords
pcBrowser
plumanalytics
s1z.ru
scalaj-http
sexsearcher
siteripz
sogouspider
sp_auditbot
voyagerx.com
webmeup-crawler
zauba.io