nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-22 22:07:15 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
ADmantX
AIBOT
Aboundexbot
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Anthill
Atomseobot
BLEXBot
Backlink-Ceck
Bandit
Barkrowler
BatchFTP
Bigfoot
Bitacle
Boardreader
Bolt
BotALot
Buddy
BuiltBotTough
Bullseye
BuzzSumo
CATExplorador
CSHttp
CherryPicker
ChinaClaw
Claritybot
Cliqzbot
Copyscape
Curious
Custo
DSearch
DTS Agent
DataCha0s
Demon
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
DnyzBot
DomCopBot
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EMail Wolf
Ebingbong
EirGrabber
Evil
ExtractorPro
Ezooms
FHscan
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Foobot
FrontPage
Fuzz
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Getintent
Gigabot
GoZilla
GrapeshotCrawler
HTTP::Lite
HTTrack
Haansoft
Humanlinks
IDBot
IlseBot
Image Sucker
InternetSeer
Iria
Iskanie
JOC Web Spider
JennyBot
JikeSpider
Joomla
Jyxobot
Kenjin Spider
Keyword Density
Kinza
LeechGet
LexiBot
LibWeb
Lightspeedsystems
Linkbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lmspider
MFC_Tear_Sample
MIIxpc
MJ12bot
Mail.RU_Bot
Majestic SEO
MarkWatch
Masscan
MicroMessenger
Microsoft Data Access
Minefield
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Mozlila
NICErsPRO
NPbot
Name Intelligence
NearSite
Needle
NetLyzer
NetZIP
Nettrack
Nimbostratus
Nmap
Not
Nuclei
Nutch
Octopus
Offline Navigator
OnCrawl
OrangeSpider
PECL::HTTP
PHPCrawl
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Panscient
PeoplePal
Pi-Monster
Picscout
Pimonster
PleaseCrawl
Pockey
ProPowerBot
Probethenet
Pu_iN
QueryN Metasearch
Quick-Crawler
RSSingBot
RankFlex
Rankivabot
Recorder
RocketCrawler
SEOkicks
SEOkicks-Robot
SMTBot
ScrepyBot
Seekport
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
Sitevigil
Snake
Snoopy
Sociscraper
SpankBot
Sqlmap
Sucker
Surfbot
Swiftbot
Szukacz
Telesoft
The Intraformant
TheNomad
TightTwatBot
Toweyabot
Trendictionbot
Turingos
TurnitinBot
URLy.Warning
VB Project
VCI
Vacuum
Vagabondo
VeriCiteCrawler
Virusdie
VoidEYE
Voil
WBSearchBot
WPScan
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fuck
Web Sauger
WebAuto
WebBandit
WebEnhancer
WebLeacher
WebPix
WebWhacker
Website Quester
Webster
Whacker
Who.is Bot
Widow
WinHTTrack
Wprecon
Zade
Zitebot
ZumBot
ZyBorg
adscanner
arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community
clark-crawler
crawl.sogou.com
demandbase-bot
gopher
instabid
internetVista monitor
linkdexbot
lwp-request
lwp-trivial
meanpathbot
netEstate NE Crawler
pcBrowser
plumanalytics
s1z.ru
satoristudio.net
seostar
sogouspider
sp_auditbot
tAkeOut
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
zgrab