nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-15 22:07:14 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
80legs
ADmantX
ALittle Client
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
AllSubmitter
Anarchy
Aspiegel
Atomseobot
BBBike
BDCbot
BackDoorBot
BackWeb
Backlink-Ceck
Bandit
Black Hole
BlackWidow
BlowFish
Boardreader
Bolt
Brandprotect
Brandwatch
BunnySlippers
CazoodleBot
CensysInspect
ChinaClaw
Chlooe
Claritybot
Cogentbot
Cosmos
Crawling at Home Project
CrunchBot
CyotekWebCopy
DBLBot
DIIbot
DSearch
DataCha0s
Deusu
Devil
Digincore
DigitalPebble
Dirbuster
Dispatch
DittoSpyder
DnBCrawler-Analytics
Domains Project
Dotbot
Dragonfly
ECCP/1.0
EirGrabber
Evil
Exabot
Extreme Picture Finder
FDM
Foobot
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GermCrawler
GetWeb
Go!Zilla
Gotit
Grafula
GrapeshotCrawler
HTTrack
Harvest
Havij
HonoluluBot
Image Fetch
Image Sucker
InterGET
Internet Ninja
Iskanie
IstellaBot
JOC Web Spider
Jbrofuzz
Jetty
Joomla
Jorgee
JustView
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Kinza
Lanshanbot
Leap
LeechFTP
LeechGet
LibWeb
LieBaoFast
Likse
LinkWalker
LinkextractorPro
LinkpadBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
MIDown tool
MQQBrowser
Mag-Net
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkWatch
Mata Hari
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft URL Control
Mozlila
Nameprotect
NetLyzer
NetMechanic
Netcraft
NimbleCrawler
Nimbostratus
Ninja
Nmap
Nutch
OpenVAS
Openfind
OrangeSpider
OutclicksBot
POE-Component-Client-HTTP
PageThing.com
Pandalytics
PeoplePal
Petalbot
Picsearch
Pimonster
Pixray
Probethenet
Pu_iN
Quick-Crawler
RSSingBot
RankActive
RankFlex
RankurBot
Re-re
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
ScanAlert
Scrapy
Searchestate
Seekport
Semrush
SemrushBot
SeobilityBot
Seomoz
Siphon
SiteExplorer
SiteSucker
SlySearch
Snapbot
SocialRankIOBot
Sosospider
Spanner
Spinn3r
SputnikBot
Sucker
SuperHTTP
Telesphorep
TheNomad
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turnitin
TurnitinBot
URLy Warning
Vacuum
VeriCiteCrawler
VidibleScraper
Voil
Voltron
WISENutbot
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Enhancer
Web Pix
WebAuto
WebCollage
WebCopier
WebEnhancer
WebFuck
WebGo IS
WebLeacher
WebSauger
WebSucker
WebZIP
Website Quester
WebsiteExtractor
Webster
Whatweb
Who.is Bot
Woobot
Wotbox
Wprecon
Zade
Zauba
Zermelo
Zeus
ZoominfoBot
ZumBot
arquivo-web-crawler
cah.io.community
demandbase-bot
eCatch
evc-batch
facebookscraper
heritrix
instabid
internetVista monitor
isitwp.com
lwp-request
magpie-crawler
oBot
page scorer
plumanalytics
polaris version
s1z.ru
seobility
seocompany.store
seoscanners
seostar
serpstatbot
sexsearcher
sogouspider
sp_auditbot
voyagerx.com
webgains-bot
webmeup-crawler
x22Mozilla
xpymep1.exe
zgrab