nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-01 10:09:47 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404enemy
80legs
ALittle Client
Aboundex
AiHitBot
Alexibot
Anarchie
Ankit
Apexoo
Aspiegel
Atomseobot
BDCbot
BDFetch
BLEXBot
Backlink-Ceck
Barkrowler
Black Hole
Blackboard
BlowFish
BuiltBotTough
Bullseye
CATExplorador
CODE87
CSHttp
CazoodleBot
Cegbfeieh
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Citoid
Cocolyzebot
Copyscape
Cosmos
CrunchBot
DIIbot
DSearch
Demon
Deusu
Dirbuster
Discobot
Discoverybot
Domains Project
Dotbot
Download Wonder
Dragonfly
Express WebPictures
Extreme Picture Finder
Fuzz
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetWeb
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
Grabber
GrapeFX
HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
Harvest
Humanlinks
HybridBot
IDBTE4M
Iblog
Id-search
IlseBot
Image Sucker
InfoNaviRobot
InterGET
Internet Ninja
InternetSeer
Iskanie
IstellaBot
JennyBot
JikeSpider
Joomla
JustView
Jyxobot
Kenjin Spider
Kinza
LexiBot
Lftp
LibWeb
Libwhisker
LieBaoFast
Likse
LinkWalker
Lipperhey Spider
Litemage_walker
Lmspider
MJ12bot
MSFrontPage
MTRobot
Mail.RU_Bot
MarkWatch
Masscan
Mata Hari
Mb2345Browser
Meanpathbot
Metauri
MicroMessenger
Microsoft Data Access
Msrabot
Musobot
NPbot
Name Intelligence
Navroad
Net Vampire
NetLyzer
NetZIP
NextGenSearchBot
Nibbler
Nikto
Ninja
Nmap
Nutch
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
Papa Foto
PeoplePal
Petalbot
Pi-Monster
Picsearch
PictureFinder
Piepmatz
Pockey
ProPowerBot
Probethenet
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankFlex
RankurBot
Re-re
ReGet
RebelMouse
RepoMonkey
RocketCrawler
SBIder
SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
ScoutJet
Screaming
ScreenerBot
ScrepyBot
Searchestate
Seekport
Semrush
SemrushBot
Shodan
Siphon
SiteExplorer
SiteLockSpider
SiteSucker
Sitebeam
Siteimprove
Snoopy
Sosospider
Spbot
Spinn3r
Sqlmap
Stripper
SuperHTTP
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Teleport
Telesphorep
Titan
Turingos
Turnitin
Twice
V-BOT
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voltron
WASALive-Bot
WWW-Mechanize
Wallpapers
Web Collage
Web Pix
Web Sauger
WebCollage
WebCopier
WebFetch
WebReaper
WebSauger
WebStripper
Website Quester
Whack
Whatweb
Who.is Bot
WinHTTrack
Woobot
Wotbox
Wprecon
Zade
ZmEu
ZyBorg
arquivo.pt
autoemailspider
check1.exe
coccocbot-web
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler4j
domainsproject.org
eCatch
gopher
heritrix
instabid
ips-agent
iubenda-radar
meanpathbot
oBot
pcBrowser
probe-image-size
s1z.ru
satoristudio.net
seobility
spyfu
tAkeOut
ubermetrics-technologies.com
voyagerx.com
webpros.com
webprosbot
x22Mozilla
zauba.io
zgrab