nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-02-12 22:07:12 +00:00

250 lines
2.7 KiB
Text

360Spider
404enemy
ADmantX
Abonti
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
AllSubmitter
AlphaBot
Anarchie
Ankit
Anthill
Aspiegel
Asterias
Atomseobot
AwarioSmartBot
BDFetch
BLEXBot
BackStreet
BackWeb
Badass
Battleztar Bazinga
Bitacle
Black Hole
Blackboard
Blow
Bolt
Buck
Buddy
Bullseye
BuzzSumo
CCBot
CODE87
CSHttp
Calculon
CheeseBot
CherryPicker
ChinaClaw
Citoid
Cliqzbot
Cogentbot
Collector
Cosmos
Craftbot
Crescent
Custo
DIIbot
DTS Agent
Deusu
Devil
Dirbuster
Disco
Discoverybot
DittoSpyder
DomainAppender
Domains Project
Dragonfly
Drip
EMail Siphon
EasyDL
Express WebPictures
ExtractorPro
Extreme Picture Finder
Fimap
Firefox/7.0
FlashGet
Foobot
Freeuploader
FrontPage
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GT::WWW
Genieo
Go-Ahead-Got-It
Gotit
Grabber
GrapeshotCrawler
HTMLparser
Hloader
HybridBot
IlseBot
Image Sucker
Intelliseek
InterGET
Internet Ninja
InternetSeer
Jbrofuzz
JustView
Keybot Translation-Search-Machine
Kinza
LNSpiderguy
LWP::Simple
Leap
LeechGet
LibWeb
Libwhisker
Likse
LinkScan
LinkextractorPro
LinqiaRSSBot
Lipperhey
MIDown tool
MIIxpc
MJ12bot
Mail.RU_Bot
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
Microsoft Data Access
Microsoft URL Control
Mister PiX
Name Intelligence
Nameprotect
Net Vampire
NetAnts
NetLyzer
Nettrack
NextGenSearchBot
Nibbler
Nikto
Nmap
Nuclei
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
OrangeBot
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Pandalytics
Pi-Monster
Picsearch
Piepmatz
Pixray
PleaseCrawl
ProPowerBot
ProWebWalker
Probethenet
Psbot
Pump
QueryN Metasearch
RankActive
RankFlex
ReGet
Reaper
RebelMouse
RedesScrapy
Ripper
RocketCrawler
SEOkicks-Robot
SalesIntelligent
Scanbot
ScoutJet
Searchestate
SentiBot
SeobilityBot
SiteCheckerBotCrawler
Snapbot
Snoopy
Sottopop
Spammen
Spbot
Steeler
SuperBot
SurveyBot
T0PHackTeam
T8Abot
Telesoft
Telesphoreo
Thumbor
Titan
Toata
Trendiction
Turnitin
Typhoeus
URLy Warning
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
WASALive-Bot
WWW-Collector-E
WWW::Mechanize
WeSEE
Web Auto
Web Enhancer
WebBandit
WebCopier
WebEnhancer
WebGo IS
WebLeacher
WebPix
WebReaper
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteQuester
Webster
Whack
Whatweb
WiseGuys Robot
Wonderbot
Zade
Zeus
ZoominfoBot
archive.org_bot
autoemailspider
backlink-check
check1.exe
crawler4j
demandbase-bot
domainsproject.org
eCatch
facebookscraper
ips-agent
isitwp.com
linkdexbot
lwp-request
lwp-trivial
meanpathbot
mediawords
netEstate NE Crawler
pcBrowser
polaris version
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seoscanners
serpstatbot
siteripz
sogouspider
sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com
webpros.com
x22Mozilla
zauba.io
zgrab