nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-07-02 12:37:18 +02:00

250 lines
2.6 KiB
Text

360Spider
Aboundex
AiHitBot
Alligator
AlphaBot
Apexoo
archive.org_bot
autoemailspider
BackDoorBot
backlink-check
Badass
BatchFTP
Battleztar Bazinga
BDCbot
BDFetch
BetaBot
Bitacle
Blackboard
BlackWidow
Blow
BlowFish
Bolt
Brandprotect
BuiltBotTough
BuiltWith
Calculon
CATExplorador
CCBot
Chlooe
coccocbot-web
cognitiveseo
Copier
Copyscape
crawler4j
Crescent
Curious
Custo
Deusu
Devil
Digincore
DIIbot
Dirbuster
Discobot
Download Wonder
Dragonfly
DTS Agent
ECCP/1.0
EMail Wolf
Evil
Express WebPictures
ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
facebookscraper
FDM
FemtosearchBot
FHscan
FlashGet
Flunky
Foobot
Freeuploader
FrontPage
GalaxyBot
GetRight
Gigablast
Gigabot
G-i-g-a-b-o-t
Go!Zilla
Grabber
GrabNet
GrapeFX
Havij
HMView
HTTrack
HybridBot
Id-search
Indy Library
InfoNaviRobot
instabid
Internet Ninja
InternetSeer
internetVista monitor
ips-agent
Iria
Iskanie
JennyBot
Jetty
JOC Web Spider
Jyxobot
Keyword Density
Kozmosbot
Lanshanbot
Larbin
LibWeb
Libwhisker
Lightspeedsystems
LinkpadBot
LinkWalker
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
LNSpiderguy
lwp-request
Mag-Net
Majestic SEO
MarkMonitor
MarkWatch
Masscan
MauiBot
MeanPath Bot
Mediatoolkitbot
MFC_Tear_Sample
Microsoft URL Control
MIIxpc
MJ12bot
Mojeek
Mr.4x3
MS Web Services Client Protocol
muhstik-scan
Name Intelligence
Nameprotect
NetAnts
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
Nettrack
Net Vampire
Nibbler
Ninja
Nmap
NPbot
Nutch
oBot
Offline Explorer
OnCrawl
Openfind
OpenLinkProfiler
OpenVAS
OrangeSpider
OutclicksBot
Page Analyzer
page scorer
PHPCrawl
Picscout
Picsearch
PictureFinder
Pi-Monster
Pixray
PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP
ProPowerBot
Psbot
Pump
PxBroker
QueryN Metasearch
RankActive
RankingBot2
RankurBot
RealDownload
Reaper
RepoMonkey
Ripper
RocketCrawler
SalesIntelligent
ScanAlert
Scanbot
scan.lol
Scrapy
ScreenerBot
Semrush
SEOprofiler
seoscanners
SeoSiteCheckup
SEOstats
Sitebeam
SiteExplorer
SiteLockSpider
SiteSucker
Site Sucker
SmartDownload
SMTBot
Snake
Snapbot
Snoopy
Sosospider
Sottopop
Spammen
SpankBot
Sqlworm
Stripper
Sucuri
SuperBot
SuperHTTP
Suzuran
Szukacz
T8Abot
Teleport
Telesoft
Telesphorep
Thumbor
Trendictionbot
trendiction.com
TwengaBot
Twice
URLy Warning
URLy.Warning
VB Project
VCI
VeriCiteCrawler
Virusdie
Voil
WallpapersHD
Webalta
Web Collage
WebCopier
WEBDAV
WebEnhancer
Web Enhancer
Web Fetch
WebmasterWorldForumBot
WebPix
Web Pix
WebSauger
Web Sauger
Webster
WebStripper
Web Sucker
WebWhacker
WebZIP
WeSEE
Whacker
WiseGuys Robot
WISENutbot
Wonderbot
WWW-Mechanize
WWW::Mechanize
x22Mozilla
Xenu
xpymep1.exe
YoudaoBot
Zade
zauba.io
Zeus
zgrab
ZmEu