nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-test.list
2020-01-02 21:31:41 +02:00

250 lines
2.6 KiB
Text

360Spider
80legs
AfD-Verbotsverfahren
AiHitBot
Anarchie
Apexoo
arquivo.pt
arquivo-web-crawler
Asterias
Attach
autoemailspider
AwarioRssBot
AwarioSmartBot
Backlink-Ceck
BacklinkCrawler
BackStreet
BackWeb
BatchFTP
Battleztar Bazinga
BDCbot
BDFetch
BetaBot
Blackboard
BlackWidow
Blow
BlowFish
Boardreader
BotALot
Brandprotect
Buddy
Bullseye
BunnySlippers
CheTeam
Claritybot
Cliqzbot
Cloud mapping
coccocbot-web
Collector
Copier
Cosmos
crawler4j
CrazyWebCrawler
Custo
Deusu
DIIbot
Discobot
Discoverybot
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
Download Wonder
DSearch
DTS Agent
eCatch
ECCP/1.0
Ecxi
Evil
ExtLinksBot
Extractor
Ezooms
FemtosearchBot
Firefox/7.0
FlashGet
Foobot
GalaxyBot
Getintent
GetRight
GetWeb
Go-Ahead-Got-It
Gotit
Grabber
GrabNet
Grafula
Haansoft
Harvest
Havij
heritrix
Heritrix
Hloader
HMView
Humanlinks
IDBot
IlseBot
Image Sucker
Indy Library
InfoTekies
Internet Ninja
Iria
IRLbot
JamesBOT
Jbrofuzz
JennyBot
JikeSpider
Joomla
Jorgee
Jyxobot
Kozmosbot
LeechGet
Lftp
LibWeb
Libwhisker
LinkScan
LinksManager
LinkWalker
LinqiaRSSBot
Litemage_walker
LNSpiderguy
Ltx71
LWP::Simple
lwp-trivial
magpie-crawler
Majestic12
Majestic-SEO
MarkMonitor
MFC_Tear_Sample
Microsoft URL Control
MJ12bot
Mojeek
Mojolicious
Nameprotect
NearSite
Nessus
netEstate NE Crawler
NetLyzer
NetMechanic
NetSpider
Nettrack
Net Vampire
NextGenSearchBot
Nibbler
NICErsPRO
Nikto
NimbleCrawler
Nimbostratus
Nmap
oBot
Octopus
Offline Explorer
Offline Navigator
OnCrawl
Openfind
OpenLinkProfiler
OpenVAS
OrangeSpider
OutfoxBot
PageAnalyzer
Page Analyzer
Pandalytics
Panscient
Pavuk
PECL::HTTP
PeoplePal
PictureFinder
Pimonster
Pi-Monster
Pockey
Probethenet
Psbot
PyCurl
QueryN Metasearch
RankingBot2
Rankivabot
RankurBot
RealDownload
Reaper
RebelMouse
RedesScrapy
RepoMonkey
RocketCrawler
RSSingBot
ScanAlert
Scanbot
Searchestate
SearchmetricsBot
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
seoscanners
SEOstats
SISTRIX
SiteExplorer
SiteLockSpider
SiteSnagger
Site Sucker
SMTBot
Snoopy
Sociscraper
sogouspider
Sosospider
SpaceBison
SpankBot
spyfu
Sqlworm
Steeler
Stripper
Sucker
sysscan
Szukacz
Teleport
Telesphoreo
The Intraformant
TheNomad
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
TurnitinBot
TwengaBot
Twice
Typhoeus
UnisterBot
URLy.Warning
Vacuum
Vagabondo
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
Wallpapers/3.0
WallpapersHD
WASALive-Bot
WBSearchBot
Webalta
WebAuto
Web Auto
WebCollage
WebFetch
WebGo IS
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebSauger
Webster
WebSucker
WebZIP
WeSEE
Whack
Woobot
Wotbox
WWW-Mechanize
WWWOFFLE
Xaldon WebSpider
YoudaoBot
Zermelo
Zitebot