nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-07-01 13:33:44 +02:00

250 lines
2.6 KiB
Text

404checker
Aboundexbot
ADmantX
AfD-Verbotsverfahren
Aipbot
Alexibot
AllSubmitter
Anarchie
BackDoorBot
backlink-check
BackStreet
BatchFTP
Battleztar Bazinga
BDFetch
BetaBot
Black Hole
Boardreader
Brandprotect
Buddy
BuzzSumo
CATExplorador
CCBot
Cegbfeieh
CheeseBot
CherryPicker
CheTeam
ChinaClaw
Claritybot
Cliqzbot
Cogentbot
cognitiveseo
Craftbot
Crescent
DBLBot
demandbase-bot
Demon
Digincore
DigitalPebble
DIIbot
Disco
Dispatch
DittoSpyder
DomainCrawler
Dragonfly
DSearch
ECCP/1.0
EMail Wolf
evc-batch
Express WebPictures
Extreme Picture Finder
EyeNetIE
facebookscraper
FDM
FemtosearchBot
FHscan
Fimap
FlashGet
Foobot
FrontPage
Genieo
GermCrawler
GetWeb
Gigabot
G-i-g-a-b-o-t
GoZilla
GrapeFX
GridBot
GT::WWW
Havij
Heritrix
Hloader
HMView
HTMLparser
HTTrack
Iblog
Indy Library
instabid
Intelliseek
InterGET
Internet Ninja
ips-agent
Iria
IRLbot
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JikeSpider
JustView
Jyxobot
Keyword Density
Lanshanbot
LeechFTP
LexiBot
Lftp
LibWeb
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
Ltx71
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Majestic12
MarkMonitor
Mata Hari
MauiBot
Mediatoolkitbot
MegaIndex.ru
MFC_Tear_Sample
Microsoft Data Access
Mister PiX
Mojeek
MSIECrawler
MS Web Services Client Protocol
muhstik-scan
Musobot
Name Intelligence
Nameprotect
Navroad
NearSite
Nessus
NetAnts
Netcraft
NetLyzer
NetMechanic
Net Vampire
Netvibes
Nibbler
NICErsPRO
Nimbostratus
Ninja
NPbot
Nutch
oBot
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
OutfoxBot
PageGrabber
Pandalytics
Papa Foto
pcBrowser
PeoplePal
Picsearch
plumanalytics
Pockey
POE-Component-Client-HTTP
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot
RebelMouse
RedesScrapy
ReGet
Ripper
RocketCrawler
s1z.ru
SalesIntelligent
SBIder
scan.lol
ScoutJet
Screaming
Searchestate
SearchmetricsBot
serpstatbot
sexsearcher
Sitebeam
SiteExplorer
Siteimprove
SiteSnagger
SiteSucker
Site Sucker
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
SpankBot
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqworm
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Suzuran
Szukacz
Teleport
Telesphoreo
Telesphorep
The Intraformant
Thumbor
Toata
trendiction.de
Turingos
Turnitin
TwengaBot
URLy Warning
URLy.Warning
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
WallpapersHD
WASALive-Bot
WBSearchBot
Webalta
WebAuto
Web Auto
WebBandit
Web Enhancer
WebFetch
WebFuck
WebImageCollector
WebLeacher
Web Sauger
Webshag
WebsiteExtractor
WebsiteQuester
WebStripper
WebSucker
Web Sucker
WebWhacker
WebZIP
Who.is Bot
WiseGuys Robot
Wonderbot
WPScan
WWW-Collector-E
WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
Zauba
Zitebot
ZumBot