nginx-ultimate-bad-bot-blocker/.dev-tools/test_units/random-bots-for-whitelist-test.list
2019-06-26 12:12:03 +02:00

250 lines
2.6 KiB
Text

404enemy
Aboundexbot
AfD-Verbotsverfahren
Alexibot
AlphaBot
Apexoo
archive.org_bot
Asterias
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
BackStreet
Badass
Bandit
BatchFTP
BDCbot
Bigfoot
Bitacle
Blackboard
Black Hole
BlackWidow
Blow
Boardreader
BotALot
Buddy
Bullseye
Calculon
Cegbfeieh
CherryPicker
CheTeam
Chlooe
Claritybot
cognitiveseo
crawler4j
CrazyWebCrawler
Crescent
CrunchBot
CSHttp
DatabaseDriverMysqli
DataCha0s
DBLBot
demandbase-bot
Demon
Devil
DigitalPebble
Dirbuster
DittoSpyder
Download Wonder
Drip
DTS Agent
EasyDL
Ebingbong
ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
Exabot
ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FemtosearchBot
FlashGet
Flunky
FyberSpider
GalaxyBot
GermCrawler
Getintent
Gigablast
Gigabot
GrabNet
GrapeshotCrawler
Havij
Hloader
HTMLparser
Humanlinks
IDBot
IlseBot
Image Sucker
IndeedBot
Indy Library
instabid
InterGET
InternetSeer
Iria
IstellaBot
JamesBOT
Jbrofuzz
JetCar
Jetty
JikeSpider
Joomla
Kenjin Spider
Larbin
LeechFTP
LeechGet
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Linkdexbot
LinkpadBot
LinksManager
LinkWalker
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
lwp-request
LWP::Simple
lwp-trivial
Magnet
magpie-crawler
Majestic SEO
Majestic-SEO
MarkWatch
Mass Downloader
meanpathbot
Meanpathbot
Microsoft URL Control
MIDown tool
MJ12bot
MSFrontPage
MSIECrawler
MS Web Services Client Protocol
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
NetAnts
NetLyzer
NetMechanic
Nettrack
NetZIP
NICErsPRO
NimbleCrawler
Nimbostratus
Ninja
NPbot
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
OrangeSpider
OutfoxBot
PageScorer
Pandalytics
Panscient
pcBrowser
PECL::HTTP
PictureFinder
Pi-Monster
Pockey
POE-Component-Client-HTTP
Pump
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankurBot
Reaper
RebelMouse
Recorder
RedesScrapy
SalesIntelligent
SBIder
ScanAlert
scan.lol
Scrapy
SearchmetricsBot
SemrushBot
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SEOstats
sexsearcher
SISTRIX
SiteSnagger
SiteSucker
Site Sucker
Sitevigil
SlySearch
SMTBot
Snoopy
SocialRankIOBot
Sogou web spider
Spammen
sp_auditbot
Spbot
spyfu
Sqlworm
Sqworm
Sucuri
SuperBot
SurveyBot
Suzuran
Swiftbot
Teleport
Telesphoreo
Thumbor
Titan
Toata
Toweyabot
Trendictionbot
True_Robot
Typhoeus
UnisterBot
URLy.Warning
VeriCiteCrawler
VidibleScraper
VoidEYE
WallpapersHD
WASALive-Bot
WBSearchBot
Webalta
WebAuto
WebBandit
WebCollage
WebCopier
WEBDAV
WebFetch
WebGo IS
WebLeacher
webmeup-crawler
WebPix
Web Pix
Web Sauger
Webshag
WebsiteExtractor
Website Quester
Webster
WebWhacker
Whacker
Widow
WiseGuys Robot
WPScan
WWW-Mechanize
WWW::Mechanize
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
zauba.io
Zermelo
ZmEu
ZyBorg