nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-25 22:07:24 +00:00

250 lines
2.7 KiB
Text

01h4x.com
360Spider
ALittle Client
ASPSeek
Aboundex
AfD-Verbotsverfahren
AiHitBot
Alexibot
AllSubmitter
AlphaBot
Aspiegel
BDCbot
BackWeb
BacklinkCrawler
BatchFTP
Black Hole
Blackboard
Blow
Boardreader
BotALot
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CCBot
Calculon
Cegbfeieh
CheTeam
CheeseBot
Claritybot
Cloud mapping
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
CyotekWebCopy
DBLBot
DSearch
DatabaseDriverMysqli
Demon
Devil
Digincore
Dispatch
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
Dotbot
Download Wonder
ECCP/1.0
EMail Wolf
EasyDL
Ebingbong
Ecxi
Exabot
ExtLinksBot
Ezooms
FDM
FemtosearchBot
Flunky
Foobot
Freeuploader
Fuzz
FyberSpider
Fyrebot
GT::WWW
Genieo
Gigabot
GridBot
HMView
HTMLparser
Havij
Heritrix
HybridBot
IDBTE4M
IRLbot
Iblog
Id-search
InfoTekies
Intelliseek
Iskanie
IstellaBot
JOC Web Spider
JikeSpider
Joomla
Jorgee
Jyxobot
Keyword Density
LNSpiderguy
Lanshanbot
Lightspeedsystems
Linkdexbot
LinkpadBot
LinksManager
LinqiaRSSBot
Lipperhey Spider
MFC_Tear_Sample
MJ12bot
MSIECrawler
Magnet
Majestic SEO
Mata Hari
Mb2345Browser
MeanPath Bot
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Moblie Safari
Mojolicious
Mr.4x3
Musobot
NICErsPRO
Nameprotect
NearSite
Needle
NetSpider
NetZIP
Netcraft
NextGenSearchBot
Niki-bot
Nimbostratus
Nutch
Octopus
OpenLinkProfiler
Openvas
OrangeBot
OutclicksBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
Panscient
Pavuk
Petalbot
PictureFinder
Piepmatz
Pockey
ProPowerBot
PxBroker
PyCurl
QueryN Metasearch
RankActiveLinkBot
Rankivabot
RankurBot
RealDownload
Reaper
RocketCrawler
Rogerbot
SEOlyticsCrawler
SEOstats
SMTBot
Scanbot
Screaming
Semrush
SentiBot
SeobilityBot
Shodan
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
SiteSnagger
Sitevigil
Snapbot
Snoopy
Sogou web spider
Spammen
SpankBot
Spbot
Spinn3r
Sqlworm
Sucker
Surfbot
SurveyBot
Szukacz
TeleportPro
Telesphorep
Tracemyfile
Trendictionbot
Turingos
TwengaBot
Twice
UnisterBot
Upflow
Vagabondo
VeriCiteCrawler
VoidEYE
WBSearchBot
WWW-Collector-E
WWW::Mechanize
Wallpapers
Web Auto
Web Collage
Web Pix
Web Sucker
WebEnhancer
WebGo IS
WebPix
WebReaper
WebWhacker
WebmasterWorldForumBot
Webster
Whatweb
Who.is Bot
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zermelo
Zitebot
ZumBot
archive.org_bot
backlink-check
clark-crawler
crawl.sogou.com
gopher
isitwp.com
lwp-request
lwp-trivial
muhstik-scan
oBot
plumanalytics
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
scan.lol
seostar
serpstatbot
sexsearcher
sitechecker.pro
siteripz
sogouspider
tAkeOut
ubermetrics-technologies.com
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
xpymep1.exe