nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-24 10:09:14 +00:00

250 lines
2.6 KiB
Text

ALittle Client
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
Aipbot
Alexibot
AllSubmitter
Ankit
Aspiegel
Asterias
Attach
AwarioRssBot
BDFetch
BLEXBot
BackDoorBot
Backlink-Ceck
Badass
Battleztar Bazinga
Blackboard
Boardreader
Bullseye
BunnySlippers
CATExplorador
CensysInspect
CheTeam
CherryPicker
Chlooe
Claritybot
Cloud mapping
Cogentbot
Copyscape
Cosmos
CrazyWebCrawler
Custo
DBLBot
DataCha0s
DatabaseDriverMysqli
Deusu
Devil
Digincore
Disco
Dispatch
DnyzBot
DomainAppender
DomainCrawler
Download Wonder
Dragonfly
Drip
ECCP/1.0
EasyDL
EirGrabber
Exabot
ExtLinksBot
ExtractorPro
Ezooms
FHscan
Firefox/7.0
FlashGet
Freeuploader
FrontPage
Fuzz
GT::WWW
Getintent
GoZilla
Gotit
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HMView
HTTP::Lite
HaosouSpider
Harvest
Heritrix
Humanlinks
HybridBot
IDBTE4M
Iblog
Id-search
IndeedBot
Intelliseek
InternetSeer
Iria
Jbrofuzz
Jorgee
Jyxobot
Larbin
LeechFTP
Lftp
LibWeb
Libwhisker
LieBaoFast
Likse
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
MJ12bot
Mag-Net
Magnet
Majestic12
Mass Downloader
Mb2345Browser
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mojeek
Mr.4x3
NearSite
Needle
Nessus
Net Vampire
NetAnts
NetLyzer
NetMechanic
NetSpider
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Ninja
Nutch
Offline Explorer
OpenLinkProfiler
OpenVAS
OrangeSpider
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
Pandalytics
Panscient
Papa Foto
Pavuk
PeoplePal
Picscout
Piepmatz
Pixray
PleaseCrawl
ProPowerBot
Psbot
Pu_iN
PyCurl
RSSingBot
RankActive
RankFlex
RebelMouse
RepoMonkey
SBIder
SEOkicks
SEOlyticsCrawler
SEOstats
Scanbot
ScoutJet
ScrepyBot
SemrushBot
SeobilityBot
Seomoz
Siphon
Sitebeam
Sitevigil
SlySearch
SmartDownload
Snake
Snoopy
Sociscraper
Sogou web spider
Sottopop
Spammen
SpankBot
Spbot
SputnikBot
Sqlmap
Stripper
Sucker
SuperBot
Surfbot
SurveyBot
Teleport
Telesphorep
Toata
Tracemyfile
Trendictionbot
Turingos
TurnitinBot
Twice
Typhoeus
URLy Warning
UnisterBot
V-BOT
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
VoidEYE
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
Web Auto
WebCopier
WebEnhancer
WebGo IS
WebReaper
WebSauger
WebWhacker
WebmasterWorldForumBot
Webster
Who.is Bot
WiseGuys Robot
Wonderbot
Xaldon_WebSpider
Xenu
Zauba
Zermelo
Zeus
Zitebot
ZyBorg
archive.org_bot
autoemailspider
cah.io.community
check1.exe
cognitiveseo
crawler4j
demandbase-bot
domainsproject.org
eCatch
facebookscraper
instabid
ips-agent
lwp-request
mediawords
muhstik-scan
pcBrowser
plumanalytics
polaris version
scalaj-http
seoscanners
serpstatbot
sitechecker.pro
sogouspider
spyfu
voyagerx.com
webmeup-crawler
zauba.io