nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-23 10:09:49 +00:00

250 lines
2.6 KiB
Text

360Spider
80legs
ADmantX
AIBOT
ALittle Client
Abonti
AfD-Verbotsverfahren
AiHitBot
Alligator
AlphaBot
Anarchy99
Asterias
BDCbot
Battleztar Bazinga
Bigfoot
Blackboard
Blow
Bolt
Brandprotect
BuiltBotTough
BuiltWith
Cegbfeieh
CensysInspect
CherryPicker
ChinaClaw
Cocolyzebot
Cogentbot
Collector
CopyRightCheck
CrazyWebCrawler
Crescent
Curious
CyotekWebCopy
DBLBot
DSearch
DTS Agent
DatabaseDriverMysqli
Demon
Devil
Discoverybot
DnyzBot
DomCopBot
Domains Project
Download Wonder
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi
Exabot
Express WebPictures
FDM
FHscan
FlashGet
Flunky
Foobot
Freeuploader
FrontPage
Fuzz
Fyrebot
GT::WWW
Getintent
Gigabot
Go!Zilla
Grafula
GrapeFX
GridBot
HTMLparser
HTTP::Lite
HaosouSpider
Heritrix
HybridBot
IDBTE4M
IlseBot
Indy Library
Internet Ninja
Iskanie
IstellaBot
JOC Web Spider
Joomla
Jorgee
Keyword Density
LNSpiderguy
Lanshanbot
Larbin
LeechFTP
LeechGet
LieBaoFast
Lightspeedsystems
Likse
LinkWalker
Linkbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
MJ12bot
MSFrontPage
MTRobot
Majestic SEO
Majestic12
MarkWatch
MauiBot
Mb2345Browser
MeanPath Bot
Metauri
Microsoft URL Control
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Msrabot
Musobot
NICErsPRO
NPbot
Nameprotect
Navroad
Nessus
Net Vampire
NetAnts
NetMechanic
NetZIP
Netcraft
Netvibes
Nibbler
Nikto
Nimbostratus
Ninja
Nmap
Nuclei
Offline Navigator
OnCrawl
Openfind
PHPCrawl
Page Analyzer
PageAnalyzer
Pandalytics
Panscient
Picscout
PictureFinder
Piepmatz
PleaseCrawl
Probethenet
QueryN Metasearch
RSSingBot
RankingBot
RankingBot2
RankurBot
Re-re
Reaper
RocketCrawler
SBIder
SMTBot
ScoutJet
Scrapy
Searchestate
SemanticJuice
SentiBot
Shodan
Site Sucker
SiteLockSpider
SiteSucker
Sitebeam
Siteimprove
Sitevigil
Snapbot
Snoopy
Sociscraper
Sottopop
SpaceBison
SpankBot
Sqlmap
Sqworm
SurveyBot
Suzuran
Swiftbot
T8Abot
Teleport
TeleportPro
Telesphoreo
The Intraformant
TheNomad
Titan
Tracemyfile
Trendiction
Turingos
TurnitinBot
Typhoeus
URLy Warning
URLy.Warning
UnisterBot
Upflow
VelenPublicWebCrawler
VidibleScraper
Virusdie
WASALive-Bot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WeSEE
Web Collage
Web Enhancer
Web Pix
Web Sucker
WebAuto
WebBandit
WebCollage
WebCopier
WebFuck
WebImageCollector
WebPix
WebReaper
WebStripper
WebZIP
WebmasterWorldForumBot
Webshag
WebsiteQuester
Webster
Whacker
Who.is Bot
WinHTTrack
Wonderbot
Xenu
YoudaoBot
ZmEu
ZumBot
adscanner
arquivo-web-crawler
arquivo.pt
autoemailspider
check1.exe
cognitiveseo
crawler.feedback
crawler4j
demandbase-bot
eCatch
ips-agent
isitwp.com
linkdexbot
mediawords
muhstik-scan
oBot
satoristudio.net
scalaj-http
seobility
webgains-bot
webprosbot
x22Mozilla
zauba.io