nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-18 22:07:07 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
AIBOT
ALittle Client
Aboundex
Acunetix
AhrefsBot
AiHitBot
AlphaBot
Anarchie
Anarchy99
Aspiegel
AwarioRssBot
BDCbot
BDFetch
Badass
Bandit
Battleztar Bazinga
Bigfoot
Black Hole
BlackWidow
Blow
Boardreader
BotALot
Brandwatch
BuiltBotTough
BuiltWith
CATExplorador
Calculon
CazoodleBot
Cegbfeieh
ChinaClaw
Claritybot
Cloud mapping
Cocolyzebot
Collector
CopyRightCheck
Copyscape
Cosmos
CrazyWebCrawler
CyotekWebCopy
DatabaseDriverMysqli
Deusu
Dirbuster
Discobot
DnyzBot
DomCopBot
DomainCrawler
DomainStatsBot
Domains Project
Dragonfly
Drip
EMail Siphon
EMail Wolf
EasyDL
Ecxi
Exabot
Extractor
FHscan
Fimap
FlashGet
Flunky
Foobot
Freeuploader
FrontPage
Fuzz
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GermCrawler
GetRight
Gigabot
Go-Ahead-Got-It
GoZilla
Gotit
Grafula
HTMLparser
HTTrack
Havij
Heritrix
HonoluluBot
HybridBot
Iblog
Id-search
Indy Library
InfoNaviRobot
JamesBOT
Jbrofuzz
JustView
Jyxobot
Kenjin Spider
Kozmosbot
LNSpiderguy
Lanshanbot
Larbin
Leap
LeechGet
LexiBot
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinkextractorPro
LinqiaMetadataDownloaderBot
Ltx71
MIDown tool
MIIxpc
MQQBrowser
MSIECrawler
Magnet
Majestic12
Mass Downloader
Masscan
Mb2345Browser
MeanPath Bot
Meanpathbot
Mister PiX
Moblie Safari
MolokaiBot
Morfeus Fucking Scanner
Msrabot
NearSite
NetAnts
NetMechanic
NetZIP
Netvibes
Nibbler
NimbleCrawler
Nmap
Offline Explorer
OpenVAS
Openfind
OutclicksBot
PHPCrawl
Page Analyzer
PageGrabber
PageScorer
Pi-Monster
Picscout
PictureFinder
Pimonster
Probethenet
Psbot
Pu_iN
Pump
Quick-Crawler
RankActive
Rankivabot
Re-re
RealDownload
Reaper
RebelMouse
RepoMonkey
Ripper
RocketCrawler
SBIder
SEOprofiler
SMTBot
SalesIntelligent
ScanAlert
Scanbot
Scrapy
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
Semrush
SentiBot
Shodan
SlySearch
Sociscraper
Sogou web spider
Sosospider
Sottopop
Spammen
SpankBot
Spbot
Sqlmap
Sqlworm
Sucker
SuperHTTP
SurveyBot
Telesphoreo
Telesphorep
TheNomad
Toweyabot
Turnitin
TwengaBot
URLy Warning
V-BOT
VB Project
VoidEYE
Voil
WASALive-Bot
WBSearchBot
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers
Web Collage
Web Enhancer
Web Fetch
WebAuto
WebCollage
WebCopier
WebFetch
WebGo IS
WebLeacher
WebSauger
WebStripper
WebSucker
Whacker
Whatweb
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Zeus
Zitebot
ZumBot
ZyBorg
arquivo-web-crawler
arquivo.pt
check1.exe
dataforseo.com
demandbase-bot
domainsproject.org
evc-batch
facebookscraper
heritrix
instabid
ips-agent
isitwp.com
iubenda-radar
magpie-crawler
meanpathbot
netEstate NE Crawler
pcBrowser
polaris version
s1z.ru
scalaj-http
seocompany.store
sogouspider
sp_auditbot
trendiction.com
ubermetrics-technologies.com
x09Mozilla
zauba.io