nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-24 22:07:39 +00:00

250 lines
2.6 KiB
Text

AIBOT
ALittle Client
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter
Anarchie
Anthill
Apexoo
Asterias
BBBike
BDCbot
BLEXBot
BackStreet
Badass
Barkrowler
Black Hole
BlackWidow
Blow
BlowFish
Boardreader
BotALot
Brandprotect
Buck
Bullseye
BunnySlippers
CCBot
CODE87
CazoodleBot
Cegbfeieh
CheTeam
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
CopyRightCheck
Copyscape
Crawling at Home Project
CrazyWebCrawler
Crescent
Curious
Custo
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
DatabaseDriverMysqli
Demon
DigitalPebble
Dirbuster
Disco
Discoverybot
DomainSigmaCrawler
Domains Project
Download Wonder
Dragonfly
EasyDL
EirGrabber
ExtLinksBot
Extreme Picture Finder
FDM
FemtosearchBot
Fuzz
G-i-g-a-b-o-t
GetRight
GetWeb
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HTTP::Lite
Harvest
Heritrix
Hloader
IDBTE4M
Image Sucker
InfoNaviRobot
Internet Ninja
IstellaBot
JetCar
Jyxobot
Kenjin Spider
Kozmosbot
LWP::Simple
LeechGet
LexiBot
Lftp
LibWeb
Likse
LinkScan
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSIECrawler
Mag-Net
Magnet
Majestic SEO
Majestic-SEO
Majestic12
Masscan
MauiBot
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Mister PiX
Mojeek
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Nameprotect
Navroad
Needle
Nessus
NetAnts
NetSpider
NetZIP
Nettrack
Netvibes
Nibbler
Nikto
NimbleCrawler
Nmap
Not
Nuclei
Octopus
Offline Navigator
OpenVAS
OutclicksBot
Page Analyzer
PageScorer
Pavuk
Petalbot
PictureFinder
Pimonster
Pixray
PleaseCrawl
Pockey
ProWebWalker
Psbot
Pu_iN
Pump
RankingBot
RankingBot2
RankurBot
ReGet
Reaper
Recorder
RocketCrawler
Rogerbot
SBIder
SEOlyticsCrawler
SEOstats
SISTRIX
SalesIntelligent
ScrepyBot
SemanticJuice
Semrush
SentiBot
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SmartDownload
Spbot
SputnikBot
Sqlmap
Sqworm
Stripper
SuperBot
SuperHTTP
Szukacz
T0PHackTeam
Teleport
Telesphoreo
Telesphorep
TheNomad
Toweyabot
Tracemyfile
Turingos
Turnitin
Twice
UnisterBot
Upflow
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voltron
Wallpapers
Web Enhancer
Web Pix
Web Sucker
WebBandit
WebFuck
WebStripper
WebmasterWorldForumBot
Webster
Whack
Wprecon
Xenu
YoudaoBot
Zade
ZoomBot
ZoominfoBot
ZumBot
arquivo-web-crawler
autoemailspider
com.plumanalytics
crawl.sogou.com
crawler4j
dataforseo.com
domainsproject.org
eCatch
evc-batch
facebookscraper
gopher
internetVista monitor
iubenda-radar
lwp-request
magpie-crawler
muhstik-scan
pcBrowser
sexsearcher
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webpros.com
webprosbot