nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-05-29 10:07:08 +00:00

100 lines
1 KiB
Text

360Spider
AlphaBot
Aspiegel
Asterias
Atomseobot
BuiltBotTough
CATExplorador
CCBot
Cegbfeieh
Cliqzbot
CrunchBot
Curious
CyotekWebCopy
DSearch
Dirbuster
Download Wonder
FemtosearchBot
Freeuploader
GT::WWW
GetRight
GetWeb
GrabNet
GrapeshotCrawler
HTMLparser
Harvest
HonoluluBot
HybridBot
Iria
Iskanie
JOC Web Spider
JamesBOT
Jbrofuzz
Lftp
LinkpadBot
MTRobot
MarkMonitor
Mata Hari
MeanPath Bot
MicroMessenger
Minefield
Mojeek
Mr.4x3
Msrabot
NICErsPRO
Nessus
NetZIP
NimbleCrawler
Nimbostratus
Nuclei
OutclicksBot
PECL::HTTP
PHPCrawl
Pandalytics
Picscout
PictureFinder
Pixray
Quick-Crawler
Re-re
SMTBot
SalesIntelligent
SearchmetricsBot
SeekportBot
Semrush
SemrushBot
Seomoz
Shodan
SputnikBot
Sqlmap
Sqworm
SuperBot
Szukacz
Teleport
Toata
Toweyabot
Trendiction
UnisterBot
VB Project
VeriCiteCrawler
Voil
Web Fetch
Web Sauger
WebStripper
Webster
Woobot
Wotbox
Xenu
Zauba
ZoomBot
cognitiveseo
crawler4j
domainsproject.org
gopher
lwp-trivial
mediawords
netEstate NE Crawler
page scorer
satoristudio.net
scan.lol
sp_auditbot
xpymep1.exe