nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-01-08 10:07:07 +00:00

100 lines
1.1 KiB
Text

Abonti
Anarchie
Anarchy
Anthill
BackDoorBot
Bandit
BlowFish
Bytespider
CODE87
CopyRightCheck
Crawling at Home Project
DIIbot
Digincore
DomCopBot
DomainCrawler
EroCrawler
Exabot
ExtLinksBot
ExtractorPro
EyeNetIE
Gigabot
Go-Ahead-Got-It
HTTrack
Iskanie
IstellaBot
JamesBOT
Kozmosbot
LWP::Simple
Leap
LeechGet
LexiBot
Likse
LinkextractorPro
LinksManager
MarkMonitor
Mass Downloader
Mediatoolkitbot
Moblie Safari
MolokaiBot
Nessus
Netcraft
Offline Explorer
Offline Navigator
Openvas
OrangeBot
OutfoxBot
PageAnalyzer
PageGrabber
Panscient
PeoplePal
PleaseCrawl
ProWebWalker
Pump
RebelMouse
Recorder
Rogerbot
SBIder
ScanAlert
ScoutJet
Siphon
SiteLockSpider
SlySearch
Snoopy
Sqlmap
SuperBot
Swiftbot
Teleport
The Intraformant
Thumbor
TinyTestBot
Titan
Trendictionbot
VB Project
VeriCiteCrawler
WISENutbot
WPScan
WWW-Mechanize
Wallpapers/3.0
WeSEE
WebFuck
WebGo IS
WinHTTrack
Xaldon_WebSpider
Zade
ZoominfoBot
ZumBot
check1.exe
clark-crawler
com.plumanalytics
crawler.feedback
dataforseobot
domainsproject.org
gopher
internetVista monitor
lwp-trivial
pcBrowser
siteripz
tAkeOut
x22Mozilla
zgrab