nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-05-23 10:17:00 +00:00

100 lines
1 KiB
Text

ADmantX
AIBOT
ASPSeek
Aipbot
Alligator
Atomseobot
BlowFish
Brandprotect
Bullseye
BunnySlippers
CensysInspect
Citoid
ClaudeBot
Crawling at Home Project
CrazyWebCrawler
CyotekWebCopy
Deusu
Digincore
Dispatch
DittoSpyder
EMail Wolf
Ebingbong
Evil
EyeNetIE
Ezooms
FDM
FlashGet
Freeuploader
Getintent
Grabber
HTMLparser
HTTrack
Hloader
IDBot
InternetMeasurement
JamesBOT
Keybot Translation-Search-Machine
LWP::Simple
LinksManager
MSFrontPage
MSIECrawler
Majestic SEO
MarkMonitor
MarkWatch
Mass Downloader
Minefield
Mojeek
Musobot
NPbot
Net Vampire
NetAnts
NextGenSearchBot
NimbleCrawler
Nmap
Nuclei
Openvas
Panscient
PeoplePal
ProWebWalker
RSSingBot
RankActive
SEOlyticsCrawler
Semrush
SemrushBot-FT
Sitevigil
Snake
Sosospider
SpaceBison
Sqlworm
Steeler
SuperHTTP
Suzuran
Swiftbot
The Intraformant
TheNomad
TightTwatBot
Vacuum
VidibleScraper
Virusdie
VoidEYE
Wallpapers
Web Enhancer
Web Fetch
Web Pix
WebFetch
Webshag
Whacker
Wprecon
Zermelo
ZoominfoBot
demandbase-bot
heritrix
imagesift.com
lwp-request
muhstik-scan
oBot
omgili
seocompany.store
seoscanners
sysscan