nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-09-30 10:07:00 +00:00

100 lines
1,012 B
Text

ADmantX
ALittle Client
Abonti
AhrefsBot
Anarchie
Anarchy99
Aspiegel
Atomseobot
BatchFTP
Bigfoot
BlackWidow
BlowFish
Bolt
Bullseye
CensysInspect
CheeseBot
ChinaClaw
Cogentbot
Cosmos
DBLBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Exabot
ExtLinksBot
Ezooms
FHscan
Fimap
Flunky
GPTBot
GT::WWW
GalaxyBot
Getintent
Go!Zilla
Grabber
Image Sucker
InternetSeer
JamesBOT
Keyword Density
Kozmosbot
Larbin
LibWeb
Lipperhey
Mag-Net
MarkWatch
Mass Downloader
Mediatoolkitbot
Mozlila
Name Intelligence
Navroad
NetZIP
Nettrack
Nibbler
NimbleCrawler
Nutch
OnCrawl
OpenLinkProfiler
OutfoxBot
Panscient
Picscout
ProWebWalker
Proximic
Pump
RankingBot
Ripper
SBIder
SalesIntelligent
ScanAlert
Searchestate
SentiBot
Seomoz
Siteimprove
Snapbot
Spanner
Spbot
SputnikBot
Sqlworm
Teleport
Voltron
Web Enhancer
WebFuck
WebGo IS
WebStripper
Webster
Whacker
WinHTTrack
Zauba
dataforseobot
meanpathbot
mediawords
muhstik-scan
oBot
pcBrowser
plumanalytics
satoristudio.net
scalaj-http
siteripz
sp_auditbot
voyagerx.com