nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-08-24 10:11:55 +00:00

100 lines
1.1 KiB
Text

Aboundexbot
AdsTxtCrawlerTP
Alligator
Asterias
AwarioRssBot
Barkrowler
Black Hole
Blow
Bytespider
Chlooe
Cocolyzebot
Copier
Crawling at Home Project
DigitalPebble
DomainStatsBot
Dragonfly
Evil
Foobot
Freeuploader
Genieo
GetRight
Grabber
GridBot
HTTrack
Image Fetch
Jorgee
Kozmosbot
Larbin
Lftp
LinkpadBot
MQQBrowser
Majestic-SEO
Masscan
Mata Hari
Mb2345Browser
Metauri
MicroMessenger
Microsoft URL Control
Mojolicious
Net Vampire
NetMechanic
NetSpider
Netvibes
NextGenSearchBot
OnCrawl
OpenLinkProfiler
OrangeSpider
POE-Component-Client-HTTP
PageGrabber
Pandalytics
Piepmatz
PxBroker
Quick-Crawler
RankActiveLinkBot
RankFlex
SEOlyt
SEOprofiler
Scrapy
SemrushBot
SemrushBot-OCOB
SemrushBot-SI
Shodan
Siphon
SiteSucker
Spammen
SpankBot
Spbot
Sucuri
Suzuran
T0PHackTeam
Teleport
TeleportPro
Titan
VB Project
Vagabondo
Voltron
WWW-Collector-E
WallpapersHD
Web Fetch
WebWhacker
WebmasterWorldForumBot
WebsiteQuester
Webster
Who.is Bot
ZoominfoBot
cah.io.community
cohere-ai
crawler4j
dataforseobot
instabid
internetVista monitor
linkfluence
meanpathbot
openai.com
seoscanners
seostar
tAkeOut
trendiction.de
xpymep1.exe
zgrab