nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-06-04 22:10:33 +00:00

100 lines
1 KiB
Text

404checker
Abonti
Anthill
BacklinksExtendedBot
BatchFTP
Black Hole
Bolt
BuiltBotTough
CODE87
Citoid
Claritybot
Cloud mapping
CopyRightCheck
Crawling at Home Project
CrunchBot
Custo
Digincore
DigitalPebble
Dirbuster
DomainStatsBot
Drip
EMail Siphon
Extractor
Ezooms
FemtosearchBot
Freeuploader
FrontPage
GalaxyBot
GetWeb
GoZilla
HMView
HonoluluBot
IDBTE4M
ImagesiftBot
InfoNaviRobot
Iskanie
JOC Web Spider
LNSpiderguy
LinkScan
MIDown tool
MQQBrowser
MTRobot
MarkWatch
MauiBot
Mozlila
NearSite
Needle
NetMechanic
Nettrack
Netvibes
NextGenSearchBot
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
OnCrawl
Openfind
Pavuk
PeoplePal
Petalbot
RSSingBot
RankingBot
Rankivabot
RealDownload
Recorder
SMTBot
SeekportBot
SemrushBot-BA
SemrushBot-SI
SemrushBot-SWA
SeoCherryBot
SiteAuditBot
SiteSucker
Siteimprove
Spbot
Surfbot
Szukacz
TeleportPro
Tracemyfile
Trendictionbot
Twice
V-BOT
WWW-Mechanize
Web Enhancer
WebAuto
WebFuck
WebPix
WebSucker
WebsiteExtractor
Zade
Zauba
ZyBorg
coccocbot
internetVista monitor
iubenda-radar
linkfluence
muhstik-scan
s1z.ru
webmeup-crawler
zgrab