nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-08-13 10:07:02 +00:00

100 lines
1.1 KiB
Text

360Spider
ADmantX
AIBOT
ALittle Client
BBBike
BDCbot
BackWeb
BlowFish
Boardreader
CSHttp
Cegbfeieh
ChinaClaw
CrazyWebCrawler
Crescent
Custo
DIIbot
DatabaseDriverMysqli
ECCP/1.0
EMail Wolf
EasyDL
Ebingbong
Evil
Express WebPictures
ExtLinksBot
EyeNetIE
FDM
FyberSpider
GPTBot
GetWeb
Gigabot
GrabNet
Grabber
HEADMasterSEO
HaosouSpider
HonoluluBot
Indy Library
Information Security Team InfraSec Scanner
InfraSec Scanner
Internet Ninja
Joomla
Jyxobot
LibWeb
LinkScan
LinkWalker
LinkextractorPro
LinksManager
Lipperhey Spider
Lmspider
Mb2345Browser
MicroMessenger
Mojolicious
Mr.4x3
Name Intelligence
Nessus
Octopus
Offline Explorer
ProWebWalker
RankActive
RankActiveLinkBot
RankFlex
ReGet
Ripper
SEOprofiler
SISTRIX
ScanAlert
SiteSnagger
SiteSucker
Sitebeam
Suzuran
Telesoft
TheNomad
Trendiction
True_Robot
Typhoeus
UnisterBot
Upflow
V-BOT
Web Fuck
WebAuto
WebBandit
WebCopier
WebWhacker
Who.is Bot
WinHTTrack
Wonderbot
Woobot
crawl.sogou.com
crawler4j
domainsproject.org
iubenda-radar
lwp-request
meanpathbot
mediawords
netEstate NE Crawler
oBot
s1z.ru
sysscan
webgains-bot
webpros.com
x22Mozilla