nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-03-03 10:07:42 +00:00

100 lines
1 KiB
Text

Aboundex
Aboundexbot
AwarioRssBot
BackDoorBot
Bandit
BatchFTP
BetaBot
Blackboard
CheTeam
Cogentbot
Collector
Copier
CopyRightCheck
Craftbot
CyotekWebCopy
Discobot
DittoSpyder
DomainAppender
Drip
Ebingbong
EroCrawler
Express WebPictures
Ezooms
FacebookBot
Firefox/7.0
Foobot
FrontPage
Fuzz
GalaxyBot
Genieo
GetRight
Go!Zilla
Go-Ahead-Got-It
GrabNet
HaosouSpider
Harvest
IRLbot
InterGET
Internet Ninja
Iria
LibWeb
LinkextractorPro
Litemage_walker
Meanpathbot
Musobot
NetLyzer
NetMechanic
NetZIP
Netvibes
Nibbler
Offline Navigator
PageAnalyzer
Panscient
Pavuk
Picsearch
Piepmatz
PleaseCrawl
Pockey
ProWebWalker
Pu_iN
Pump
RankFlex
RankurBot
Re-re
RedesScrapy
SEOprofiler
SalesIntelligent
ScoutJet
Seekport
SeoSiteCheckup
SocialRankIOBot
Sosospider
Sqlworm
Sqworm
T8Abot
Telesphoreo
Telesphorep
Toata
TwengaBot
Vagabondo
WWW-Collector-E
WebCopier
WebImageCollector
WebStripper
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Xaldon_WebSpider
Zauba
ZyBorg
anthropic-ai
crawl.sogou.com
crawler4j
gopher
lwp-trivial
magpie-crawler
webpros.com
webprosbot
x22Mozilla
xpymep1.exe