nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-10-08 22:05:09 +00:00

100 lines
1 KiB
Text

ADmantX
AllSubmitter
Anarchy
BetaBot
Blow
Boardreader
BuiltWith
CODE87
CSHttp
CazoodleBot
CensysInspect
Craftbot
DomCopBot
ECCP/1.0
Ebingbong
EroCrawler
FyberSpider
GermCrawler
Getintent
GrabNet
Grabber
HybridBot
Iria
Jbrofuzz
JustView
LNSpiderguy
Larbin
LibWeb
LinkextractorPro
LinkpadBot
LinqiaScrapeBot
Lmspider
MFC_Tear_Sample
Majestic-SEO
MarkWatch
MicroMessenger
Microsoft URL Control
Moblie Safari
NPbot
Navroad
NearSite
NetSpider
NetZIP
Nibbler
Ninja
PageGrabber
PeoplePal
Piepmatz
Pimonster
Pixray
PleaseCrawl
Pu_iN
Pump
RankActiveLinkBot
Recorder
RepoMonkey
SBIder
SEOlyticsCrawler
Scanbot
SeobilityBot
Site Sucker
SiteLockSpider
SiteSnagger
Sosospider
Sottopop
SpankBot
Sqlworm
Stripper
Sucuri
Tracemyfile
Trendictionbot
Turnitin
UnisterBot
Vacuum
VeriCiteCrawler
VoidEYE
Wallpapers
Web Enhancer
Web Fetch
WebFetch
WebSucker
WebWhacker
Webalta
Whack
Wotbox
anthropic-ai
arquivo.pt
check1.exe
crawl.sogou.com
crawler4j
demandbase-bot
gopher
instabid
linkdexbot
linkfluence
mediawords
muhstik-scan
page scorer
scalaj-http
sp_auditbot