nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-10-07 10:07:31 +00:00

100 lines
1.1 KiB
Text

ADmantX
Aboundex
AfD-Verbotsverfahren
Anarchy
Anarchy99
Attach
BackStreet
Badass
BetaBot
BlowFish
Brandprotect
BuiltBotTough
CensysInspect
Claritybot
ClaudeBot
Cliqzbot
Crescent
CrunchBot
Deusu
DnBCrawler-Analytics
DomainCrawler
Dotbot
Download Wonder
EirGrabber
GalaxyBot
Getintent
Go-Ahead-Got-It
HEADMasterSEO
Harvest
Heritrix
Hloader
Humanlinks
Image Sucker
InfraSec Scanner
Jbrofuzz
Kenjin Spider
Lftp
LinkextractorPro
LinksManager
Lipperhey Spider
MQQBrowser
Majestic-SEO
Mb2345Browser
MicroMessenger
Moblie Safari
Mozlila
Mr.4x3
Navroad
NearSite
OpenLinkProfiler
Page Analyzer
Pandalytics
Panscient
PeoplePal
Pockey
Probethenet
Rainbot
Rankivabot
SBIder
Screaming
SenutoBot
Seomoz
Site Sucker
SiteSnagger
Snapbot
Sociscraper
SpaceBison
Spider_Bot/3.0
Steeler
TeleportPro
Telesoft
Trendictionbot
VoidEYE
WBSearchBot
WEBDAV
WWWOFFLE
WallpapersHD
Web Auto
Web Enhancer
Web Sucker
WebGo IS
WebSauger
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
Xaldon_WebSpider
Zade
Zermelo
ZoomBot
ZyBorg
adscanner
awario.com
crawl.sogou.com
crawler.feedback
ips-agent
webgains-bot
webmeup-crawler
x09Mozilla
zauba.io