nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-05-18 10:07:12 +00:00

100 lines
1 KiB
Text

AIBOT
Aboundex
Aboundexbot
Bolt
Brandwatch
Buddy
CCBot
CSHttp
ChatGPT-User
ChinaClaw
Chlooe
Copyscape
Craftbot
CrazyWebCrawler
DTS Agent
Digincore
DittoSpyder
EMail Siphon
EMail Wolf
EasyDL
Extreme Picture Finder
FDM
Freeuploader
FrontPage
Fyrebot
GT::WWW
GrabNet
IDBot
IndeedBot
InfraSec Scanner
InterGET
Iskanie
Joomla
JustView
Kenjin Spider
LibWeb
LieBaoFast
LinkScan
Litemage_walker
Lmspider
MarkWatch
Mb2345Browser
MegaIndex.ru
MicroMessenger
Mojolicious
Nessus
Nimbostratus
Ninja
Octopus
OpenLinkProfiler
OutfoxBot
PageThing.com
Pandalytics
Psbot
Pump
Rainbot
RankActiveLinkBot
Rankivabot
Recorder
Rogerbot
SEOkicks-Robot
Seekport
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
SiteSnagger
Snapbot
SurveyBot
TeleportPro
Thumbor
TightTwatBot
TinyTestBot
Titan
Toata
Tracemyfile
URLy.Warning
UnisterBot
V-BOT
VelenPublicWebCrawler
Voil
Web Auto
Web Sauger
Web Sucker
WebCopier
WebFetch
WebImageCollector
WebLeacher
WebSauger
Who.is Bot
Wonderbot
Xaldon_WebSpider
YoudaoBot
clark-crawler
gopher
seobility
serpstatbot
sexsearcher
ubermetrics-technologies.com
x22Mozilla