nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-09-08 10:07:46 +00:00

100 lines
1 KiB
Text

ADmantX
ASPSeek
Aboundexbot
AfD-Verbotsverfahren
Attach
BacklinkCrawler
BlowFish
Boardreader
Buck
CSHttp
Craftbot
CrazyWebCrawler
CyotekWebCopy
Disco
Discobot
Dispatch
DittoSpyder
ECCP/1.0
EasyDL
ExtLinksBot
ExtractorPro
FrontPage
GPTBot
GalaxyBot
GrapeFX
GrapeshotCrawler
HaosouSpider
Humanlinks
HybridBot
IDBTE4M
JetCar
Jorgee
Keyword Density
Kinza
Lanshanbot
LibWeb
LieBaoFast
Lipperhey
MQQBrowser
Masscan
Morfeus Fucking Scanner
Nessus
NetMechanic
Nmap
Offline Explorer
OpenVAS
PECL::HTTP
Pandalytics
PictureFinder
Piepmatz
Pixray
PleaseCrawl
Probethenet
RankingBot2
Recorder
RedesScrapy
SISTRIX
Scanbot
SeekportBot
SemanticJuice
SentiBot
Sitebeam
Sogou web spider
Spinn3r
Sucuri
SurveyBot
T8Abot
TeleportPro
Trendictionbot
TurnitinBot
URLy.Warning
VB Project
Vagabondo
WeSEE
Web Fuck
Web Sucker
WebFetch
WebPix
WebStripper
WebSucker
Xaldon WebSpider
Zitebot
ZoominfoBot
anthropic-ai
backlink-check
crawler4j
eCatch
ips-agent
linkfluence
lwp-trivial
muhstik-scan
openai
plumanalytics
s1z.ru
satoristudio.net
seoscanners
sexsearcher
sitechecker.pro
webpros.com
zauba.io