nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-09-02 10:07:11 +00:00

100 lines
1 KiB
Text

360Spider
404checker
404enemy
AIBOT
ALittle Client
Acunetix
AlphaBot
Anarchy99
AwarioRssBot
BDCbot
BLEXBot
BackWeb
Barkrowler
Blow
Brandprotect
BuiltWith
Calculon
CheeseBot
Cloud mapping
Crawling at Home Project
CyotekWebCopy
Demon
Discoverybot
DittoSpyder
DnBCrawler-Analytics
Domains Project
ExtractorPro
Gigabot
Go-Ahead-Got-It
GrapeshotCrawler
Haansoft
Humanlinks
Image Sucker
JikeSpider
Joomla
LinksManager
LinqiaRSSBot
MIIxpc
Majestic12
MarkWatch
Mister PiX
Needle
NetSpider
Nmap
Offline Navigator
OpenLinkProfiler
OutclicksBot
OutfoxBot
Page Analyzer
Panscient
Probethenet
Pu_iN
PyCurl
RankingBot
Reaper
SBIder
ScanAlert
Scanbot
ScoutJet
ScrepyBot
SeekportBot
Snake
SpaceBison
Spammen
Spinn3r
SputnikBot
Sucuri
Suzuran
Telesoft
Telesphoreo
The Intraformant
URLy.Warning
Voltron
WEBDAV
WWWOFFLE
Wallpapers
Web Auto
Web Pix
WebEnhancer
WebPix
WebReaper
WebStripper
Whack
Whacker
Widow
Woobot
Wprecon
Xaldon_WebSpider
Xenu
Zermelo
Zeus
ZmEu
arquivo.pt
crawler.feedback
instabid
linkdexbot
lwp-trivial
openai
sitechecker.pro
zauba.io