nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-07-18 22:05:12 +00:00

100 lines
1 KiB
Text

80legs
ADmantX
AdsTxtCrawlerTP
AhrefsBot
AlphaBot
Anthill
BLEXBot
Backlink-Ceck
Boardreader
Bolt
Calculon
ChinaClaw
Cloud mapping
CopyRightCheck
Custo
DBLBot
DatabaseDriverMysqli
Deusu
Drip
EMail Wolf
Foobot
Freeuploader
GoZilla
Grabber
GrapeshotCrawler
HEADMasterSEO
Haansoft
Humanlinks
HybridBot
Iblog
Image Sucker
JikeSpider
Kinza
LeechFTP
LibWeb
LinkWalker
Lmspider
MIIxpc
Metauri
Microsoft Data Access
Mr.4x3
Musobot
Name Intelligence
Needle
Nessus
NetAnts
NetMechanic
Niki-bot
Offline Navigator
Openvas
OrangeBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
Papa Foto
Psbot
RankActive
RankActiveLinkBot
ReGet
RebelMouse
Recorder
Ripper
SalesIntelligent
ScreenerBot
SiteExplorer
Sottopop
Spanner
Spinn3r
SputnikBot
Sucker
T8Abot
TeleportPro
TwengaBot
VidibleScraper
Voil
WEBDAV
WWW-Mechanize
Web Auto
Web Collage
Web Pix
WebAuto
WebGo IS
WebSauger
Webster
Whatweb
Widow
WiseGuys Robot
Zermelo
Zeus
ZoominfoBot
ZyBorg
adscanner
crawler.feedback
dataforseobot
heritrix
internetVista monitor
siteripz
trendiction.com
xpymep1.exe
zauba.io