nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-11-21 10:07:51 +00:00

100 lines
1 KiB
Text

01h4x.com
360Spider
404checker
ASPSeek
Atomseobot
AwarioSmartBot
BDCbot
Backlink-Ceck
BacklinksExtendedBot
CSHttp
Cegbfeieh
CheTeam
CheeseBot
Cosmos
Curious
DIIbot
DSearch
DnBCrawler-Analytics
DomainAppender
ECCP/1.0
EirGrabber
Extractor
ExtractorPro
FHscan
Fimap
Flunky
FyberSpider
GetRight
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
Grabber
Harvest
Iblog
Image Sucker
JustView
LexiBot
LinksManager
Lmspider
MTRobot
Magnet
Moblie Safari
MolokaiBot
NPbot
Navroad
NetMechanic
Netcraft
NextGenSearchBot
Nibbler
Octopus
OnCrawl
OrangeSpider
Page Analyzer
PageThing.com
Picsearch
Piepmatz
PleaseCrawl
PyCurl
Recorder
Rogerbot
SBIder
SEOkicks-Robot
SEOstats
SMTBot
SalesIntelligent
Searchestate
Shodan
Siteimprove
Snapbot
Surfbot
Szukacz
Tracemyfile
VB Project
Vacuum
WWW-Collector-E
WebBandit
WebCollage
WebEnhancer
WebFetch
WebSauger
WebWhacker
WebmasterWorldForumBot
Whack
WinHTTrack
Zeus
anthropic-ai
arquivo-web-crawler
awario.com
backlink-check
domainsproject.org
ips-agent
linkdexbot
omgili
pcBrowser
seobility
seostar
sp_auditbot
tAkeOut
xpymep1.exe