Aboundexbot
AiHitBot
Aipbot
AllSubmitter
Anarchy99
Atomseobot
BDFetch
Buck
Bytespider
CODE87
CheeseBot
ClaudeBot
Collector
Copier
CrunchBot
Custo
CyotekWebCopy
Digincore
Dirbuster
DnBCrawler-Analytics
ECCP/1.0
EroCrawler
Exabot
FDM
Flunky
HTTP::Lite
Havij
Humanlinks
IDBTE4M
Id-search
IndeedBot
Indy Library
JustView
Jyxobot
LexiBot
Linkbot
LinkextractorPro
LinksManager
MFC_Tear_Sample
MIDown tool
Majestic SEO
Mb2345Browser
Microsoft URL Control
Mister PiX
NICErsPRO
Nessus
NetAnts
NetMechanic
Netvibes
Offline Explorer
OnCrawl
PHPCrawl
POE-Component-Client-HTTP
PageThing.com
PeoplePal
Piepmatz
ProWebWalker
Pu_iN
Rainbot
Ripper
ScreenerBot
Searchestate
SemrushBot-BA
SemrushBot-FT
SemrushBot-SI
SenutoBot
Seomoz
Shodan
Sitebeam
SlySearch
Snake
SocialRankIOBot
Sogou web spider
Sosospider
SpaceBison
Spider_Bot/3.0
SplitSignalBot
Stripper
SurveyBot
T8Abot
TightTwatBot
Trendiction
Twice
URLy Warning
Voltron
Web Fetch
WebStripper
Xaldon WebSpider
Zitebot
archive.org_bot
crawler.feedback
evc-batch
heritrix
ips-agent
meanpathbot
s1z.ru
scan.lol
sogouspider
tAkeOut
x22Mozilla