360Spider
80legs
Aboundex
Acunetix
AhrefsBot
AiHitBot
Alexibot
Alligator
AlphaBot
Atomseobot
BackWeb
BetaBot
Blow
Bolt
CATExplorador
ChinaClaw
Chlooe
DSearch
Demon
Dirbuster
Extractor
ExtractorPro
FacebookBot
Fimap
FlashGet
Freeuploader
Gigabot
Google-Extended
GridBot
HEADMasterSEO
Harvest
Humanlinks
Id-search
JamesBOT
JennyBot
Kenjin Spider
LNSpiderguy
Larbin
LibWeb
LinqiaScrapeBot
Mag-Net
MarkMonitor
Masscan
Mata Hari
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Morfeus Fucking Scanner
NetZIP
Netvibes
Nibbler
Nikto
PHPCrawl
Picscout
Piepmatz
Pixray
PleaseCrawl
Pockey
Pump
QueryN Metasearch
SalesIntelligent
Scanbot
ScoutJet
Screaming
Searchestate
Siphon
Siteimprove
Sitevigil
Sogou web spider
Sosospider
Spbot
SputnikBot
Sucker
SuperHTTP
Turnitin
TurnitinBot
TwengaBot
Upflow
V-BOT
VeriCiteCrawler
Web Auto
WebBandit
WebSauger
Webshag
Wonderbot
Woobot
Xaldon WebSpider
Xaldon_WebSpider
backlink-check
cohere-ai
evc-batch
internetVista monitor
netEstate NE Crawler
page scorer
scalaj-http
seostar
sp_auditbot
webmeup-crawler