360Spider
80legs
ADmantX
ASPSeek
Abonti
AiHitBot
Aipbot
Alligator
Anarchie
Anarchy
Anarchy99
Ankit
Anthill
Attach
AwarioSmartBot
BackDoorBot
BacklinkCrawler
Bandit
Battleztar Bazinga
Bigfoot
BlackWidow
Blackboard
BlowFish
BotALot
Brandprotect
Buck
BunnySlippers
CATExplorador
CCBot
Calculon
CheTeam
Cliqzbot
Cloud mapping
Copyscape
Craftbot
CrunchBot
Curious
DBLBot
DIIbot
DatabaseDriverMysqli
Discoverybot
DomCopBot
DomainStatsBot
Drip
ECCP/1.0
EMail Wolf
EroCrawler
Exabot
ExtLinksBot
Extreme Picture Finder
FDM
FHscan
Fimap
FlashGet
Flunky
Freeuploader
Fuzz
GalaxyBot
GermCrawler
GetWeb
Getintent
Gigabot
GridBot
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
Havij
Heritrix
Hloader
Humanlinks
HybridBot
IDBTE4M
Iblog
Id-search
InfoNaviRobot
InfoTekies
Intelliseek
Iskanie
JamesBOT
JetCar
Jetty
JikeSpider
Kenjin Spider
Kinza
LNSpiderguy
LWP::Simple
Lightspeedsystems
LinkScan
LinkWalker
Linkdexbot
LinkextractorPro
Litemage_walker
Ltx71
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
Mag-Net
Mail.RU_Bot
Majestic-SEO
MarkMonitor
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft Data Access
Minefield
Mister PiX
Mojeek
Mozlila
Mr.4x3
NICErsPRO
NPbot
Navroad
NetSpider
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Nmap
Openfind
PECL::HTTP
PHPCrawl
Page Analyzer
PageAnalyzer
PageScorer
Panscient
Picsearch
PictureFinder
Pimonster
Pu_iN
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot
RankingBot2
Rankivabot
RealDownload
RebelMouse
RedesScrapy
RocketCrawler
SBIder
SEOlyticsCrawler
SEOstats
SISTRIX
SMTBot
SalesIntelligent
Screaming
ScrepyBot
SemanticJuice
Semrush
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
Site Sucker
SiteSucker
Sitebeam
SmartDownload
Snapbot
Sociscraper
SpaceBison
SpankBot
Spbot
Spinn3r
Sqlworm
SuperHTTP
Surfbot
SurveyBot
Szukacz
TeleportPro
Telesphoreo
Thumbor
Titan
Toata
Toweyabot
Tracemyfile
Turnitin
TurnitinBot
Twice
URLy.Warning
UnisterBot
VB Project
VelenPublicWebCrawler
Virusdie
WASALive-Bot
WISENutbot
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Auto
Web Fetch
Web Pix
Web Sauger
Web Sucker
WebAuto
WebCollage
WebLeacher
WebPix
Webalta
Webshag
Website Quester
WebsiteQuester
Webster
Whack
Widow
WinHTTrack
Wonderbot
Wotbox
Xaldon WebSpider
YoudaoBot
Zade
Zauba
Zermelo
Zeus
Zitebot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
coccocbot-web
cognitiveseo
crawl.sogou.com
demandbase-bot
ips-agent
lwp-trivial
meanpathbot
mediawords
page scorer
scalaj-http
scan.lol
seobility
seoscanners
sexsearcher
sogouspider
spyfu
tAkeOut
trendiction.com
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webprosbot
x09Mozilla
xpymep1.exe
zgrab