360Spider
404checker
404enemy
Abonti
Aboundex
AiHitBot
Aipbot
Alexibot
AllSubmitter
Apexoo
autoemailspider
AwarioRssBot
BackDoorBot
Backlink-Ceck
BackStreet
BackWeb
Badass
Battleztar Bazinga
BBBike
BDCbot
BDFetch
BetaBot
Bigfoot
Blackboard
Black Hole
BLEXBot
Bolt
BotALot
Brandprotect
Buddy
BuiltWith
BuzzSumo
Calculon
Cegbfeieh
Chlooe
Claritybot
coccocbot-web
Cogentbot
Collector
CopyRightCheck
Copyscape
Cosmos
Craftbot
crawler4j
CSHttp
Curious
DatabaseDriverMysqli
demandbase-bot
Demon
Digincore
Discobot
DnyzBot
DomainAppender
DomainStatsBot
Dotbot
Download Wonder
Drip
EasyDL
Ecxi
EirGrabber
EMail Siphon
evc-batch
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
FlashGet
FrontPage
FyberSpider
Fyrebot
GalaxyBot
Getintent
GetWeb
Gigablast
G-i-g-a-b-o-t
Gotit
Go!Zilla
GrabNet
GT::WWW
Haansoft
Harvest
Hloader
HMView
HTTP::Lite
HybridBot
Iblog
IDBot
Image Fetch
InfoNaviRobot
Intelliseek
InternetSeer
ips-agent
IRLbot
Jorgee
Keyword Density
Kinza
Kozmosbot
Lftp
Libwhisker
Lightspeedsystems
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Lmspider
Ltx71
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic-SEO
MarkWatch
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
MeanPath Bot
Mediatoolkitbot
Metauri
MFC_Tear_Sample
Mister PiX
Mojeek
Mr.4x3
Msrabot
Musobot
Name Intelligence
Nameprotect
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
NextGenSearchBot
NICErsPRO
Nikto
Nimbostratus
Nmap
Octopus
Offline Explorer
Offline Navigator
OpenVAS
OutclicksBot
OutfoxBot
PageAnalyzer
PageGrabber
page scorer
Pandalytics
Panscient
pcBrowser
PECL::HTTP
PeoplePal
PHPCrawl
Picscout
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP
PxBroker
RankActive
RankActiveLinkBot
RankFlex
Rankivabot
RankurBot
RedesScrapy
Rogerbot
RSSingBot
s1z.ru
SBIder
scan.lol
Scrapy
Screaming
Searchestate
SemrushBot
SEOkicks
Seomoz
SeoSiteCheckup
SEOstats
Shodan
SISTRIX
Siteimprove
SiteLockSpider
SiteSnagger
SiteSucker
Sitevigil
SlySearch
Snake
Snapbot
Snoopy
sogouspider
Sogou web spider
Sottopop
SpankBot
Spanner
SputnikBot
Sqlworm
Steeler
Sucuri
SuperBot
SuperHTTP
Szukacz
T0PHackTeam
T8Abot
Telesoft
The Intraformant
TheNomad
Thumbor
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
trendiction.com
True_Robot
Turingos
Turnitin
Typhoeus
URLy Warning
URLy.Warning
VB Project
Virusdie
Voil
Voltron
WASALive-Bot
Web Auto
WebCollage
Web Enhancer
WebFetch
WebFuck
WebGo IS
WebImageCollector
WebLeacher
webmeup-crawler
Web Pix
WebReaper
Web Sauger
WebSucker
Whack
WISENutbot
WPScan
WWWOFFLE
Xaldon WebSpider
Xenu
YoudaoBot
Zade
Zauba
Zermelo
Zeus
zgrab