360Spider
404checker
404enemy
Abonti
Acunetix
AhrefsBot
Aipbot
Alexibot
Ankit
Apexoo
Asterias
Attach
AwarioSmartBot
BacklinkCrawler
BackStreet
BackWeb
Badass
Bandit
BatchFTP
Battleztar Bazinga
BDFetch
BetaBot
Blackboard
Black Hole
BlackWidow
BLEXBot
Blow
BlowFish
BotALot
Brandwatch
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CheTeam
ChinaClaw
Claritybot
Cloud mapping
CODE87
Copyscape
crawl.sogou.com
CrazyWebCrawler
CrunchBot
Curious
demandbase-bot
Deusu
DigitalPebble
DIIbot
Disco
Discoverybot
Dispatch
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
Dragonfly
DTS Agent
Ebingbong
Ecxi
EMail Wolf
EroCrawler
evc-batch
ExtLinksBot
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
FemtosearchBot
FHscan
Fimap
Foobot
Freeuploader
Fyrebot
GalaxyBot
G-i-g-a-b-o-t
Gotit
GoZilla
Go!Zilla
GrabNet
GrapeshotCrawler
GridBot
GT::WWW
Haansoft
Harvest
Havij
HEADMasterSEO
heritrix
Heritrix
IDBTE4M
Image Fetch
IndeedBot
Indy Library
instabid
Intelliseek
InterGET
InternetSeer
Iria
isitwp.com
Iskanie
IstellaBot
JennyBot
Jetty
JOC Web Spider
Jorgee
JustView
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LexiBot
Lftp
LieBaoFast
Likse
LinkScan
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Ltx71
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkMonitor
Masscan
Mass Downloader
Meanpathbot
MegaIndex.ru
MFC_Tear_Sample
MicroMessenger
MIDown tool
Mister PiX
MQQBrowser
Mr.4x3
MSFrontPage
MSIECrawler
Msrabot
NetAnts
Netcraft
NetSpider
Net Vampire
Netvibes
NextGenSearchBot
Nimbostratus
Nmap
NPbot
oBot
Offline Navigator
Openfind
Openvas
OrangeSpider
OutclicksBot
PageAnalyzer
PageGrabber
page scorer
Pandalytics
Panscient
Papa Foto
pcBrowser
PECL::HTTP
PeoplePal
PictureFinder
Pi-Monster
Pockey
POE-Component-Client-HTTP
ProPowerBot
PyCurl
QueryN Metasearch
RankActive
RankingBot
Recorder
RedesScrapy
RepoMonkey
Rogerbot
s1z.ru
satoristudio.net
SBIder
Scanbot
ScoutJet
Screaming
ScreenerBot
SemrushBot
SEOkicks
SEOkicks-Robot
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
Sitevigil
SlySearch
SMTBot
Snake
Snoopy
SocialRankIOBot
Spammen
SpankBot
Spanner
sp_auditbot
Spinn3r
SputnikBot
spyfu
Stripper
Sucker
SuperHTTP
Suzuran
Swiftbot
T8Abot
TeleportPro
Thumbor
Titan
Toweyabot
Trendictionbot
True_Robot
URLy.Warning
VB Project
VeriCiteCrawler
VidibleScraper
Virusdie
WallpapersHD
WASALive-Bot
Web Enhancer
WebFetch
WebFuck
Web Fuck
WebImageCollector
WebmasterWorldForumBot
WebReaper
WebSauger
Web Sauger
Webshag
WebsiteExtractor
Web Sucker
WebZIP
Who.is Bot
Widow
WISENutbot
Woobot
Wotbox
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Xaldon WebSpider
Zade
Zermelo
Zeus
zgrab
Zitebot
ZumBot