360Spider
Aboundexbot
Acunetix
ADmantX
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
Apexoo
ASPSeek
Attach
AwarioSmartBot
BackDoorBot
BackWeb
Badass
Barkrowler
BatchFTP
Battleztar Bazinga
BBBike
Bigfoot
Bitacle
Black Hole
Boardreader
Bolt
Brandprotect
BuiltWith
Bullseye
CATExplorador
CCBot
Chlooe
cognitiveseo
Collector
com.plumanalytics
Copier
CopyRightCheck
Copyscape
Cosmos
Craftbot
crawler4j
crawl.sogou.com
CrazyWebCrawler
Curious
Custo
DBLBot
demandbase-bot
Deusu
Devil
DIIbot
Disco
DittoSpyder
DnyzBot
DomainSigmaCrawler
DomainStatsBot
DSearch
Ecxi
EirGrabber
EMail Wolf
EroCrawler
Evil
ExtLinksBot
ExtractorPro
EyeNetIE
facebookscraper
Fimap
Flunky
Foobot
FyberSpider
GermCrawler
Getintent
GetWeb
Gigabot
Go-Ahead-Got-It
Gotit
GrabNet
GrapeFX
GrapeshotCrawler
Harvest
Havij
heritrix
Hloader
HMView
HTMLparser
HTTrack
Humanlinks
Id-search
Image Fetch
IndeedBot
InfoTekies
Intelliseek
Iria
IRLbot
Iskanie
IstellaBot
JamesBOT
JetCar
Jetty
Jorgee
JustView
Kozmosbot
Larbin
LeechFTP
Lftp
Lightspeedsystems
Likse
LinkextractorPro
LinkpadBot
LinkScan
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
LNSpiderguy
lwp-request
LWP::Simple
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic SEO
MarkWatch
Mata Hari
MauiBot
Metauri
Microsoft URL Control
Mister PiX
Mojeek
MSFrontPage
MSIECrawler
muhstik-scan
Nameprotect
Navroad
Needle
netEstate NE Crawler
Nettrack
NextGenSearchBot
Nutch
Octopus
OrangeBot
OrangeSpider
PageAnalyzer
Page Analyzer
PageGrabber
page scorer
Pandalytics
Panscient
Papa Foto
Pavuk
pcBrowser
PictureFinder
Pimonster
Pi-Monster
PleaseCrawl
Pockey
ProPowerBot
Pump
PyCurl
RankActive
RankFlex
RankingBot
Rankivabot
RealDownload
Ripper
SalesIntelligent
Scanbot
ScoutJet
Searchestate
SEOkicks
Seomoz
sexsearcher
Shodan
SiteExplorer
Siteimprove
SiteLockSpider
SiteSucker
Site Sucker
Sitevigil
SlySearch
SmartDownload
Snake
Snapbot
Snoopy
SocialRankIOBot
sogouspider
Sosospider
Spammen
SpankBot
sp_auditbot
Spbot
spyfu
Sqlmap
Sucker
Sucuri
Surfbot
SurveyBot
Swiftbot
Szukacz
T8Abot
Teleport
Telesphoreo
TheNomad
trendiction.de
True_Robot
TurnitinBot
TwengaBot
UnisterBot
Vacuum
VB Project
VeriCiteCrawler
VoidEYE
Voil
Voltron
Wallpapers/3.0
WallpapersHD
Webalta
WEBDAV
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
WebGo IS
WebLeacher
Web Pix
WebReaper
WebSauger
WebsiteQuester
WebSucker
WebZIP
WeSEE
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
WISENutbot
Wonderbot
Woobot
Wotbox
Wprecon
WPScan
WWW-Collector-E
Xaldon WebSpider
Xenu
xpymep1.exe
YoudaoBot
Zade
zauba.io
Zermelo
zgrab
ZumBot
ZyBorg