360Spider
404checker
404enemy
80legs
ADmantX
AhrefsBot
AllSubmitter
Anarchie
Apexoo
ASPSeek
Asterias
autoemailspider
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BackStreet
BackWeb
Bandit
Barkrowler
BatchFTP
BDCbot
BDFetch
Bitacle
Blackboard
BlackWidow
BLEXBot
Brandwatch
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CazoodleBot
CheeseBot
CheTeam
ChinaClaw
Claritybot
Cogentbot
Cosmos
crawler.feedback
crawl.sogou.com
CrunchBot
CSHttp
Curious
Custo
Deusu
Devil
Digincore
DIIbot
DittoSpyder
DomainAppender
Dotbot
DSearch
eCatch
EirGrabber
EMail Siphon
Express WebPictures
ExtLinksBot
EyeNetIE
facebookscraper
FDM
Fimap
Foobot
Freeuploader
Fyrebot
GalaxyBot
Genieo
Getintent
GetRight
GetWeb
Gigabot
G-i-g-a-b-o-t
Gotit
GrapeshotCrawler
GT::WWW
Haansoft
HaosouSpider
Harvest
Havij
Heritrix
Hloader
HTMLparser
HTTP::Lite
HybridBot
Iblog
IDBot
IlseBot
Image Fetch
Image Sucker
Intelliseek
InterGET
Internet Ninja
Iria
JamesBOT
JetCar
Jetty
JikeSpider
JOC Web Spider
Joomla
JustView
Kenjin Spider
Larbin
LeechFTP
Lftp
Lightspeedsystems
Likse
LinkextractorPro
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
LNSpiderguy
Magnet
Majestic12
Majestic SEO
MarkMonitor
Masscan
MegaIndex.ru
Metauri
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
Mister PiX
Mr.4x3
MSIECrawler
Msrabot
Name Intelligence
Nameprotect
NearSite
Needle
NetAnts
Netcraft
NetMechanic
Nettrack
Nibbler
NICErsPRO
Niki-bot
NimbleCrawler
Nimbostratus
Nmap
Nutch
oBot
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
OutclicksBot
OutfoxBot
PageGrabber
page scorer
Pandalytics
Panscient
Picscout
Pimonster
Pi-Monster
Pixray
plumanalytics
Probethenet
ProPowerBot
Psbot
Pump
PxBroker
RankActiveLinkBot
Rankivabot
RankurBot
RealDownload
Reaper
RebelMouse
RedesScrapy
Ripper
s1z.ru
SBIder
scan.lol
ScoutJet
Screaming
Searchestate
SemrushBot
SEOkicks
SeoSiteCheckup
SEOstats
Siphon
SiteSnagger
SiteSucker
SlySearch
Snake
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
Sottopop
SpankBot
Spanner
Spinn3r
spyfu
Sqlworm
Stripper
Sucker
T8Abot
Telesoft
The Intraformant
Thumbor
TightTwatBot
Toweyabot
Trendiction
Trendictionbot
Turingos
TurnitinBot
Twice
Typhoeus
UnisterBot
Upflow
URLy Warning
URLy.Warning
Vacuum
Vagabondo
VeriCiteCrawler
Voil
Voltron
WebBandit
WebCollage
Web Collage
WebCopier
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
Web Fuck
WebmasterWorldForumBot
Web Pix
WebReaper
Webster
WebStripper
WebZIP
Whack
Whacker
Who.is Bot
Widow
Woobot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Xaldon_WebSpider
Xenu
Zade
Zermelo
ZmEu
ZumBot
ZyBorg