404enemy
80legs
Abonti
Aboundex
Acunetix
AhrefsBot
Alexibot
Anarchie
archive.org_bot
ASPSeek
Attach
autoemailspider
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BackStreet
Barkrowler
BatchFTP
Battleztar Bazinga
BDFetch
BetaBot
Bitacle
Blackboard
Black Hole
BlackWidow
BLEXBot
Blow
Boardreader
Buddy
Calculon
CATExplorador
Cegbfeieh
CheeseBot
Cloud mapping
coccocbot-web
Cogentbot
Collector
Copier
CopyRightCheck
CrazyWebCrawler
CrunchBot
Curious
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
Demon
Devil
Dirbuster
Disco
Dispatch
DomainCrawler
DomainStatsBot
EMail Wolf
Evil
Exabot
ExtractorPro
Extreme Picture Finder
Ezooms
facebookscraper
Fimap
Firefox/7.0
FlashGet
FrontPage
Fyrebot
GetRight
GetWeb
Gigablast
Gigabot
Gotit
Go!Zilla
Grabber
GrapeFX
GridBot
Haansoft
HaosouSpider
Havij
HEADMasterSEO
Heritrix
Hloader
HTTP::Lite
HTTrack
HybridBot
IDBot
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
InterGET
Internet Ninja
ips-agent
Iria
Iskanie
JamesBOT
Jbrofuzz
Jetty
JikeSpider
Kozmosbot
LeechGet
LexiBot
LibWeb
Libwhisker
LinkextractorPro
LinkpadBot
LinksManager
LinkWalker
LinqiaScrapeBot
Lipperhey
Ltx71
magpie-crawler
Majestic12
MauiBot
Meanpathbot
mediawords
MegaIndex.ru
Metauri
Microsoft URL Control
MIDown tool
Morfeus Fucking Scanner
MSFrontPage
muhstik-scan
Musobot
Navroad
NetAnts
netEstate NE Crawler
NetMechanic
Nibbler
NimbleCrawler
Nimbostratus
Ninja
NPbot
oBot
Offline Explorer
Offline Navigator
OnCrawl
OrangeBot
OutclicksBot
PageAnalyzer
PageGrabber
page scorer
Panscient
Pavuk
pcBrowser
PECL::HTTP
PHPCrawl
Picsearch
Pi-Monster
Pockey
Probethenet
ProWebWalker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankingBot2
Reaper
Recorder
ReGet
RepoMonkey
Ripper
SalesIntelligent
ScanAlert
Scanbot
Scrapy
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SEOstats
serpstatbot
SISTRIX
Sitebeam
SiteSnagger
Sitevigil
SlySearch
SmartDownload
SMTBot
Snake
Snapbot
Snoopy
Sociscraper
Sogou web spider
SpaceBison
Spammen
sp_auditbot
Spinn3r
SputnikBot
Sqlworm
Sqworm
Steeler
Sucker
Sucuri
SuperHTTP
sysscan
Szukacz
T8Abot
TeleportPro
Telesphorep
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
Turingos
TwengaBot
Twice
Typhoeus
Upflow
Vacuum
Vagabondo
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WBSearchBot
Webalta
WebAuto
Web Auto
WebBandit
WebFetch
Web Fetch
WebFuck
WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
Web Pix
WebsiteExtractor
WebsiteQuester
Website Quester
Webster
Whack
Whacker
Widow
Wonderbot
Wotbox
WWW-Mechanize
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Zade
Zermelo
Zeus
zgrab
Zitebot
ZmEu