404enemy
80legs
Abonti
Aboundex
Aboundexbot
ADmantX
AhrefsBot
AIBOT
Alligator
AllSubmitter
AlphaBot
Anarchie
Ankit
Apexoo
arquivo.pt
arquivo-web-crawler
Asterias
Attach
autoemailspider
BackDoorBot
Backlink-Ceck
Bitacle
Black Hole
BlackWidow
BLEXBot
BlowFish
Boardreader
Brandprotect
Bullseye
BunnySlippers
CazoodleBot
CCBot
CheTeam
Chlooe
Claritybot
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
CopyRightCheck
CrunchBot
CSHttp
Curious
Custo
DatabaseDriverMysqli
Deusu
Devil
Digincore
Dispatch
DnyzBot
DomainAppender
Domains Project
Dotbot
DTS Agent
Ebingbong
eCatch
EMail Wolf
evc-batch
Evil
Express WebPictures
Extreme Picture Finder
EyeNetIE
Fimap
Firefox/7.0
FlashGet
FyberSpider
Getintent
GetRight
Gigabot
Go!Zilla
Grabber
GrabNet
GrapeshotCrawler
GridBot
HaosouSpider
HEADMasterSEO
HTMLparser
InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
ips-agent
Iria
IRLbot
Iskanie
JamesBOT
Jbrofuzz
JennyBot
Jetty
JikeSpider
JOC Web Spider
Joomla
Jyxobot
Kozmosbot
Lanshanbot
LeechGet
LibWeb
LieBaoFast
LinkextractorPro
Litemage_walker
LNSpiderguy
lwp-request
LWP::Simple
lwp-trivial
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic SEO
Mass Downloader
MauiBot
mediawords
MegaIndex.ru
MicroMessenger
Microsoft URL Control
MIIxpc
Mojeek
Mr.4x3
MSFrontPage
Name Intelligence
Nameprotect
Needle
Nessus
Netcraft
NetLyzer
NetMechanic
Netvibes
Nibbler
NICErsPRO
Nikto
Nimbostratus
Ninja
oBot
Octopus
Offline Explorer
OrangeBot
OutfoxBot
PageAnalyzer
Page Analyzer
PageGrabber
pcBrowser
PECL::HTTP
PHPCrawl
Picscout
PictureFinder
PleaseCrawl
plumanalytics
polaris version
Probethenet
ProWebWalker
Psbot
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot2
Rankivabot
RankurBot
RealDownload
Recorder
RedesScrapy
Ripper
RocketCrawler
RSSingBot
SBIder
ScanAlert
ScoutJet
Scrapy
Searchestate
SemrushBot
SEOkicks-Robot
SEOprofiler
Shodan
Siteimprove
Sitevigil
SlySearch
SmartDownload
SMTBot
Snake
Snapbot
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
SpaceBison
Spanner
SputnikBot
spyfu
Sqlmap
Sqlworm
Steeler
Stripper
SuperBot
Surfbot
Swiftbot
sysscan
T8Abot
tAkeOut
Teleport
Telesoft
TheNomad
TightTwatBot
Titan
Toweyabot
True_Robot
TurnitinBot
TwengaBot
Typhoeus
URLy.Warning
VCI
VoidEYE
Voltron
Wallpapers/3.0
WBSearchBot
Webalta
WebCollage
Web Collage
WebEnhancer
Web Fetch
WebFuck
Web Fuck
WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
Web Pix
WebReaper
Web Sauger
Webshag
WebsiteExtractor
Webster
WebSucker
Web Sucker
WebWhacker
WeSEE
Whack
Whacker
Who.is Bot
WISENutbot
Wonderbot
Woobot
Wprecon
WPScan
WWW-Collector-E
WWW-Mechanize
Xenu
zgrab
Zitebot
ZmEu
ZyBorg