404checker
404enemy
Abonti
Acunetix
AhrefsBot
AIBOT
Alexibot
AllSubmitter
AlphaBot
archive.org_bot
ASPSeek
Attach
Backlink-Ceck
Badass
Bandit
BDFetch
Bigfoot
Bitacle
BLEXBot
Blow
Boardreader
Bolt
Brandprotect
Brandwatch
CATExplorador
CazoodleBot
CCBot
CheTeam
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
coccocbot-web
Cogentbot
Crescent
CSHttp
Curious
DatabaseDriverMysqli
DataCha0s
DBLBot
Demon
Devil
DigitalPebble
Dirbuster
Dispatch
DnyzBot
DomainCrawler
DomainSigmaCrawler
Drip
DSearch
EasyDL
Ebingbong
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Evil
Exabot
Extractor
Extreme Picture Finder
EyeNetIE
FDM
FHscan
Firefox/7.0
Foobot
Freeuploader
Fyrebot
GermCrawler
Getintent
GetWeb
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla
GrabNet
Grafula
GrapeshotCrawler
GridBot
Haansoft
HTTP::Lite
HTTrack
Humanlinks
Iblog
IlseBot
Image Sucker
Indy Library
JamesBOT
Jbrofuzz
JOC Web Spider
Joomla
Jyxobot
Keyword Density
LeechGet
LexiBot
Lftp
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinkScan
Lipperhey
LNSpiderguy
Ltx71
lwp-trivial
Mag-Net
magpie-crawler
MarkMonitor
MarkWatch
MauiBot
meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Metauri
Microsoft URL Control
Mister PiX
MJ12bot
Morfeus Fucking Scanner
Mr.4x3
Musobot
Nameprotect
Navroad
Nessus
NetAnts
Netcraft
NetLyzer
NetMechanic
NetSpider
Net Vampire
NextGenSearchBot
Nibbler
Niki-bot
Offline Explorer
OnCrawl
Openvas
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PageAnalyzer
Page Analyzer
page scorer
Pandalytics
Panscient
PECL::HTTP
PHPCrawl
Pimonster
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
Probethenet
ProWebWalker
Pump
PxBroker
PyCurl
QueryN Metasearch
RankActiveLinkBot
RankFlex
RankingBot
RankurBot
RebelMouse
ReGet
s1z.ru
SalesIntelligent
ScanAlert
Scanbot
ScreenerBot
Searchestate
SearchmetricsBot
SemrushBot
SEOlyticsCrawler
SEOstats
Shodan
SISTRIX
Sitebeam
SiteExplorer
Siteimprove
SiteSnagger
SiteSucker
Site Sucker
Sitevigil
SlySearch
SMTBot
Snoopy
SocialRankIOBot
Sogou web spider
SpaceBison
SpankBot
Spanner
Sqworm
SuperHTTP
SurveyBot
Swiftbot
sysscan
T0PHackTeam
T8Abot
tAkeOut
Teleport
Telesoft
Telesphorep
TheNomad
Toweyabot
Trendiction
trendiction.com
trendiction.de
Turnitin
UnisterBot
URLy Warning
VB Project
VeriCiteCrawler
Virusdie
VoidEYE
Voil
Voltron
WallpapersHD
WebAuto
WebBandit
WebCollage
Web Collage
WebCopier
WebEnhancer
Web Fetch
Web Fuck
WebImageCollector
WebLeacher
WebPix
Web Pix
WebSauger
Web Sauger
WebsiteQuester
WebSucker
WebWhacker
WebZIP
Whack
Whacker
Whatweb
Widow
WiseGuys Robot
Wonderbot
Woobot
Wprecon
WWW-Mechanize
WWWOFFLE
x09Mozilla
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
ZyBorg