360Spider
404checker
404enemy
ADmantX
AllSubmitter
Anarchie
Ankit
arquivo-web-crawler
Aspiegel
ASPSeek
Asterias
AwarioRssBot
Backlink-Ceck
BackStreet
Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BDCbot
Bigfoot
Bitacle
Blackboard
Black Hole
BLEXBot
Blow
Boardreader
Brandprotect
BuzzSumo
CATExplorador
CCBot
CheeseBot
CheTeam
ChinaClaw
Chlooe
Claritybot
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
Copyscape
Cosmos
crawler.feedback
crawl.sogou.com
Crescent
CSHttp
Curious
Custo
DatabaseDriverMysqli
DBLBot
Digincore
DigitalPebble
DIIbot
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
Download Wonder
Dragonfly
Ebingbong
EMail Siphon
Evil
Exabot
Express WebPictures
ExtLinksBot
Extreme Picture Finder
EyeNetIE
FemtosearchBot
FHscan
Fimap
Firefox/7.0
Freeuploader
FrontPage
GermCrawler
GetWeb
G-i-g-a-b-o-t
Go!Zilla
GrapeshotCrawler
Haansoft
Havij
heritrix
HTTrack
Humanlinks
Image Fetch
IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja
internetVista monitor
ips-agent
IRLbot
Iskanie
JamesBOT
Jbrofuzz
JetCar
Jetty
JikeSpider
JOC Web Spider
Jorgee
Kenjin Spider
Lanshanbot
Lftp
LieBaoFast
LinkextractorPro
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lmspider
LNSpiderguy
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Majestic-SEO
MarkWatch
Mata Hari
Mb2345Browser
meanpathbot
Meanpathbot
Mediatoolkitbot
mediawords
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
MIIxpc
Mister PiX
Mojolicious
MQQBrowser
MSFrontPage
MSIECrawler
Msrabot
Name Intelligence
Nameprotect
Netvibes
NetZIP
NextGenSearchBot
Nibbler
NimbleCrawler
Nimbostratus
Nutch
Offline Explorer
Offline Navigator
Openvas
OpenVAS
OPPO A33
OrangeBot
OrangeSpider
OutclicksBot
PageAnalyzer
Page Analyzer
PageGrabber
Pandalytics
Papa Foto
PECL::HTTP
PeoplePal
PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP
polaris version
Psbot
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
RealDownload
RebelMouse
Recorder
RSSingBot
SalesIntelligent
SBIder
Screaming
Searchestate
SearchmetricsBot
Semrush
SEOkicks-Robot
SEOprofiler
SEOstats
Shodan
Siphon
SISTRIX
Sitebeam
Sitevigil
SlySearch
SmartDownload
SMTBot
Snapbot
Sogou web spider
SpaceBison
spyfu
Sqlmap
Sqlworm
Sucker
SuperBot
SurveyBot
Suzuran
Swiftbot
sysscan
T8Abot
tAkeOut
Telesphoreo
Thumbor
Trendictionbot
trendiction.de
Turingos
Turnitin
Twice
Typhoeus
UnisterBot
Upflow
URLy.Warning
Vacuum
Vagabondo
VidibleScraper
WASALive-Bot
Webalta
Web Auto
WebCopier
WEBDAV
Web Enhancer
WebFetch
WebFuck
WebReaper
WebSauger
Web Sauger
Webshag
WeSEE
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Wprecon
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
x22Mozilla
xpymep1.exe
Zermelo
Zeus
ZumBot
ZyBorg