404checker
404enemy
80legs
Abonti
Aboundex
Acunetix
ADmantX
AfD-Verbotsverfahren
AIBOT
AiHitBot
Alexibot
AllSubmitter
Anarchie
Apexoo
Asterias
Attach
Backlink-Ceck
BacklinkCrawler
BackWeb
Barkrowler
BatchFTP
BBBike
BDCbot
BDFetch
Black Hole
BlowFish
Buddy
BuiltWith
BuzzSumo
CATExplorador
CheTeam
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
coccocbot-web
Collector
Copier
CopyRightCheck
Craftbot
crawler4j
DataCha0s
Devil
Dirbuster
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainCrawler
Dotbot
Download Wonder
Drip
Ebingbong
eCatch
ECCP/1.0
Ecxi
EirGrabber
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FemtosearchBot
FlashGet
Flunky
Foobot
FrontPage
FyberSpider
Fyrebot
GalaxyBot
GetRight
Gigablast
Gotit
GoZilla
Grabber
Haansoft
Harvest
Havij
HEADMasterSEO
IDBot
Image Fetch
Image Sucker
Indy Library
instabid
InternetSeer
internetVista monitor
ips-agent
Iria
IRLbot
Jbrofuzz
JikeSpider
JustView
Keyword Density
Lanshanbot
LeechGet
LexiBot
Likse
LinkpadBot
LinksManager
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
LNSpiderguy
Ltx71
Mag-Net
Mail.RU_Bot
Majestic12
Majestic SEO
MarkMonitor
Mass Downloader
MauiBot
MegaIndex.ru
Microsoft URL Control
MIIxpc
MJ12bot
Mr.4x3
Msrabot
Musobot
NearSite
Needle
Netcraft
NetSpider
Net Vampire
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
oBot
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeBot
PageAnalyzer
Page Analyzer
PageScorer
Papa Foto
pcBrowser
PECL::HTTP
PHPCrawl
Picsearch
Pi-Monster
Pixray
plumanalytics
Psbot
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot2
RealDownload
RebelMouse
ReGet
RepoMonkey
Ripper
Rogerbot
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
SearchmetricsBot
Seomoz
SEOprofiler
SeoSiteCheckup
serpstatbot
Shodan
Sitebeam
SiteExplorer
Siteimprove
SiteLockSpider
SmartDownload
SMTBot
Snapbot
Sociscraper
Sottopop
SpaceBison
SpankBot
Spanner
Spbot
spyfu
Sqlmap
Sqlworm
Sqworm
Steeler
Stripper
Sucuri
SuperBot
Szukacz
T0PHackTeam
tAkeOut
Telesoft
Telesphoreo
Telesphorep
TheNomad
TightTwatBot
Titan
Tracemyfile
Trendictionbot
Turnitin
TurnitinBot
Twice
UnisterBot
Upflow
Vacuum
Vagabondo
VCI
VidibleScraper
Virusdie
VoidEYE
WallpapersHD
WASALive-Bot
Webalta
WebAuto
Web Auto
Web Collage
WebEnhancer
Web Fetch
WebGo IS
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
Website Quester
Webster
WebStripper
WebSucker
Web Sucker
Whack
Whacker
Whatweb
Who.is Bot
Widow
WISENutbot
Woobot
Wprecon
WWW-Mechanize
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Zermelo
Zeus
zgrab
Zitebot
ZmEu
ZumBot
ZyBorg