404checker
404enemy
Abonti
Aboundex
Acunetix
ADmantX
Alexibot
AlphaBot
Apexoo
archive.org_bot
arquivo-web-crawler
ASPSeek
Attach
AwarioSmartBot
Badass
Barkrowler
Battleztar Bazinga
BDFetch
BetaBot
Bigfoot
Bitacle
Black Hole
BlackWidow
BlowFish
Bolt
BotALot
Brandprotect
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
Calculon
CATExplorador
CCBot
CherryPicker
CheTeam
ChinaClaw
cognitiveseo
com.plumanalytics
Copier
Craftbot
crawler4j
CrazyWebCrawler
CrunchBot
Custo
DBLBot
demandbase-bot
Demon
Devil
DIIbot
Disco
Dispatch
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
DSearch
eCatch
Ecxi
EirGrabber
EMail Siphon
Evil
Exabot
Extractor
ExtractorPro
EyeNetIE
Ezooms
FDM
FemtosearchBot
Freeuploader
Genieo
GermCrawler
Getintent
GetRight
Gotit
GoZilla
Grabber
GrapeshotCrawler
Haansoft
Harvest
heritrix
Hloader
HMView
HTMLparser
HTTrack
Iblog
IDBot
Image Fetch
InfoTekies
Intelliseek
InterGET
Iskanie
Jbrofuzz
JennyBot
Jyxobot
Kenjin Spider
Keyword Density
Larbin
LeechFTP
Likse
LinkextractorPro
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
lwp-request
lwp-trivial
Majestic SEO
MarkMonitor
MarkWatch
Masscan
Mata Hari
MauiBot
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
MIDown tool
Mister PiX
Mojolicious
MSFrontPage
MSIECrawler
Musobot
Name Intelligence
NearSite
Needle
netEstate NE Crawler
NetLyzer
NetMechanic
Nettrack
Net Vampire
Netvibes
NetZIP
NextGenSearchBot
Nibbler
NimbleCrawler
Nimbostratus
Nutch
Offline Navigator
OnCrawl
OpenLinkProfiler
OutclicksBot
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Panscient
Papa Foto
Pavuk
Picscout
Pi-Monster
Pixray
plumanalytics
POE-Component-Client-HTTP
ProPowerBot
Psbot
Quick-Crawler
RankFlex
RankingBot
RankingBot2
RankurBot
RebelMouse
RedesScrapy
ReGet
RepoMonkey
Ripper
RocketCrawler
RSSingBot
s1z.ru
SBIder
ScoutJet
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
Semrush
sexsearcher
Siphon
Sitebeam
Siteimprove
SiteSnagger
SlySearch
SMTBot
Snake
Snapbot
SocialRankIOBot
Sogou web spider
Sottopop
Spammen
Spanner
sp_auditbot
Spbot
Spinn3r
spyfu
Sqlmap
Sqlworm
Stripper
Sucker
SuperHTTP
Surfbot
SurveyBot
Szukacz
T8Abot
Telesphoreo
The Intraformant
Toata
trendiction.de
TurnitinBot
Upflow
URLy Warning
URLy.Warning
Vacuum
VCI
VidibleScraper
Virusdie
Voil
Wallpapers/3.0
WebAuto
WebCollage
WebCopier
WEBDAV
WebEnhancer
Web Enhancer
WebFuck
Web Fuck
WebGo IS
WebmasterWorldForumBot
WebPix
Web Sauger
Webshag
WebStripper
WebSucker
WebZIP
Whack
Whacker
Whatweb
Widow
Woobot
WWW-Collector-E
x09Mozilla
x22Mozilla
YoudaoBot
Zade
Zermelo
zgrab
Zitebot
ZmEu
ZumBot