404enemy
80legs
Abonti
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Apexoo
archive.org_bot
ASPSeek
Attach
Backlink-Ceck
BacklinkCrawler
Barkrowler
Battleztar Bazinga
BBBike
BDCbot
Blackboard
BlackWidow
BLEXBot
Boardreader
Bolt
Brandprotect
Brandwatch
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CheTeam
Cliqzbot
Cloud mapping
coccocbot-web
Copier
crawler4j
Crescent
CSHttp
Custo
DBLBot
Deusu
Devil
Digincore
DigitalPebble
DittoSpyder
DomainStatsBot
Download Wonder
Dragonfly
DSearch
EasyDL
EMail Siphon
EMail Wolf
evc-batch
Evil
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
Firefox/7.0
FlashGet
Flunky
Freeuploader
FrontPage
GalaxyBot
Getintent
Gigablast
G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla
Go!Zilla
Grabber
Grafula
GT::WWW
Haansoft
HaosouSpider
Harvest
HEADMasterSEO
Heritrix
HMView
HTTP::Lite
HybridBot
IndeedBot
Indy Library
InfoTekies
InternetSeer
internetVista monitor
ips-agent
Iria
Iskanie
JamesBOT
JikeSpider
Joomla
Jorgee
Keyword Density
LeechFTP
LeechGet
LexiBot
Lftp
LinkpadBot
LinksManager
Lipperhey
LNSpiderguy
lwp-trivial
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Meanpathbot
Microsoft Data Access
MIDown tool
MIIxpc
Mister PiX
MJ12bot
Mr.4x3
MSIECrawler
muhstik-scan
Nameprotect
Navroad
Needle
Nessus
NetAnts
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
Nettrack
NetZIP
NextGenSearchBot
Nibbler
Niki-bot
Nutch
OnCrawl
OpenLinkProfiler
OrangeSpider
OutfoxBot
Page Analyzer
Pandalytics
Pavuk
PeoplePal
PHPCrawl
Picscout
Picsearch
PictureFinder
Pi-Monster
Pixray
PleaseCrawl
POE-Component-Client-HTTP
ProPowerBot
ProWebWalker
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankurBot
RedesScrapy
ReGet
Rogerbot
RSSingBot
s1z.ru
SalesIntelligent
ScanAlert
Scanbot
Scrapy
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SEOstats
serpstatbot
Shodan
SISTRIX
Siteimprove
SiteSucker
Site Sucker
SmartDownload
SMTBot
Snake
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
SpaceBison
sp_auditbot
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Sqworm
SuperBot
SuperHTTP
Suzuran
sysscan
Szukacz
TeleportPro
Telesphorep
The Intraformant
TheNomad
Thumbor
Tracemyfile
Trendiction
Trendictionbot
trendiction.com
True_Robot
Turnitin
Twice
Typhoeus
UnisterBot
Vagabondo
VCI
VidibleScraper
Virusdie
VoidEYE
Voil
Wallpapers/3.0
WallpapersHD
Web Auto
WebBandit
WebCopier
Web Fetch
WebGo IS
WebImageCollector
WebLeacher
WebSauger
Web Sauger
WebsiteExtractor
WebsiteQuester
WebStripper
Whatweb
Widow
WiseGuys Robot
WISENutbot
Wotbox
YoudaoBot
Zauba
zgrab
ZumBot