360Spider
404checker
404enemy
Aboundexbot
ADmantX
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter
AlphaBot
Apexoo
archive.org_bot
Asterias
Attach
autoemailspider
Backlink-Ceck
BackWeb
Bandit
Battleztar Bazinga
BDCbot
BetaBot
Bigfoot
BlackWidow
BLEXBot
Boardreader
BotALot
CATExplorador
CCBot
Cegbfeieh
CheeseBot
CheTeam
ChinaClaw
Cloud mapping
cognitiveseo
com.plumanalytics
crawler.feedback
crawl.sogou.com
Crescent
CrunchBot
Custo
DataCha0s
Demon
Deusu
Digincore
DIIbot
Dirbuster
Disco
Discobot
DnyzBot
DomainCrawler
DomainStatsBot
Dotbot
DSearch
Ecxi
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Evil
ExtLinksBot
ExtractorPro
Extreme Picture Finder
Ezooms
facebookscraper
FemtosearchBot
FHscan
Fimap
Firefox/7.0
Flunky
FrontPage
GalaxyBot
Genieo
GermCrawler
GetRight
GetWeb
Go-Ahead-Got-It
Gotit
Grabber
Grafula
GrapeshotCrawler
GT::WWW
HEADMasterSEO
Hloader
HMView
Iblog
IDBot
Id-search
Image Sucker
Indy Library
internetVista monitor
ips-agent
Iria
JennyBot
JetCar
JikeSpider
Jorgee
Keyword Density
Kozmosbot
Lanshanbot
LeechFTP
LinkextractorPro
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
LWP::Simple
Magnet
magpie-crawler
Majestic12
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
meanpathbot
Mediatoolkitbot
mediawords
MFC_Tear_Sample
Microsoft URL Control
MIIxpc
Mister PiX
MJ12bot
Mr.4x3
Msrabot
MS Web Services Client Protocol
muhstik-scan
Musobot
Navroad
Needle
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
NetZIP
NextGenSearchBot
Nibbler
NICErsPRO
Nmap
Nutch
Offline Explorer
Offline Navigator
OnCrawl
OutclicksBot
OutfoxBot
Papa Foto
Pavuk
PECL::HTTP
PeoplePal
PHPCrawl
PictureFinder
PleaseCrawl
ProPowerBot
ProWebWalker
Psbot
Pump
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot2
Rankivabot
Reaper
Recorder
RedesScrapy
RocketCrawler
s1z.ru
SalesIntelligent
SBIder
ScanAlert
Scanbot
scan.lol
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
Semrush
SemrushBot
SEOkicks
Seomoz
SEOstats
sexsearcher
Siphon
Sitebeam
SiteSnagger
SiteSucker
Site Sucker
Sitevigil
SlySearch
SMTBot
Snake
Sogou web spider
Spanner
Spbot
SputnikBot
Sqlmap
Sucker
Sucuri
SuperBot
SuperHTTP
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
T8Abot
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Thumbor
Toata
Toweyabot
Trendictionbot
trendiction.com
Turingos
Turnitin
UnisterBot
Upflow
VeriCiteCrawler
Voil
Wallpapers/3.0
WASALive-Bot
Webalta
WebAuto
Web Auto
WebCollage
WebEnhancer
WebFuck
WebLeacher
WebmasterWorldForumBot
WebReaper
WebSauger
Webshag
Website Quester
WebStripper
WebSucker
WebZIP
Whack
Whacker
Whatweb
Who.is Bot
WiseGuys Robot
WPScan
WWWOFFLE
x09Mozilla
Xaldon_WebSpider
Xenu
xpymep1.exe
Zauba
Zermelo
Zeus
Zitebot
ZyBorg