80legs
Aboundex
Acunetix
AfD-Verbotsverfahren
Aipbot
Alligator
AllSubmitter
AlphaBot
Anarchie
Apexoo
archive.org_bot
ASPSeek
Backlink-Ceck
BacklinkCrawler
Barkrowler
BBBike
BDCbot
BetaBot
Bitacle
Black Hole
Blow
BlowFish
Boardreader
Buddy
BuiltWith
Bullseye
Calculon
CATExplorador
CazoodleBot
CCBot
Claritybot
Cogentbot
cognitiveseo
Copier
CopyRightCheck
Copyscape
Cosmos
Craftbot
crawler4j
crawler.feedback
CrunchBot
CSHttp
Curious
DatabaseDriverMysqli
Deusu
Digincore
DigitalPebble
Discoverybot
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
Dotbot
Download Wonder
Dragonfly
EasyDL
ECCP/1.0
Ecxi
EMail Siphon
EMail Wolf
Express WebPictures
ExtLinksBot
ExtractorPro
FemtosearchBot
Fimap
FyberSpider
Fyrebot
GalaxyBot
Genieo
GetWeb
GoZilla
Grafula
GrapeshotCrawler
HaosouSpider
Harvest
Heritrix
Hloader
HMView
HTTP::Lite
HTTrack
Id-search
IndeedBot
instabid
Intelliseek
InterGET
Internet Ninja
InternetSeer
ips-agent
Iria
IstellaBot
Jetty
JOC Web Spider
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LeechFTP
LeechGet
Lightspeedsystems
Likse
Linkdexbot
LinkextractorPro
LinkScan
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
LNSpiderguy
Magnet
Mag-Net
Majestic SEO
MarkMonitor
Masscan
MauiBot
meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
MIIxpc
Mister PiX
MSFrontPage
MSIECrawler
Musobot
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
Nessus
NetAnts
netEstate NE Crawler
NetLyzer
NetMechanic
Netvibes
NICErsPRO
NimbleCrawler
NPbot
Octopus
OpenLinkProfiler
Openvas
Page Analyzer
page scorer
PageScorer
Pandalytics
Papa Foto
pcBrowser
PECL::HTTP
PeoplePal
PHPCrawl
PictureFinder
Pimonster
PleaseCrawl
POE-Component-Client-HTTP
Psbot
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RankingBot2
Rankivabot
RealDownload
RebelMouse
Recorder
Ripper
Rogerbot
SBIder
ScanAlert
Screaming
SemrushBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
seoscanners
SEOstats
SISTRIX
SiteLockSpider
SiteSnagger
Snapbot
sogouspider
SpaceBison
Spammen
sp_auditbot
Spinn3r
SputnikBot
spyfu
Sqlmap
Steeler
Stripper
SuperHTTP
Swiftbot
T8Abot
tAkeOut
Teleport
TeleportPro
Telesoft
Telesphorep
TheNomad
Titan
Toata
Toweyabot
Trendictionbot
trendiction.de
Turingos
Turnitin
URLy Warning
URLy.Warning
VCI
VidibleScraper
Voil
Voltron
Wallpapers/3.0
WallpapersHD
WASALive-Bot
Webalta
WebAuto
WebBandit
Web Collage
Web Fetch
WebGo IS
Web Pix
WebSauger
Web Sauger
Webshag
WebsiteExtractor
WebsiteQuester
WebStripper
Web Sucker
WebWhacker
WeSEE
WinHTTrack
Wonderbot
Woobot
Wotbox
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
x09Mozilla
Xaldon WebSpider
Xenu
xpymep1.exe
Zauba
Zermelo
zgrab
Zitebot
ZyBorg