360Spider
ADmantX
AIBOT
Aboundex
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
AlphaBot
Anarchy
Anarchy99
Anthill
Asterias
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackWeb
BacklinkCrawler
Badass
Barkrowler
Battleztar Bazinga
Bigfoot
Bitacle
Blackboard
BlowFish
Brandprotect
Buck
Buddy
CATExplorador
CCBot
CensysInspect
CheeseBot
ChinaClaw
Cliqzbot
Cogentbot
Copyscape
Cosmos
Craftbot
Crescent
CrunchBot
Custo
DBLBot
DataCha0s
Devil
Disco
Discoverybot
Dispatch
DomCopBot
Dragonfly
ECCP/1.0
Ebingbong
Ecxi
EirGrabber
Exabot
ExtLinksBot
ExtractorPro
Extreme Picture Finder
FHscan
Fimap
Firefox/7.0
FrontPage
FyberSpider
G-i-g-a-b-o-t
Genieo
GetWeb
Grabber
GrapeFX
GridBot
HEADMasterSEO
HTMLparser
Haansoft
Harvest
Havij
Hloader
IlseBot
Image Sucker
IndeedBot
Indy Library
InterGET
Iria
Iskanie
JOC Web Spider
Jbrofuzz
JennyBot
Jetty
Kenjin Spider
Keyword Density
LWP::Simple
Larbin
LeechFTP
Lightspeedsystems
LinkScan
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MIDown tool
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
MarkMonitor
MarkWatch
MauiBot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Mojolicious
Mozlila
Musobot
NPbot
Name Intelligence
Navroad
NearSite
Net Vampire
NetAnts
NetLyzer
NextGenSearchBot
Nikto
Nuclei
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openfind
Openvas
OrangeSpider
OutclicksBot
PageGrabber
PageScorer
PageThing.com
Papa Foto
Petalbot
Pixray
PleaseCrawl
Psbot
PxBroker
Quick-Crawler
RankActiveLinkBot
Re-re
Reaper
RedesScrapy
RepoMonkey
RocketCrawler
SEOprofiler
SISTRIX
Scanbot
Scrapy
ScrepyBot
Seekport
SemanticJuice
SemrushBot
SentiBot
Seomoz
Siphon
Site Sucker
SiteLockSpider
SiteSnagger
Snake
Snapbot
Snoopy
Sogou web spider
Sosospider
Spammen
SpankBot
Spanner
Spinn3r
Sqlworm
Sqworm
Sucuri
SuperHTTP
Swiftbot
T0PHackTeam
Teleport
TeleportPro
Telesoft
Telesphorep
TheNomad
Thumbor
Trendiction
Trendictionbot
Turingos
URLy.Warning
Upflow
VCI
Vacuum
Virusdie
Voil
WEBDAV
WISENutbot
WWW::Mechanize
WWWOFFLE
WeSEE
Web Collage
Web Sauger
WebBandit
WebEnhancer
WebFuck
WebGo IS
WebPix
WebSucker
WebWhacker
Whack
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Zauba
Zeus
Zitebot
ZoominfoBot
ZumBot
ZyBorg
adscanner
arquivo-web-crawler
backlink-check
cah.io.community
clark-crawler
crawl.sogou.com
demandbase-bot
domainsproject.org
facebookscraper
gopher
instabid
isitwp.com
pcBrowser
serpstatbot
sitechecker.pro
siteripz
spyfu
sysscan
trendiction.com
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com
x22Mozilla
xpymep1.exe