404checker
80legs
AIBOT
Abonti
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter
Anarchy99
Anthill
Aspiegel
Asterias
Attach
BBBike
BDFetch
BacklinkCrawler
Badass
Bandit
Bitacle
BlackWidow
Blackboard
Brandwatch
Buddy
BuiltWith
BuzzSumo
CATExplorador
CCBot
CensysInspect
Chlooe
Citoid
Claritybot
Cliqzbot
Cloud mapping
Cocolyzebot
Copier
Copyscape
CyotekWebCopy
DIIbot
DTS Agent
Demon
Devil
Digincore
Dirbuster
Discobot
Discoverybot
Dispatch
DomainStatsBot
Domains Project
Ecxi
EirGrabber
Express WebPictures
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
Flunky
FrontPage
GT::WWW
GetRight
GoZilla
Gotit
GrabNet
Grabber
GrapeFX
GridBot
HTTP::Lite
Heritrix
HonoluluBot
HybridBot
IDBot
Id-search
IlseBot
Image Sucker
InfoTekies
Intelliseek
InterGET
InternetSeer
IstellaBot
JOC Web Spider
JetCar
Joomla
JustView
Jyxobot
Kenjin Spider
Kozmosbot
LWP::Simple
Lanshanbot
LeechGet
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Likse
Linkbot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Ltx71
MFC_Tear_Sample
MQQBrowser
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic12
MauiBot
MicroMessenger
Microsoft Data Access
Mister PiX
Mojolicious
Mr.4x3
NPbot
Name Intelligence
Navroad
Net Vampire
NetAnts
NetSpider
Netcraft
Netvibes
NextGenSearchBot
Niki-bot
Nikto
Ninja
Not
Nuclei
Nutch
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
PageAnalyzer
PageGrabber
PageScorer
Pavuk
Petalbot
PictureFinder
Pimonster
Pixray
PleaseCrawl
Pockey
PyCurl
RankFlex
RankingBot
Re-re
RealDownload
Reaper
RebelMouse
Recorder
SMTBot
SalesIntelligent
Scanbot
Scrapy
ScreenerBot
ScrepyBot
Searchestate
SemrushBot
SentiBot
SeoSiteCheckup
Seomoz
Siphon
Site Sucker
SiteLockSpider
SiteSucker
SmartDownload
Snapbot
Sociscraper
Sosospider
Sottopop
SpaceBison
Spammen
SpankBot
Sqlworm
Stripper
SuperHTTP
Suzuran
TeleportPro
The Intraformant
Thumbor
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turnitin
URLy Warning
URLy.Warning
UnisterBot
VB Project
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VoidEYE
Voltron
WASALive-Bot
WWW::Mechanize
WWWOFFLE
WeSEE
Web Enhancer
Web Pix
Web Sucker
WebAuto
WebCollage
WebEnhancer
WebFetch
WebGo IS
WebReaper
WebZIP
Webshag
Whack
Whatweb
Who.is Bot
Widow
Zauba
ZumBot
archive.org_bot
arquivo.pt
backlink-check
check1.exe
coccocbot
crawler.feedback
eCatch
evc-batch
facebookscraper
heritrix
internetVista monitor
iubenda-radar
lwp-request
magpie-crawler
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
oBot
plumanalytics
s1z.ru
seoscanners
serpstatbot
sexsearcher
siteripz
sp_auditbot
sysscan
ubermetrics-technologies.com
webprosbot
x09Mozilla
x22Mozilla
zauba.io
zgrab