360Spider
ADmantX
AIBOT
Aboundex
Aboundexbot
AfD-Verbotsverfahren
Alexibot
Anarchy99
Ankit
Anthill
Aspiegel
Asterias
Atomseobot
BBBike
BackStreet
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle
BlowFish
Bolt
Buck
Buddy
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CODE87
CazoodleBot
CensysInspect
CheTeam
ChinaClaw
Collector
Copier
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Curious
CyotekWebCopy
DBLBot
DTS Agent
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
Dragonfly
EMail Siphon
Exabot
Extractor
EyeNetIE
FDM
FHscan
FemtosearchBot
Fimap
FlashGet
Flunky
Foobot
Fuzz
FyberSpider
GetRight
Gigabot
GoZilla
Grabber
GrapeshotCrawler
HMView
Heritrix
Hloader
IDBot
Iblog
Image Sucker
InterGET
Iria
JOC Web Spider
Jbrofuzz
Jetty
Joomla
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LWP::Simple
Leap
Lftp
LieBaoFast
Lightspeedsystems
Likse
LinkScan
LinqiaScrapeBot
Ltx71
MFC_Tear_Sample
MQQBrowser
MSIECrawler
MTRobot
Majestic-SEO
MarkMonitor
Mass Downloader
Masscan
MeanPath Bot
Meanpathbot
Microsoft Data Access
MolokaiBot
Mr.4x3
NetAnts
NetLyzer
Netcraft
Niki-bot
Nikto
NimbleCrawler
Nutch
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Panscient
Pavuk
PictureFinder
Pimonster
PleaseCrawl
ProPowerBot
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
Re-re
ReGet
RealDownload
RebelMouse
RocketCrawler
SEOprofiler
SMTBot
SalesIntelligent
ScanAlert
Scrapy
Screaming
ScrepyBot
Searchestate
SearchmetricsBot
Semrush
SeobilityBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Sitebeam
SmartDownload
Snapbot
SocialRankIOBot
SpankBot
Spbot
SputnikBot
Sqlmap
Stripper
Sucker
Surfbot
SurveyBot
TeleportPro
Telesphoreo
Telesphorep
TheNomad
Toata
Trendictionbot
Turnitin
Twice
URLy Warning
URLy.Warning
UnisterBot
Upflow
VB Project
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voltron
WEBDAV
WISENutbot
WWWOFFLE
Wallpapers
Web Fetch
Web Fuck
WebAuto
WebCollage
WebFetch
WebSauger
WebSucker
WebZIP
Webalta
Webshag
Website Quester
Webster
Whack
Whacker
Widow
WinHTTrack
WiseGuys Robot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zermelo
Zitebot
ZoominfoBot
arquivo.pt
check1.exe
cognitiveseo
crawl.sogou.com
facebookscraper
gopher
heritrix
iubenda-radar
linkdexbot
lwp-trivial
mediawords
plumanalytics
probe-image-size
scalaj-http
scan.lol
seostar
serpstatbot
sexsearcher
sitechecker.pro
siteripz
sogouspider
spyfu
tAkeOut
voyagerx.com
x09Mozilla
x22Mozilla