404checker
Aboundex
AfD-Verbotsverfahren
AiHitBot
Anarchie
Aspiegel
BDFetch
BLEXBot
Blow
Brandprotect
Chlooe
Collector
Copyscape
CrazyWebCrawler
CyotekWebCopy
DigitalPebble
DittoSpyder
DomCopBot
Firefox/7.0
GetWeb
Grafula
GrapeshotCrawler
Haansoft
IDBot
Image Fetch
InfoTekies
Iria
Iskanie
JikeSpider
Jyxobot
LeechFTP
Lightspeedsystems
LinkWalker
LinqiaMetadataDownloaderBot
Ltx71
MIIxpc
MQQBrowser
MTRobot
Mag-Net
Magnet
MarkMonitor
Mass Downloader
Masscan
MegaIndex.ru
Microsoft Data Access
Moblie Safari
MolokaiBot
Octopus
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
Petalbot
Pi-Monster
Pimonster
RankingBot
RebelMouse
SEOprofiler
SMTBot
SemrushBot
SenutoBot
SiteExplorer
SiteLockSpider
Sitevigil
SmartDownload
SputnikBot
Sucuri
SuperBot
SurveyBot
Suzuran
TheNomad
TightTwatBot
URLy.Warning
UnisterBot
WASALive-Bot
WWW-Mechanize
Web Pix
WebCollage
WebFetch
WebGo IS
WebImageCollector
WebStripper
WebSucker
Webshag
WebsiteExtractor
WiseGuys Robot
Zade
arquivo-web-crawler
arquivo.pt
crawler4j
evc-batch
facebookscraper
mediawords
muhstik-scan
omgili
siteripz
voyagerx.com
x09Mozilla
x22Mozilla
zauba.io