360Spider
404checker
404enemy
80legs
Abonti
AfD-Verbotsverfahren
Alligator
AllSubmitter
Anarchie
ASPSeek
autoemailspider
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
BatchFTP
BBBike
BDCbot
BDFetch
Bitacle
Black Hole
BlowFish
Bolt
Brandprotect
Bullseye
BuzzSumo
CazoodleBot
ChinaClaw
Claritybot
coccocbot-web
cognitiveseo
Collector
Copier
crawler4j
Crescent
Curious
Custo
DataCha0s
DBLBot
Disco
Discobot
DomainStatsBot
Dragonfly
DTS Agent
EasyDL
eCatch
ECCP/1.0
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
evc-batch
Exabot
ExtLinksBot
EyeNetIE
facebookscraper
FDM
FemtosearchBot
FHscan
Firefox/7.0
FlashGet
Flunky
Foobot
GalaxyBot
GermCrawler
GetRight
G-i-g-a-b-o-t
Go!Zilla
GrapeFX
GridBot
GT::WWW
Haansoft
HaosouSpider
Harvest
HEADMasterSEO
HTMLparser
HTTP::Lite
HybridBot
Image Fetch
IndeedBot
InfoNaviRobot
InternetSeer
internetVista monitor
ips-agent
Iskanie
JamesBOT
JetCar
Jetty
JustView
Kenjin Spider
Kozmosbot
Larbin
LexiBot
Lftp
LibWeb
Lightspeedsystems
Likse
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Ltx71
Majestic12
Majestic-SEO
Mata Hari
meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
Microsoft Data Access
MJ12bot
Mr.4x3
Msrabot
muhstik-scan
Nameprotect
NearSite
Needle
NetAnts
Netcraft
NetMechanic
Nettrack
Netvibes
NextGenSearchBot
Nikto
Ninja
Nutch
Octopus
Offline Explorer
Offline Navigator
Openfind
OpenLinkProfiler
OrangeBot
OutclicksBot
page scorer
PageScorer
Pandalytics
PECL::HTTP
PeoplePal
PHPCrawl
Picscout
Pi-Monster
Pockey
POE-Component-Client-HTTP
Probethenet
Pump
PxBroker
QueryN Metasearch
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RankurBot
Reaper
RedesScrapy
ReGet
Ripper
SalesIntelligent
ScanAlert
Scanbot
scan.lol
ScoutJet
Scrapy
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
serpstatbot
sexsearcher
Shodan
SISTRIX
Sitebeam
SiteSnagger
SiteSucker
SlySearch
SmartDownload
Snake
Sociscraper
sogouspider
Sosospider
Sottopop
Spanner
Sqlmap
Steeler
Stripper
Sucuri
SuperBot
Surfbot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
TeleportPro
Telesphoreo
Telesphorep
TheNomad
TightTwatBot
Toweyabot
Tracemyfile
trendiction.com
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
Vacuum
VCI
VoidEYE
Voil
Voltron
WASALive-Bot
WBSearchBot
WebAuto
WebBandit
WebCopier
WebEnhancer
Web Enhancer
WebFetch
Web Fuck
webmeup-crawler
Web Pix
WebSauger
Web Sauger
Webshag
WebsiteExtractor
Website Quester
WebStripper
WebSucker
Web Sucker
WebZIP
Whack
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Wprecon
WWW-Collector-E
x09Mozilla
Zade
Zauba
zauba.io
zgrab