80legs
ADmantX
AIBOT
ASPSeek
Abonti
Aboundex
Acunetix
AfD-Verbotsverfahren
AiHitBot
AlphaBot
Anarchy
Apexoo
Aspiegel
Asterias
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BDFetch
BackWeb
BetaBot
Bigfoot
Black Hole
Blackboard
Brandprotect
BuiltWith
BunnySlippers
BuzzSumo
CODE87
CSHttp
CazoodleBot
CensysInspect
CheeseBot
CherryPicker
Chlooe
Cliqzbot
Cloud mapping
Collector
CopyRightCheck
CrunchBot
Custo
CyotekWebCopy
DBLBot
DSearch
DatabaseDriverMysqli
Demon
Devil
Dirbuster
Disco
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
EasyDL
Extractor
ExtractorPro
Extreme Picture Finder
FDM
Firefox/7.0
Fyrebot
GalaxyBot
Genieo
Go!Zilla
Go-Ahead-Got-It
Gotit
Grabber
Grafula
HEADMasterSEO
HTTrack
Harvest
HybridBot
IDBTE4M
IDBot
IlseBot
Image Sucker
Internet Ninja
Iskanie
JOC Web Spider
JetCar
JikeSpider
JustView
Kozmosbot
LeechGet
LibWeb
LieBaoFast
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinksManager
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
MIIxpc
MJ12bot
MSIECrawler
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft URL Control
Moblie Safari
Mojeek
Mojolicious
Mozlila
Msrabot
Needle
Nessus
Net Vampire
NetLyzer
NetZIP
Netcraft
Nettrack
Niki-bot
Nikto
Ninja
Nuclei
Offline Explorer
OpenVAS
OrangeBot
OutfoxBot
PECL::HTTP
PHPCrawl
PageGrabber
Pandalytics
Panscient
Petalbot
Picsearch
Piepmatz
Pixray
Pockey
PyCurl
Quick-Crawler
RankActive
RankingBot
Re-re
ReGet
RealDownload
Recorder
SBIder
SEOkicks
SISTRIX
SMTBot
SalesIntelligent
Searchestate
SearchmetricsBot
SentiBot
Siphon
Site Sucker
SiteLockSpider
Sitebeam
SlySearch
SmartDownload
Snake
Sociscraper
Sosospider
Spammen
Sqlmap
Sqlworm
Sqworm
Steeler
Stripper
SuperHTTP
Suzuran
Swiftbot
T8Abot
Teleport
TeleportPro
Telesoft
Telesphoreo
The Intraformant
Thumbor
Toata
Toweyabot
Trendictionbot
Turingos
TwengaBot
UnisterBot
Upflow
VCI
VeriCiteCrawler
Virusdie
Voil
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WWW::Mechanize
Web Fetch
Web Pix
Web Sauger
WebImageCollector
WebWhacker
WebmasterWorldForumBot
Webshag
WebsiteQuester
Webster
Whack
Who.is Bot
Widow
WiseGuys Robot
Wotbox
Xaldon WebSpider
Xenu
YoudaoBot
ZmEu
ZoomBot
ZyBorg
archive.org_bot
arquivo-web-crawler
backlink-check
check1.exe
cognitiveseo
crawl.sogou.com
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
evc-batch
netEstate NE Crawler
plumanalytics
s1z.ru
scalaj-http
seoscanners
seostar
sexsearcher
sogouspider
sp_auditbot
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webpros.com
webprosbot
x22Mozilla
zgrab