404enemy
Aboundex
Aboundexbot
Acunetix
AhrefsBot
Alligator
AlphaBot
Anarchie
Anarchy
arquivo-web-crawler
ASPSeek
Asterias
Attach
AwarioSmartBot
Backlink-Ceck
backlink-check
Badass
Bandit
Barkrowler
BDCbot
BDFetch
BetaBot
Blackboard
Black Hole
BlackWidow
Blow
Boardreader
Brandprotect
Brandwatch
Buck
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
Cegbfeieh
CensysInspect
CheeseBot
CheTeam
Cliqzbot
Cloud mapping
CODE87
Cogentbot
cognitiveseo
Collector
Copier
Copyscape
Craftbot
crawler4j
CrunchBot
CSHttp
CyotekWebCopy
DatabaseDriverMysqli
DataCha0s
DBLBot
demandbase-bot
Deusu
Devil
DigitalPebble
DIIbot
Dirbuster
Disco
Discoverybot
DomainCrawler
Download Wonder
DTS Agent
EMail Siphon
EMail Wolf
EroCrawler
Extractor
Ezooms
FDM
FemtosearchBot
Fuzz
Genieo
Gotit
Go!Zilla
Grabber
Grafula
GrapeFX
GrapeshotCrawler
Havij
HEADMasterSEO
Heritrix
HTTP::Lite
HTTrack
Humanlinks
IDBTE4M
IlseBot
Image Sucker
InfoTekies
instabid
internetVista monitor
ips-agent
isitwp.com
Jbrofuzz
JetCar
Keyword Density
Kinza
Kozmosbot
LeechFTP
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinksManager
LinqiaRSSBot
Lmspider
Ltx71
lwp-request
lwp-trivial
Mag-Net
magpie-crawler
Majestic12
Majestic-SEO
MarkMonitor
Masscan
Mass Downloader
Mata Hari
Mb2345Browser
Meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft URL Control
MIDown tool
Mister PiX
Mojeek
Mojolicious
MQQBrowser
MSFrontPage
MSIECrawler
Nameprotect
Navroad
Needle
NetAnts
Netcraft
NetSpider
Net Vampire
NimbleCrawler
Ninja
Nmap
oBot
Offline Explorer
Offline Navigator
OnCrawl
OPPO A33
OrangeBot
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Panscient
PECL::HTTP
PeoplePal
PHPCrawl
Picscout
Pi-Monster
Pixray
plumanalytics
ProWebWalker
Pu_iN
PyCurl
Rankivabot
RealDownload
Reaper
RedesScrapy
ReGet
RepoMonkey
Re-re
ripz
s1z.ru
SalesIntelligent
scalaj-http
Scanbot
ScoutJet
Searchestate
SentiBot
SEOkicks-Robot
SEOlyticsCrawler
seoscanners
SEOstats
Siphon
SISTRIX
Sitebeam
SiteCheckerBotCrawler
SiteLockSpider
SmartDownload
Snake
SocialRankIOBot
Sociscraper
sogouspider
SpankBot
Spanner
Spinn3r
spyfu
Sqlmap
Sucuri
Surfbot
Suzuran
Swiftbot
sysscan
T8Abot
TeleportPro
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Toweyabot
Trendictionbot
Turingos
Twice
UnisterBot
VB Project
VCI
VeriCiteCrawler
Virusdie
Voil
WallpapersHD
WASALive-Bot
WebAuto
Web Auto
WebCollage
WEBDAV
Web Enhancer
Web Fetch
WebmasterWorldForumBot
webmeup-crawler
WebsiteExtractor
WebStripper
WeSEE
Whack
Widow
WinHTTrack
Wonderbot
Wotbox
Wprecon
WPScan
WWW-Collector-E
WWW-Mechanize
Xenu
Zade
zauba.io
Zermelo
Zeus
zgrab
ZoominfoBot
ZyBorg