360Spider
404checker
404enemy
ADmantX
AIBOT
ASPSeek
Acunetix
AhrefsBot
Aipbot
AllSubmitter
Anarchy
Anarchy99
Attach
AwarioRssBot
AwarioSmartBot
BBBike
Bandit
BetaBot
Bigfoot
Black Hole
BlackWidow
Bolt
BotALot
Brandprotect
BuzzSumo
Chlooe
Cocolyzebot
Copier
Copyscape
Craftbot
CrazyWebCrawler
Crescent
Curious
Custo
CyotekWebCopy
DBLBot
DSearch
DataCha0s
Digincore
DigitalPebble
Disco
Dispatch
DittoSpyder
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Dotbot
ECCP/1.0
EasyDL
Ebingbong
Ecxi
Evil
ExtractorPro
EyeNetIE
Foobot
Fyrebot
GalaxyBot
GetWeb
Gotit
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HTMLparser
HonoluluBot
IRLbot
Iblog
IlseBot
Image Fetch
InfoNaviRobot
Intelliseek
Internet Ninja
InternetSeer
Iskanie
IstellaBot
Jbrofuzz
Jetty
JikeSpider
JustView
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Larbin
Lightspeedsystems
Likse
LinkextractorPro
LinksManager
Ltx71
MJ12bot
MSIECrawler
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
Masscan
Mata Hari
MauiBot
MeanPath Bot
Mediatoolkitbot
Metauri
MicroMessenger
Microsoft URL Control
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
NICErsPRO
Net Vampire
NetLyzer
NetMechanic
NetZIP
Netcraft
Netvibes
Nibbler
NimbleCrawler
Nimbostratus
Not
Nuclei
Octopus
Offline Explorer
Openfind
OrangeBot
OrangeSpider
PECL::HTTP
PHPCrawl
Page Analyzer
Papa Foto
Picscout
PictureFinder
Pixray
ProPowerBot
ProWebWalker
Psbot
PxBroker
Quick-Crawler
RSSingBot
RankActiveLinkBot
Rankivabot
RankurBot
Re-re
Recorder
RedesScrapy
SEOlyticsCrawler
SISTRIX
SMTBot
Scanbot
ScoutJet
ScreenerBot
Searchestate
SemanticJuice
SemrushBot
SentiBot
SeobilityBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
Sitebeam
Snake
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider
Sottopop
Spammen
SpankBot
Spanner
Spbot
Spinn3r
SputnikBot
Sqlmap
Stripper
Sucker
Sucuri
Szukacz
Teleport
Telesphoreo
Toweyabot
Trendictionbot
UnisterBot
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VoidEYE
WEBDAV
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Fuck
Web Sucker
WebFetch
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebStripper
WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot
WebsiteExtractor
WebsiteQuester
Webster
Whacker
Who.is Bot
Wonderbot
Woobot
Xaldon WebSpider
YoudaoBot
adscanner
arquivo.pt
backlink-check
cognitiveseo
crawler4j
domainsproject.org
eCatch
facebookscraper
heritrix
internetVista monitor
isitwp.com
lwp-request
lwp-trivial
mediawords
plumanalytics
probe-image-size
scalaj-http
scan.lol
sexsearcher
sitechecker.pro
trendiction.de
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webprosbot
x09Mozilla
zauba.io
zgrab