360Spider
404checker
404enemy
80legs
Abonti
Aboundexbot
Acunetix
AhrefsBot
Alligator
AlphaBot
Ankit
Anthill
AwarioSmartBot
BackStreet
BacklinkCrawler
Badass
Bandit
BatchFTP
Black Hole
Blackboard
Bolt
Brandwatch
Buck
Buddy
BunnySlippers
BuzzSumo
Calculon
CheTeam
Copier
CopyRightCheck
Cosmos
Craftbot
Crescent
CrunchBot
CyotekWebCopy
DIIbot
DSearch
DataCha0s
Devil
DigitalPebble
Disco
Discoverybot
Dispatch
DomCopBot
DomainAppender
DomainStatsBot
Dotbot
Download Wonder
ECCP/1.0
EirGrabber
Evil
Express WebPictures
ExtLinksBot
ExtractorPro
Extreme Picture Finder
FDM
FHscan
FemtosearchBot
Fimap
Fuzz
FyberSpider
Genieo
GermCrawler
GetRight
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
Gotit
GrabNet
GrapeshotCrawler
HTMLparser
HTTP::Lite
HTTrack
HaosouSpider
Havij
Heritrix
HybridBot
IRLbot
Id-search
Image Sucker
Indy Library
InterGET
Internet Ninja
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
JetCar
JikeSpider
Jyxobot
LeechFTP
LibWeb
Lightspeedsystems
LinkScan
LinkWalker
Lipperhey Spider
Litemage_walker
MSFrontPage
Magnet
Mail.RU_Bot
MarkMonitor
Mata Hari
Microsoft URL Control
Mister PiX
Msrabot
NetMechanic
NetSpider
NetZIP
NextGenSearchBot
Niki-bot
Nikto
Nimbostratus
Nmap
Nutch
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openvas
OutclicksBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageGrabber
PageThing.com
Panscient
Petalbot
Pi-Monster
Picsearch
Piepmatz
Pimonster
Pixray
PleaseCrawl
Pockey
Pump
PxBroker
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankingBot
Rankivabot
Re-re
Reaper
Recorder
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
ScanAlert
Scanbot
ScoutJet
Scrapy
Screaming
ScrepyBot
Semrush
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
SlySearch
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
Spanner
SputnikBot
Sqlmap
Sqworm
Sucuri
SuperBot
Swiftbot
Szukacz
Teleport
TeleportPro
Telesphoreo
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
TurnitinBot
Twice
URLy.Warning
Upflow
VB Project
VidibleScraper
Voil
WASALive-Bot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WallpapersHD
Web Auto
Web Collage
Web Fetch
Web Pix
WebAuto
WebBandit
WebCollage
WebCopier
WebFuck
WebImageCollector
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Whacker
Whatweb
Who.is Bot
WiseGuys Robot
Woobot
Wotbox
Xenu
YoudaoBot
Zermelo
Zitebot
ZmEu
ZoomBot
backlink-check
clark-crawler
coccocbot-web
crawl.sogou.com
eCatch
gopher
heritrix
instabid
ips-agent
isitwp.com
lwp-request
magpie-crawler
meanpathbot
mediawords
muhstik-scan
oBot
polaris version
ripz
s1z.ru
satoristudio.net
seobility
sexsearcher
sp_auditbot
spyfu
ubermetrics-technologies.com
webmeup-crawler
xpymep1.exe