360Spider
404enemy
80legs
Aboundex
Acunetix
AhrefsBot
AIBOT
Aipbot
AllSubmitter
archive.org_bot
ASPSeek
Asterias
Attach
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
BackWeb
Bandit
Barkrowler
BBBike
BDFetch
BetaBot
Bigfoot
Bitacle
Black Hole
BLEXBot
BlowFish
Boardreader
Bolt
BotALot
BunnySlippers
BuzzSumo
Calculon
CATExplorador
ChinaClaw
cognitiveseo
Copier
CopyRightCheck
Copyscape
Craftbot
crawler4j
CrazyWebCrawler
Crescent
CSHttp
Curious
Custo
demandbase-bot
Deusu
Devil
DigitalPebble
DIIbot
Dirbuster
Disco
Dispatch
DomainCrawler
Dotbot
Download Wonder
Dragonfly
DSearch
Ebingbong
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
Evil
ExtLinksBot
Fimap
FlashGet
Freeuploader
FyberSpider
GalaxyBot
GetWeb
Go-Ahead-Got-It
GoZilla
Grabber
GrabNet
GrapeFX
GrapeshotCrawler
Havij
HEADMasterSEO
HTMLparser
Humanlinks
HybridBot
Iblog
Image Fetch
instabid
Internet Ninja
InternetSeer
IRLbot
IstellaBot
JamesBOT
JetCar
Jetty
Joomla
Kenjin Spider
LeechFTP
Libwhisker
Linkdexbot
LinkpadBot
LinkScan
LinksManager
Lipperhey
Lipperhey Spider
Litemage_walker
LNSpiderguy
lwp-request
lwp-trivial
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MauiBot
Mediatoolkitbot
Metauri
MFC_Tear_Sample
Microsoft URL Control
MIDown tool
Mister PiX
MJ12bot
Mojeek
MSFrontPage
MSIECrawler
MS Web Services Client Protocol
Musobot
Nameprotect
Nessus
Netcraft
NetMechanic
Net Vampire
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
Nimbostratus
NPbot
Nutch
Octopus
Offline Navigator
Openfind
OpenVAS
OrangeBot
OrangeSpider
PageScorer
pcBrowser
PECL::HTTP
PHPCrawl
Picscout
PictureFinder
Pixray
Pockey
Probethenet
ProWebWalker
Psbot
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot2
Rankivabot
RankurBot
RealDownload
Reaper
Recorder
RepoMonkey
SBIder
Scanbot
Scrapy
ScreenerBot
Seomoz
SEOprofiler
SeoSiteCheckup
SEOstats
Siphon
Sitebeam
SiteExplorer
SiteLockSpider
SiteSnagger
Site Sucker
Sitevigil
SmartDownload
SMTBot
Snake
Snoopy
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
Spammen
SpankBot
Spanner
sp_auditbot
Sqlworm
Steeler
SuperBot
SuperHTTP
sysscan
Szukacz
T0PHackTeam
tAkeOut
Teleport
Telesphorep
TightTwatBot
Titan
Tracemyfile
trendiction.de
True_Robot
UnisterBot
Upflow
URLy Warning
URLy.Warning
Vagabondo
VB Project
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voil
WallpapersHD
WASALive-Bot
WBSearchBot
WebCopier
WEBDAV
WebFuck
WebmasterWorldForumBot
Web Pix
WebReaper
WebSauger
Web Sauger
Webster
WebSucker
WebWhacker
WebZIP
WeSEE
Whack
WISENutbot
Wprecon
WPScan
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu
xpymep1.exe
Zade
Zauba
Zeus
ZmEu