360Spider
Aboundexbot
ADmantX
AhrefsBot
AIBOT
Alligator
AllSubmitter
archive.org_bot
ASPSeek
BacklinkCrawler
BatchFTP
Battleztar Bazinga
BBBike
BDCbot
BDFetch
BetaBot
Bigfoot
Black Hole
BLEXBot
Blow
BlowFish
Boardreader
Brandprotect
Brandwatch
BuiltWith
Calculon
CCBot
CherryPicker
CheTeam
Chlooe
Claritybot
Cliqzbot
Cloud mapping
coccocbot-web
Collector
com.plumanalytics
Cosmos
Craftbot
CSHttp
Custo
DBLBot
Demon
DigitalPebble
Discobot
Discoverybot
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
ECCP/1.0
EirGrabber
Express WebPictures
Extractor
Extreme Picture Finder
facebookscraper
FDM
FHscan
Fimap
Flunky
FrontPage
FyberSpider
Genieo
GermCrawler
GetWeb
Gigablast
Go-Ahead-Got-It
GoZilla
GrabNet
Grafula
GridBot
Harvest
Havij
HEADMasterSEO
Iblog
Image Sucker
Indy Library
instabid
Intelliseek
ips-agent
JamesBOT
JennyBot
Jetty
JOC Web Spider
Joomla
Kenjin Spider
Keyword Density
Lanshanbot
LeechGet
LibWeb
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Litemage_walker
LNSpiderguy
Ltx71
lwp-request
Mag-Net
Majestic SEO
Majestic-SEO
MarkWatch
Mata Hari
meanpathbot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft URL Control
MIDown tool
MIIxpc
Mister PiX
Morfeus Fucking Scanner
Msrabot
NearSite
Needle
Nessus
NetAnts
Netcraft
NetSpider
Net Vampire
Netvibes
NetZIP
NextGenSearchBot
Nibbler
Niki-bot
NPbot
Nutch
oBot
Octopus
Offline Navigator
OpenLinkProfiler
OutclicksBot
OutfoxBot
Panscient
Papa Foto
PECL::HTTP
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
plumanalytics
Pockey
Probethenet
ProPowerBot
PxBroker
PyCurl
RankActive
RankActiveLinkBot
RankingBot
Rankivabot
RankurBot
RealDownload
Recorder
Ripper
RocketCrawler
Rogerbot
SBIder
Scanbot
scan.lol
Scrapy
ScreenerBot
Searchestate
SearchmetricsBot
SEOkicks
SEOlyticsCrawler
SEOprofiler
serpstatbot
SISTRIX
SiteSnagger
SiteSucker
Site Sucker
SlySearch
SmartDownload
Snake
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sottopop
SpaceBison
Spammen
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Steeler
Stripper
Sucker
SuperBot
Surfbot
Suzuran
Szukacz
T8Abot
tAkeOut
Teleport
Telesphoreo
TightTwatBot
Toweyabot
Trendictionbot
trendiction.com
trendiction.de
Turnitin
TwengaBot
UnisterBot
Upflow
URLy.Warning
Vacuum
Vagabondo
VCI
VoidEYE
Voltron
Wallpapers/3.0
WallpapersHD
WASALive-Bot
WBSearchBot
Web Collage
WebCopier
WEBDAV
WebEnhancer
Web Enhancer
WebGo IS
WebLeacher
WebmasterWorldForumBot
WebSauger
Webshag
WebsiteExtractor
WebsiteQuester
WebSucker
WebWhacker
Whack
Whacker
Who.is Bot
WinHTTrack
Wonderbot
Wprecon
WPScan
WWWOFFLE
x09Mozilla
Xaldon_WebSpider
Xenu
xpymep1.exe
Zade
zauba.io
Zermelo
Zeus
ZmEu
ZumBot
ZyBorg