360Spider
80legs
Aboundex
Aboundexbot
Acunetix
Aipbot
Alligator
AllSubmitter
AlphaBot
Apexoo
archive.org_bot
BackDoorBot
BackStreet
Bandit
Barkrowler
BatchFTP
BDFetch
Bigfoot
Blackboard
BlackWidow
BLEXBot
Blow
BlowFish
BotALot
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CCBot
Cegbfeieh
CheeseBot
Cliqzbot
Cloud mapping
com.plumanalytics
Copier
crawler4j
crawl.sogou.com
CrazyWebCrawler
Curious
Custo
DatabaseDriverMysqli
DataCha0s
Deusu
Digincore
DigitalPebble
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
Drip
EasyDL
Ebingbong
ECCP/1.0
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
Ezooms
FemtosearchBot
FHscan
Freeuploader
FrontPage
GermCrawler
GetRight
GetWeb
Gigablast
Gigabot
G-i-g-a-b-o-t
Go!Zilla
GrapeshotCrawler
GridBot
HaosouSpider
Havij
HEADMasterSEO
Heritrix
HMView
HTTP::Lite
HTTrack
Iblog
IlseBot
IndeedBot
Indy Library
InfoNaviRobot
instabid
InternetSeer
Iria
Iskanie
IstellaBot
JamesBOT
JetCar
Jetty
JikeSpider
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
Lftp
Likse
LinkScan
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
LNSpiderguy
lwp-request
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Majestic SEO
Mass Downloader
Mata Hari
Meanpathbot
MeanPath Bot
Metauri
MFC_Tear_Sample
Microsoft Data Access
MIDown tool
Morfeus Fucking Scanner
Musobot
Name Intelligence
Nameprotect
Navroad
NearSite
Nessus
NetAnts
Nettrack
NetZIP
Niki-bot
Ninja
Nmap
oBot
Openfind
Openvas
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PageAnalyzer
page scorer
Pandalytics
Papa Foto
Pavuk
pcBrowser
PeoplePal
Picsearch
Pi-Monster
Pixray
Pockey
Probethenet
ProPowerBot
ProWebWalker
Psbot
QueryN Metasearch
RankActive
RankActiveLinkBot
Recorder
RepoMonkey
s1z.ru
SBIder
Scanbot
scan.lol
Screaming
SearchmetricsBot
SemrushBot
Seomoz
sexsearcher
Siphon
Sitebeam
Siteimprove
SiteLockSpider
SiteSucker
Site Sucker
Sitevigil
SMTBot
Snapbot
SocialRankIOBot
Sosospider
Sottopop
Spammen
SpankBot
Spanner
sp_auditbot
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Steeler
Stripper
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
TeleportPro
Telesoft
Telesphoreo
Trendictionbot
True_Robot
Turnitin
TurnitinBot
TwengaBot
Twice
URLy.Warning
Vacuum
Vagabondo
VB Project
VoidEYE
Voil
Voltron
WebAuto
WebBandit
Web Collage
WebFetch
WebLeacher
WebPix
Web Sauger
WebsiteQuester
Website Quester
WebStripper
Web Sucker
WebZIP
Whack
Who.is Bot
Wonderbot
Wprecon
WWW-Mechanize
WWW::Mechanize
Xaldon WebSpider
Xenu
Zauba
zgrab
ZmEu