360Spider
404checker
404enemy
80legs
Abonti
Aboundexbot
Acunetix
AhrefsBot
AIBOT
Aipbot
Alexibot
AllSubmitter
Attach
autoemailspider
BackDoorBot
Backlink-Ceck
backlink-check
BackStreet
Badass
Barkrowler
BatchFTP
Battleztar Bazinga
BDCbot
Bigfoot
Blackboard
BlackWidow
Bolt
BotALot
Brandwatch
Buddy
BunnySlippers
CazoodleBot
Cegbfeieh
CheTeam
ChinaClaw
Chlooe
Claritybot
coccocbot-web
cognitiveseo
Copier
Copyscape
Cosmos
Craftbot
crawler4j
CrazyWebCrawler
DataCha0s
DBLBot
Deusu
DigitalPebble
DIIbot
Dirbuster
Disco
Discobot
Dispatch
DomainAppender
DomainCrawler
Download Wonder
DSearch
eCatch
evc-batch
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
EyeNetIE
Ezooms
facebookscraper
FHscan
Fimap
Firefox/7.0
FlashGet
Flunky
Fyrebot
Getintent
GetRight
G-i-g-a-b-o-t
Go!Zilla
Grabber
Grafula
GrapeshotCrawler
Harvest
HEADMasterSEO
Heritrix
Hloader
HTTP::Lite
HTTrack
Iblog
Image Fetch
Indy Library
InfoTekies
instabid
Intelliseek
InterGET
ips-agent
Iria
IstellaBot
JamesBOT
JetCar
JOC Web Spider
Joomla
JustView
Kenjin Spider
Kozmosbot
LeechFTP
Lftp
Libwhisker
LinkextractorPro
LinkScan
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
MarkMonitor
MarkWatch
Mata Hari
Meanpathbot
mediawords
Metauri
MFC_Tear_Sample
Msrabot
MS Web Services Client Protocol
muhstik-scan
Musobot
Nameprotect
Navroad
Needle
NetAnts
Netcraft
NetMechanic
NetSpider
NetZIP
NextGenSearchBot
Nibbler
NICErsPRO
Nimbostratus
Ninja
Nutch
Offline Explorer
Offline Navigator
OnCrawl
Openfind
OpenLinkProfiler
OpenVAS
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
page scorer
pcBrowser
PECL::HTTP
PeoplePal
PictureFinder
plumanalytics
Pockey
Probethenet
QueryN Metasearch
RankActive
RankFlex
RankingBot
Recorder
Scanbot
scan.lol
ScoutJet
Scrapy
Screaming
Searchestate
Semrush
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SEOstats
serpstatbot
sexsearcher
Shodan
SISTRIX
Sitebeam
SiteLockSpider
Sitevigil
SMTBot
Snapbot
SocialRankIOBot
sogouspider
Sosospider
Sottopop
SpankBot
sp_auditbot
spyfu
Sqlworm
Sqworm
Sucuri
SuperHTTP
Swiftbot
sysscan
Teleport
Telesoft
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Toweyabot
Trendiction
trendiction.de
Turingos
Twice
UnisterBot
Upflow
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
WallpapersHD
WBSearchBot
WebCollage
WebCopier
WebEnhancer
Web Enhancer
WebFetch
WebFuck
Web Fuck
WebPix
Web Pix
WebReaper
WebSauger
Web Sauger
WebsiteExtractor
Webster
WebStripper
WebWhacker
WebZIP
Whack
Whatweb
WiseGuys Robot
Wotbox
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
x09Mozilla
Xenu
xpymep1.exe
YoudaoBot
Zade
Zauba
zauba.io
Zeus
ZmEu
ZyBorg