360Spider
80legs
Aboundex
Aboundexbot
Acunetix
ADmantX
AhrefsBot
AiHitBot
Aipbot
AlphaBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
BBBike
BDCbot
BDFetch
Bigfoot
Black Hole
BLEXBot
Boardreader
Bolt
BotALot
Buddy
BuiltBotTough
BuzzSumo
Calculon
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Cliqzbot
coccocbot-web
Collector
Copier
CopyRightCheck
Cosmos
crawler4j
crawl.sogou.com
CrazyWebCrawler
CrunchBot
DataCha0s
Demon
Deusu
Devil
DIIbot
Dirbuster
Disco
Discoverybot
DomainCrawler
DomainSigmaCrawler
Download Wonder
Drip
DSearch
EasyDL
Ebingbong
eCatch
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
Express WebPictures
Extractor
ExtractorPro
EyeNetIE
facebookscraper
FDM
FemtosearchBot
FHscan
FlashGet
FyberSpider
Fyrebot
GalaxyBot
GetRight
G-i-g-a-b-o-t
GoZilla
GrabNet
GridBot
GT::WWW
Haansoft
Harvest
HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
Humanlinks
HybridBot
Iblog
IDBot
Id-search
IlseBot
InfoTekies
Intelliseek
Internet Ninja
IstellaBot
Jbrofuzz
Jetty
JustView
Keyword Density
Lanshanbot
Larbin
LeechGet
LexiBot
Likse
Linkdexbot
LinkpadBot
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Lmspider
Ltx71
Magnet
Majestic-SEO
MarkMonitor
MarkWatch
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MFC_Tear_Sample
MIIxpc
Mister PiX
Mojeek
Mr.4x3
MSIECrawler
Msrabot
Musobot
Name Intelligence
Navroad
Nessus
NetLyzer
NetMechanic
Nettrack
Niki-bot
Nikto
Nimbostratus
Ninja
Nmap
NPbot
oBot
Offline Navigator
OnCrawl
Openvas
OrangeBot
OutfoxBot
PageAnalyzer
Papa Foto
Pavuk
PictureFinder
Pimonster
Pi-Monster
Pixray
plumanalytics
Pockey
POE-Component-Client-HTTP
Probethenet
Pump
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankFlex
Rankivabot
Reaper
Recorder
RepoMonkey
SBIder
ScanAlert
Scrapy
Screaming
Searchestate
SearchmetricsBot
SemrushBot
SEOlyticsCrawler
SEOprofiler
SEOstats
Siphon
SISTRIX
Siteimprove
SiteSnagger
SlySearch
SmartDownload
Snake
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
Sottopop
SpaceBison
Spammen
SpankBot
Spbot
SputnikBot
Stripper
Sucker
SuperBot
SuperHTTP
SurveyBot
Suzuran
Swiftbot
sysscan
Szukacz
T8Abot
tAkeOut
Teleport
TeleportPro
TheNomad
Titan
Toweyabot
Tracemyfile
Trendiction
Turingos
Typhoeus
UnisterBot
Upflow
Vagabondo
VCI
Voltron
Wallpapers/3.0
Webalta
WebAuto
WebBandit
Web Enhancer
WebFuck
WebLeacher
Web Sauger
WebsiteExtractor
Webster
WebStripper
WebWhacker
WeSEE
Whack
Who.is Bot
WISENutbot
Wotbox
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
x09Mozilla
Xaldon WebSpider
xpymep1.exe
YoudaoBot
Zade
Zauba
Zermelo
ZumBot