80legs
Abonti
Aboundex
Acunetix
AhrefsBot
AIBOT
Anarchie
Attach
autoemailspider
BackDoorBot
BacklinkCrawler
Badass
BatchFTP
Battleztar Bazinga
BBBike
Blackboard
BLEXBot
BlowFish
Boardreader
BotALot
Brandwatch
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CazoodleBot
CCBot
Cegbfeieh
Chlooe
Cliqzbot
coccocbot-web
cognitiveseo
Collector
com.plumanalytics
crawler4j
crawler.feedback
CrazyWebCrawler
Crescent
CrunchBot
Custo
DataCha0s
demandbase-bot
Demon
Digincore
DigitalPebble
Dirbuster
DittoSpyder
DomainAppender
DomainSigmaCrawler
eCatch
EirGrabber
EMail Wolf
EroCrawler
evc-batch
Evil
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
facebookscraper
FDM
Fimap
FlashGet
FrontPage
Genieo
Gigablast
Gigabot
G-i-g-a-b-o-t
Go!Zilla
Grabber
GrabNet
Grafula
HaosouSpider
HEADMasterSEO
Heritrix
HTTP::Lite
HybridBot
Id-search
IlseBot
Image Fetch
instabid
Intelliseek
JamesBOT
JetCar
Jetty
JOC Web Spider
Keyword Density
Kozmosbot
Lanshanbot
Lftp
LibWeb
Likse
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaScrapeBot
Lipperhey
Lmspider
lwp-request
LWP::Simple
Magnet
Mag-Net
Majestic12
Majestic SEO
MarkMonitor
Masscan
Mass Downloader
Mata Hari
MauiBot
MFC_Tear_Sample
Microsoft Data Access
Mojeek
MSIECrawler
Msrabot
muhstik-scan
Navroad
netEstate NE Crawler
NetLyzer
NetMechanic
NextGenSearchBot
Niki-bot
Nikto
Nimbostratus
Ninja
Nmap
NPbot
Nutch
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
OpenVAS
OrangeBot
OutfoxBot
PageAnalyzer
PageGrabber
page scorer
Pandalytics
pcBrowser
PeoplePal
Picscout
Picsearch
Pimonster
Pi-Monster
PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP
ProPowerBot
Psbot
Pump
RealDownload
RebelMouse
RedesScrapy
Ripper
s1z.ru
SBIder
SEOkicks
SEOkicks-Robot
SEOprofiler
seoscanners
SeoSiteCheckup
SEOstats
serpstatbot
sexsearcher
Siphon
Sitebeam
SiteExplorer
Siteimprove
SiteSnagger
SiteSucker
Site Sucker
SlySearch
SMTBot
Snapbot
Snoopy
sogouspider
Sosospider
Sottopop
SpaceBison
Spammen
Spanner
sp_auditbot
Spbot
SputnikBot
Sqlworm
Steeler
Sucker
Sucuri
SuperBot
SuperHTTP
sysscan
T0PHackTeam
Telesoft
Telesphoreo
Telesphorep
Toata
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
trendiction.com
trendiction.de
True_Robot
Turnitin
TwengaBot
Upflow
URLy.Warning
Vacuum
Vagabondo
VCI
Virusdie
Voil
Webalta
Web Auto
Web Collage
WEBDAV
WebEnhancer
WebFetch
Web Fetch
WebFuck
Web Fuck
WebGo IS
Web Pix
WebSauger
Web Sauger
Webshag
WebsiteQuester
Webster
WebStripper
WebSucker
WebWhacker
WebZIP
Whatweb
WinHTTrack
WiseGuys Robot
WISENutbot
Wonderbot
Wotbox
Wprecon
WWW::Mechanize
WWWOFFLE
xpymep1.exe
YoudaoBot
Zauba
Zermelo
zgrab
ZumBot