360Spider
404checker
80legs
Aboundexbot
Aipbot
Alligator
archive.org_bot
ASPSeek
Attach
autoemailspider
BackDoorBot
BackWeb
Badass
Bandit
Barkrowler
BatchFTP
BDFetch
Blackboard
Black Hole
BlackWidow
BLEXBot
BlowFish
Bolt
BotALot
Buddy
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
CazoodleBot
CCBot
CherryPicker
Chlooe
Cliqzbot
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
Collector
com.plumanalytics
Cosmos
CrazyWebCrawler
CSHttp
Curious
Custo
DatabaseDriverMysqli
DBLBot
demandbase-bot
Demon
Deusu
DIIbot
Dirbuster
Dispatch
DomainCrawler
DomainStatsBot
Dotbot
Download Wonder
DSearch
EasyDL
Ebingbong
Ecxi
Exabot
Extractor
FDM
FemtosearchBot
Fimap
Flunky
Freeuploader
FyberSpider
Fyrebot
Genieo
GermCrawler
Gigabot
GoZilla
Grabber
Grafula
GT::WWW
Havij
HEADMasterSEO
HTMLparser
HTTP::Lite
HybridBot
IDBot
Id-search
IlseBot
Image Fetch
Image Sucker
Indy Library
instabid
Internet Ninja
JamesBOT
JennyBot
JustView
Keyword Density
Lanshanbot
LeechGet
LibWeb
Libwhisker
Lightspeedsystems
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lmspider
LNSpiderguy
lwp-request
lwp-trivial
Mail.RU_Bot
Majestic12
Majestic SEO
MarkMonitor
MarkWatch
MauiBot
Meanpathbot
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Morfeus Fucking Scanner
Musobot
Name Intelligence
NearSite
Needle
NetAnts
netEstate NE Crawler
NetLyzer
Netvibes
NextGenSearchBot
NICErsPRO
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Ninja
NPbot
oBot
OpenLinkProfiler
Openvas
OpenVAS
OutclicksBot
PageAnalyzer
Panscient
Pavuk
PeoplePal
Picscout
Picsearch
PictureFinder
Pimonster
Pi-Monster
PleaseCrawl
plumanalytics
ProWebWalker
PxBroker
PyCurl
QueryN Metasearch
RankActive
RankingBot
RealDownload
Reaper
RebelMouse
Recorder
ReGet
RepoMonkey
RocketCrawler
SalesIntelligent
Scanbot
scan.lol
ScoutJet
Scrapy
ScreenerBot
Searchestate
SearchmetricsBot
SemrushBot
SEOkicks
SEOlyticsCrawler
SEOstats
sexsearcher
SISTRIX
Siteimprove
SiteLockSpider
SiteSnagger
SlySearch
SocialRankIOBot
sogouspider
Sogou web spider
Spammen
sp_auditbot
Sqlmap
Sqworm
Steeler
Stripper
SuperBot
Swiftbot
sysscan
Szukacz
tAkeOut
Teleport
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Tracemyfile
Trendiction
trendiction.de
Turingos
TurnitinBot
TwengaBot
Typhoeus
UnisterBot
URLy.Warning
Vacuum
Vagabondo
VB Project
VCI
VidibleScraper
Voltron
WASALive-Bot
WBSearchBot
Webalta
WebAuto
Web Auto
Web Collage
WebCopier
WebEnhancer
Web Enhancer
WebFuck
WebImageCollector
WebLeacher
WebmasterWorldForumBot
WebPix
Web Pix
WebReaper
WebSauger
Web Sauger
Webshag
WebsiteExtractor
WebStripper
WebZIP
WeSEE
Whack
Wonderbot
Wotbox
Wprecon
WWW-Collector-E
WWW::Mechanize
Xenu
Zauba
zgrab
ZmEu
ZumBot