360Spider
404checker
ADmantX
AhrefsBot
Aipbot
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Anthill
Aspiegel
Asterias
Atomseobot
AwarioSmartBot
BBBike
BDFetch
BackDoorBot
BackStreet
Backlink-Ceck
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Blow
Bolt
Brandprotect
Buck
BuiltBotTough
Bullseye
BunnySlippers
CCBot
CheeseBot
CherryPicker
Chlooe
Claritybot
Cliqzbot
Cogentbot
Collector
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
CrunchBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
DigitalPebble
Discobot
DittoSpyder
DnyzBot
DomainStatsBot
Domains Project
Dragonfly
Ecxi
EirGrabber
Express WebPictures
ExtLinksBot
ExtractorPro
FDM
FHscan
FlashGet
Flunky
Foobot
Freeuploader
GT::WWW
Genieo
GermCrawler
Getintent
Go-Ahead-Got-It
GoZilla
GrabNet
Grabber
GrapeFX
GridBot
HMView
HaosouSpider
HybridBot
IDBot
Id-search
IlseBot
Image Fetch
InfoTekies
Iria
Iskanie
IstellaBot
Joomla
Jyxobot
Keybot Translation-Search-Machine
Kinza
Kozmosbot
Larbin
LeechGet
Libwhisker
LieBaoFast
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
MarkWatch
Mass Downloader
Mata Hari
MauiBot
Metauri
MicroMessenger
Microsoft URL Control
MolokaiBot
Morfeus Fucking Scanner
NICErsPRO
Navroad
NearSite
Needle
Netvibes
NextGenSearchBot
Nikto
Nimbostratus
Ninja
Nmap
Not
Offline Explorer
Offline Navigator
PECL::HTTP
POE-Component-Client-HTTP
PictureFinder
Pixray
PleaseCrawl
Pockey
ProPowerBot
Pu_iN
Quick-Crawler
RSSingBot
RankActive
RankurBot
ReGet
RealDownload
Reaper
RebelMouse
Recorder
SEOkicks
SEOkicks-Robot
SEOprofiler
SISTRIX
ScoutJet
Searchestate
Semrush
SemrushBot
Shodan
Siphon
Site Sucker
SiteSnagger
Sitebeam
SlySearch
Snake
Snapbot
Snoopy
Sosospider
Sottopop
SpaceBison
SputnikBot
Sucuri
SuperBot
Suzuran
Swiftbot
T0PHackTeam
Teleport
Telesphoreo
Telesphorep
TheNomad
Thumbor
Toweyabot
Tracemyfile
Turingos
Turnitin
URLy Warning
UnisterBot
Upflow
V-BOT
VB Project
VCI
Vagabondo
VoidEYE
Voil
Voltron
WASALive-Bot
WWW-Collector-E
WWW-Mechanize
Wallpapers/3.0
Web Fuck
Web Pix
WebCollage
WebCopier
WebFuck
WebPix
WebSauger
WebStripper
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteQuester
Whack
Whacker
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Xenu
Zermelo
Zeus
ZoominfoBot
arquivo-web-crawler
autoemailspider
com.plumanalytics
crawl.sogou.com
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
evc-batch
heritrix
internetVista monitor
ips-agent
linkdexbot
lwp-request
meanpathbot
mediawords
netEstate NE Crawler
page scorer
scalaj-http
scan.lol
seobility
seoscanners
sexsearcher
sitechecker.pro
sogouspider
sysscan
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
webpros.com
x09Mozilla
zgrab