360Spider
404checker
80legs
ALittle Client
Abonti
Acunetix
AhrefsBot
AiHitBot
AlphaBot
Anarchie
Anarchy99
Ankit
Aspiegel
AwarioSmartBot
BBBike
BDCbot
BDFetch
BackWeb
BacklinkCrawler
Bandit
Barkrowler
BatchFTP
Black Hole
BlowFish
Boardreader
BotALot
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CODE87
CSHttp
Calculon
CazoodleBot
CheeseBot
CherryPicker
Cloud mapping
Cocolyzebot
Collector
Cosmos
Craftbot
CrazyWebCrawler
Crescent
Curious
CyotekWebCopy
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Deusu
Disco
DittoSpyder
DomainCrawler
Domains Project
Download Wonder
EMail Siphon
EasyDL
EroCrawler
Express WebPictures
ExtLinksBot
FHscan
FlashGet
Foobot
Fuzz
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GetRight
GetWeb
Getintent
GrabNet
Grabber
Grafula
GrapeshotCrawler
HEADMasterSEO
HTTrack
Heritrix
Hloader
Humanlinks
IDBTE4M
Id-search
Image Fetch
Image Sucker
IndeedBot
InfoTekies
InterGET
Iskanie
JOC Web Spider
JennyBot
JetCar
JikeSpider
JustView
Kenjin Spider
Kinza
Lanshanbot
LeechGet
LexiBot
Lftp
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MarkMonitor
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft Data Access
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
NICErsPRO
Name Intelligence
Nameprotect
NearSite
Nessus
Net Vampire
NetAnts
NetSpider
NextGenSearchBot
NimbleCrawler
Nuclei
Nutch
OpenVAS
Openfind
Openvas
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageGrabber
PageThing.com
Pavuk
Petalbot
Picsearch
Pixray
PleaseCrawl
ProPowerBot
Probethenet
Psbot
Pu_iN
Pump
PxBroker
PyCurl
RSSingBot
RankActiveLinkBot
RankingBot2
ReGet
Reaper
RedesScrapy
RepoMonkey
RocketCrawler
SEOlyticsCrawler
SEOprofiler
Scanbot
Scrapy
SentiBot
SeoSiteCheckup
Seomoz
Site Sucker
SiteSnagger
Sitevigil
SmartDownload
Snapbot
Snoopy
Sociscraper
Spammen
Spanner
Spbot
SputnikBot
Sqlmap
Sqworm
SuperBot
SuperHTTP
Surfbot
Suzuran
Szukacz
T0PHackTeam
Teleport
Telesoft
The Intraformant
TheNomad
Toata
Trendictionbot
Turnitin
TurnitinBot
Twice
UnisterBot
V-BOT
VB Project
Virusdie
VoidEYE
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WallpapersHD
WeSEE
Web Collage
Web Fetch
WebBandit
WebGo IS
WebPix
WebReaper
WebStripper
WebZIP
Whack
Who.is Bot
Widow
WinHTTrack
Wonderbot
Xaldon_WebSpider
Xenu
Zade
Zitebot
ZmEu
archive.org_bot
cognitiveseo
com.plumanalytics
crawl.sogou.com
eCatch
evc-batch
internetVista monitor
isitwp.com
magpie-crawler
mediawords
probe-image-size
ripz
s1z.ru
satoristudio.net
scan.lol
serpstatbot
sexsearcher
sp_auditbot
spyfu
sysscan
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
x09Mozilla
xpymep1.exe