360Spider
404checker
404enemy
Aboundex
Acunetix
AhrefsBot
AiHitBot
AlphaBot
Anarchy99
Anthill
Apexoo
Asterias
BLEXBot
BackDoorBot
BackStreet
BackWeb
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Bigfoot
BlowFish
Boardreader
Brandprotect
Brandwatch
Buck
Bullseye
BuzzSumo
CATExplorador
CSHttp
Calculon
Cegbfeieh
CheTeam
CherryPicker
ChinaClaw
Chlooe
Citoid
Claritybot
Cogentbot
Copier
CopyRightCheck
CrunchBot
Curious
DSearch
Demon
Deusu
Dirbuster
Disco
Discoverybot
DittoSpyder
Dotbot
Download Wonder
ECCP/1.0
EirGrabber
Evil
Exabot
Extractor
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Freeuploader
GalaxyBot
Genieo
Gotit
Grafula
GrapeFX
HMView
HTMLparser
HTTrack
HaosouSpider
Hloader
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek
Internet Ninja
InternetSeer
Iria
Jetty
JikeSpider
Joomla
Jorgee
Keyword Density
Lftp
LieBaoFast
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
LinqiaRSSBot
MFC_Tear_Sample
MIIxpc
MSFrontPage
MTRobot
Mag-Net
Magnet
Majestic-SEO
MarkWatch
Masscan
MicroMessenger
Microsoft Data Access
Minefield
Mister PiX
Moblie Safari
Morfeus Fucking Scanner
Mozlila
NPbot
Navroad
Needle
Net Vampire
NetAnts
NetLyzer
NetMechanic
NetZIP
Netcraft
NextGenSearchBot
Nibbler
Nikto
Ninja
Octopus
OpenVAS
OrangeSpider
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
Panscient
PictureFinder
Piepmatz
Pixray
Pockey
ProWebWalker
Probethenet
Pu_iN
Quick-Crawler
RSSingBot
RankActive
RankingBot
RankurBot
ReGet
Reaper
RedesScrapy
Ripper
SEOlyticsCrawler
SEOstats
SISTRIX
SalesIntelligent
ScreenerBot
ScrepyBot
Searchestate
Seekport
Semrush
SemrushBot
SeoSiteCheckup
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SmartDownload
Snoopy
SocialRankIOBot
Spammen
SpankBot
Spinn3r
Sqlmap
Sqworm
Steeler
Sucker
SuperBot
Swiftbot
T0PHackTeam
TeleportPro
Telesoft
Telesphorep
Thumbor
Toata
Turingos
TurnitinBot
TwengaBot
Typhoeus
Upflow
V-BOT
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voil
WASALive-Bot
WWW-Collector-E
WWW::Mechanize
Wallpapers
WeSEE
Web Collage
Web Sauger
WebAuto
WebFetch
WebGo IS
WebReaper
WebWhacker
Webshag
Website Quester
WebsiteExtractor
Webster
Widow
Wprecon
Xaldon WebSpider
Xenu
YoudaoBot
Zade
ZoomBot
adscanner
archive.org_bot
backlink-check
check1.exe
coccocbot
crawl.sogou.com
evc-batch
facebookscraper
gopher
lwp-request
magpie-crawler
muhstik-scan
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
polaris version
probe-image-size
s1z.ru
sexsearcher
sitechecker.pro
siteripz
sogouspider
sp_auditbot
sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
x22Mozilla
xpymep1.exe
zgrab