404enemy
Abonti
Aboundexbot
Acunetix
AhrefsBot
AIBOT
Alligator
AllSubmitter
AlphaBot
Asterias
autoemailspider
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
Barkrowler
Battleztar Bazinga
BBBike
BetaBot
Bigfoot
BLEXBot
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
Calculon
CATExplorador
CazoodleBot
CCBot
CheeseBot
Chlooe
Cliqzbot
coccocbot-web
cognitiveseo
Copier
crawler4j
crawler.feedback
CrazyWebCrawler
CSHttp
DataCha0s
DBLBot
demandbase-bot
Demon
Digincore
DigitalPebble
DIIbot
Dirbuster
Disco
Discobot
DnyzBot
DomainAppender
DomainSigmaCrawler
DSearch
Ebingbong
eCatch
evc-batch
Express WebPictures
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
facebookscraper
FHscan
Fimap
Firefox/7.0
Foobot
Fyrebot
Getintent
GetRight
GetWeb
Gigablast
Gigabot
G-i-g-a-b-o-t
Go!Zilla
Grabber
GrabNet
Grafula
GrapeshotCrawler
HaosouSpider
Havij
Heritrix
HMView
HTMLparser
Humanlinks
IDBot
Id-search
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
InterGET
ips-agent
IRLbot
JennyBot
Joomla
JustView
Kenjin Spider
Keyword Density
Lanshanbot
Larbin
LeechFTP
LeechGet
LibWeb
Lightspeedsystems
Likse
LinkpadBot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Lmspider
Magnet
magpie-crawler
Mail.RU_Bot
Majestic12
MarkMonitor
Masscan
meanpathbot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Mister PiX
Morfeus Fucking Scanner
MSIECrawler
MS Web Services Client Protocol
Nessus
NetAnts
NetLyzer
NetMechanic
NetSpider
Nettrack
Net Vampire
NextGenSearchBot
Niki-bot
Nikto
NimbleCrawler
Ninja
NPbot
Octopus
Offline Navigator
OnCrawl
Openfind
OpenLinkProfiler
OrangeSpider
OutclicksBot
PageAnalyzer
Page Analyzer
page scorer
Panscient
pcBrowser
PeoplePal
Pimonster
Pixray
Pockey
POE-Component-Client-HTTP
ProPowerBot
ProWebWalker
Pump
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
RankurBot
Reaper
Recorder
RedesScrapy
RepoMonkey
RSSingBot
SBIder
Scanbot
scan.lol
ScreenerBot
Searchestate
SearchmetricsBot
SEOlyticsCrawler
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
Shodan
SISTRIX
Sitebeam
Site Sucker
SlySearch
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
SpankBot
Steeler
Stripper
Sucker
SuperBot
SuperHTTP
Surfbot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
TeleportPro
Telesphoreo
Telesphorep
TheNomad
TightTwatBot
Titan
Trendictionbot
trendiction.com
trendiction.de
Turingos
Turnitin
TwengaBot
Twice
UnisterBot
URLy.Warning
VCI
VeriCiteCrawler
WallpapersHD
WASALive-Bot
Webalta
Web Auto
Web Fetch
WebLeacher
webmeup-crawler
WebPix
Web Pix
WebReaper
WebsiteQuester
Webster
WebZIP
Whack
Whacker
Who.is Bot
Woobot
WWW-Mechanize
WWWOFFLE
Xaldon_WebSpider
Xenu
xpymep1.exe
ZumBot
ZyBorg