404checker
404enemy
Aboundex
Aboundexbot
AhrefsBot
AIBOT
Alligator
AllSubmitter
AlphaBot
ASPSeek
autoemailspider
BackDoorBot
backlink-check
BackStreet
BackWeb
Badass
Barkrowler
Battleztar Bazinga
BDFetch
Black Hole
Bolt
Brandprotect
Brandwatch
Bullseye
Calculon
CazoodleBot
ChinaClaw
Cogentbot
cognitiveseo
com.plumanalytics
Copyscape
Craftbot
crawler4j
crawl.sogou.com
CrazyWebCrawler
CrunchBot
CSHttp
DBLBot
demandbase-bot
DIIbot
Disco
Discoverybot
Dispatch
DittoSpyder
DomainAppender
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
Drip
DSearch
EasyDL
EroCrawler
Evil
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FHscan
Firefox/7.0
FlashGet
Flunky
Freeuploader
FrontPage
GalaxyBot
GetWeb
Gigabot
G-i-g-a-b-o-t
Gotit
GrabNet
Grafula
GrapeshotCrawler
GridBot
Haansoft
HaosouSpider
HEADMasterSEO
Hloader
HTTP::Lite
Iblog
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
instabid
InternetSeer
internetVista monitor
Iria
Iskanie
JetCar
JOC Web Spider
Joomla
JustView
Kenjin Spider
Keyword Density
LeechFTP
LeechGet
LexiBot
Likse
LinkextractorPro
LinkpadBot
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Magnet
Mail.RU_Bot
Majestic-SEO
Masscan
Mass Downloader
MeanPath Bot
mediawords
MegaIndex.ru
Metauri
MIDown tool
MIIxpc
Mr.4x3
MSIECrawler
Msrabot
Musobot
NearSite
NetAnts
netEstate NE Crawler
Net Vampire
NetZIP
Nibbler
NICErsPRO
Niki-bot
Nikto
NPbot
oBot
Offline Explorer
Offline Navigator
OrangeBot
PageAnalyzer
Page Analyzer
PageGrabber
page scorer
PageScorer
Papa Foto
pcBrowser
PECL::HTTP
PeoplePal
PHPCrawl
Picsearch
Pi-Monster
Pixray
plumanalytics
Probethenet
ProWebWalker
PyCurl
RankActiveLinkBot
RankingBot2
Rankivabot
RealDownload
Reaper
RebelMouse
Recorder
RepoMonkey
RocketCrawler
SalesIntelligent
SBIder
ScanAlert
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
serpstatbot
Shodan
Siphon
Sitebeam
SiteExplorer
SiteSnagger
Site Sucker
SmartDownload
Snake
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
Sosospider
Sqlworm
Sqworm
Sucuri
SuperHTTP
T0PHackTeam
T8Abot
tAkeOut
Teleport
The Intraformant
Thumbor
TightTwatBot
Toata
Toweyabot
Tracemyfile
Trendiction
trendiction.com
TwengaBot
Twice
UnisterBot
Upflow
URLy Warning
Vacuum
VidibleScraper
VoidEYE
Voltron
WallpapersHD
Webalta
WebCollage
Web Collage
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
WebFuck
WebImageCollector
Web Pix
WebSauger
Webshag
WebsiteExtractor
WebsiteQuester
Website Quester
Webster
Web Sucker
Whatweb
Widow
WiseGuys Robot
Wonderbot
Woobot
Wotbox
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
x09Mozilla
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
YoudaoBot
Zade
Zeus
Zitebot
ZyBorg