404checker
404enemy
80legs
Abonti
ADmantX
AIBOT
Aipbot
AllSubmitter
Anarchie
Apexoo
archive.org_bot
ASPSeek
Asterias
autoemailspider
BackDoorBot
Bandit
BDCbot
BetaBot
BlackWidow
BLEXBot
Blow
BlowFish
Bolt
BotALot
Brandprotect
Brandwatch
Buddy
Calculon
CATExplorador
CCBot
CheTeam
Cliqzbot
Cogentbot
cognitiveseo
Collector
com.plumanalytics
Copier
Copyscape
Cosmos
Craftbot
crawler4j
CrunchBot
Curious
demandbase-bot
Demon
Deusu
Devil
DigitalPebble
Disco
Discobot
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
Dotbot
Drip
DTS Agent
Ebingbong
eCatch
ECCP/1.0
EMail Wolf
EroCrawler
ExtractorPro
Extreme Picture Finder
Ezooms
facebookscraper
FDM
FemtosearchBot
FHscan
Fimap
Firefox/7.0
FlashGet
Foobot
Freeuploader
Fyrebot
GalaxyBot
GermCrawler
GetRight
Gigabot
G-i-g-a-b-o-t
GoZilla
GrabNet
GrapeFX
GridBot
Havij
HEADMasterSEO
Heritrix
HMView
HTTP::Lite
HTTrack
Humanlinks
IDBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
Iskanie
IstellaBot
JennyBot
Jetty
JOC Web Spider
Joomla
JustView
Jyxobot
Kozmosbot
LeechFTP
LexiBot
Likse
LinkScan
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
LNSpiderguy
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic SEO
Mata Hari
meanpathbot
Meanpathbot
MeanPath Bot
Mediatoolkitbot
mediawords
Metauri
Microsoft Data Access
MIDown tool
MJ12bot
Morfeus Fucking Scanner
Musobot
Netcraft
NetSpider
Netvibes
NextGenSearchBot
Niki-bot
NPbot
oBot
Octopus
Offline Explorer
Offline Navigator
Openfind
OpenLinkProfiler
OpenVAS
OutclicksBot
OutfoxBot
page scorer
Pavuk
PECL::HTTP
PeoplePal
PHPCrawl
Picscout
ProPowerBot
PxBroker
PyCurl
Quick-Crawler
RankActive
RankActiveLinkBot
RedesScrapy
s1z.ru
SBIder
Scanbot
ScoutJet
Scrapy
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SEOprofiler
seoscanners
SEOstats
sexsearcher
Shodan
Siphon
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
SlySearch
Snapbot
Snoopy
Sociscraper
Sosospider
Spammen
sp_auditbot
Spbot
Stripper
Sucker
SuperHTTP
Surfbot
SurveyBot
Suzuran
Swiftbot
Teleport
TeleportPro
Telesoft
Telesphoreo
Telesphorep
TheNomad
TightTwatBot
Trendiction
Trendictionbot
trendiction.com
trendiction.de
TurnitinBot
Typhoeus
Upflow
URLy Warning
VB Project
VCI
VoidEYE
Voil
Voltron
WASALive-Bot
Web Auto
WebCollage
WebCopier
WEBDAV
WebEnhancer
Web Enhancer
WebFetch
Web Fetch
Web Fuck
WebLeacher
WebmasterWorldForumBot
Web Pix
WebSauger
Web Sauger
WebsiteQuester
Webster
WebStripper
Web Sucker
WebZIP
Whack
Whacker
Widow
WISENutbot
Woobot
Wprecon
WPScan
WWW::Mechanize
x09Mozilla
Xenu
YoudaoBot
Zauba
zauba.io
ZmEu
ZumBot
ZyBorg