Aboundex
Aboundexbot
Acunetix
ADmantX
AhrefsBot
AiHitBot
Aipbot
Alligator
AllSubmitter
AlphaBot
Anarchie
Apexoo
ASPSeek
autoemailspider
AwarioSmartBot
BackDoorBot
backlink-check
BackStreet
Badass
Bandit
Barkrowler
BBBike
Bigfoot
Bitacle
Blow
BlowFish
Bolt
Bullseye
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
Claritybot
Cliqzbot
coccocbot-web
cognitiveseo
Collector
com.plumanalytics
Cosmos
Craftbot
crawler4j
crawl.sogou.com
CrunchBot
DataCha0s
DBLBot
Deusu
DigitalPebble
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DomainAppender
DomainSigmaCrawler
Dotbot
Dragonfly
Drip
DTS Agent
Ebingbong
eCatch
EirGrabber
EMail Siphon
ExtLinksBot
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
Firefox/7.0
FlashGet
Flunky
Foobot
FrontPage
FyberSpider
GermCrawler
Getintent
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla
Grabber
GrabNet
GrapeFX
Havij
heritrix
Hloader
IDBot
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
instabid
IRLbot
JennyBot
Jetty
Joomla
Jorgee
Jyxobot
Kenjin Spider
Lanshanbot
LeechGet
Lftp
Likse
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
LNSpiderguy
LWP::Simple
lwp-trivial
Magnet
Mail.RU_Bot
Majestic12
Majestic SEO
MarkMonitor
MarkWatch
Meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
MIDown tool
Mojeek
Morfeus Fucking Scanner
MSFrontPage
MSIECrawler
Msrabot
Musobot
Nessus
NetAnts
Nettrack
Netvibes
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Octopus
Offline Explorer
Openfind
OpenLinkProfiler
Openvas
OpenVAS
OrangeBot
OutfoxBot
PageAnalyzer
Pandalytics
Panscient
Papa Foto
PECL::HTTP
PHPCrawl
Picscout
Picsearch
PictureFinder
Pimonster
POE-Component-Client-HTTP
Probethenet
ProPowerBot
ProWebWalker
Psbot
RankActive
RankActiveLinkBot
RankingBot
Rankivabot
RealDownload
RebelMouse
RedesScrapy
Ripper
Rogerbot
s1z.ru
ScanAlert
ScoutJet
Screaming
Searchestate
SearchmetricsBot
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
seoscanners
serpstatbot
sexsearcher
Sitebeam
Siteimprove
SiteLockSpider
Site Sucker
Sitevigil
SlySearch
Snake
Snapbot
SocialRankIOBot
SpaceBison
Spammen
sp_auditbot
Spbot
SputnikBot
Sqlmap
Sqworm
Stripper
Sucker
Surfbot
SurveyBot
Swiftbot
Teleport
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
Titan
Trendictionbot
trendiction.com
Twice
URLy Warning
URLy.Warning
Vacuum
VB Project
VCI
Virusdie
VoidEYE
Voil
Wallpapers/3.0
WBSearchBot
WebAuto
Web Auto
WebCopier
WebEnhancer
WebFetch
Web Fuck
WebGo IS
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
Web Pix
Webshag
WebsiteQuester
Website Quester
Webster
WebStripper
WebWhacker
WebZIP
Whatweb
WiseGuys Robot
Wonderbot
Wotbox
Wprecon
WWW-Mechanize
x09Mozilla
x22Mozilla
Xaldon_WebSpider
YoudaoBot
Zauba