404checker
Abonti
Aboundexbot
Acunetix
Aipbot
Alligator
AlphaBot
Ankit
Apexoo
arquivo-web-crawler
ASPSeek
Attach
AwarioSmartBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BatchFTP
BDCbot
BDFetch
Bigfoot
Bitacle
Black Hole
BlackWidow
BLEXBot
Boardreader
Brandprotect
Brandwatch
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
Calculon
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Cogentbot
cognitiveseo
Copier
CopyRightCheck
Craftbot
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
CrunchBot
CSHttp
Custo
DBLBot
Demon
Devil
DigitalPebble
Discobot
Discoverybot
DittoSpyder
DomainAppender
Domains Project
Download Wonder
DSearch
DTS Agent
ECCP/1.0
Ecxi
EirGrabber
EMail Wolf
Firefox/7.0
FlashGet
Flunky
Genieo
GermCrawler
GetRight
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GoZilla
Grafula
GT::WWW
Haansoft
Harvest
Havij
Heritrix
HTMLparser
HTTrack
Humanlinks
HybridBot
Image Sucker
IndeedBot
InfoTekies
internetVista monitor
IRLbot
Iskanie
IstellaBot
Jbrofuzz
JennyBot
JetCar
Jorgee
LeechGet
LexiBot
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
Linkdexbot
LinkextractorPro
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
LNSpiderguy
Ltx71
LWP::Simple
magpie-crawler
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkWatch
Mass Downloader
Mata Hari
MegaIndex.ru
Metauri
MicroMessenger
MIIxpc
MJ12bot
MQQBrowser
Mr.4x3
MSFrontPage
Musobot
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
NetSpider
Nettrack
NetZIP
Nibbler
NimbleCrawler
Ninja
oBot
Octopus
OnCrawl
OpenVAS
OrangeBot
PageAnalyzer
PageGrabber
PageScorer
Panscient
Pavuk
Picscout
Pimonster
Pixray
plumanalytics
Pockey
polaris version
Probethenet
ProPowerBot
PxBroker
Quick-Crawler
RankActive
RankingBot2
RankurBot
RebelMouse
Recorder
ReGet
RepoMonkey
Ripper
RocketCrawler
s1z.ru
SalesIntelligent
scan.lol
ScoutJet
Scrapy
Screaming
SEOkicks-Robot
SEOlyticsCrawler
seoscanners
Siphon
Sitebeam
SiteExplorer
SiteSnagger
Sitevigil
SlySearch
SMTBot
SocialRankIOBot
sogouspider
Sosospider
SpankBot
sp_auditbot
Spbot
Spinn3r
SputnikBot
spyfu
Sqlworm
Sqworm
Steeler
Sucuri
Swiftbot
sysscan
Szukacz
T0PHackTeam
T8Abot
TeleportPro
Telesphoreo
TheNomad
Thumbor
TightTwatBot
Tracemyfile
trendiction.com
True_Robot
TurnitinBot
Typhoeus
Vacuum
Vagabondo
VoidEYE
WallpapersHD
WBSearchBot
WebAuto
Web Auto
WebBandit
WebCollage
WebCopier
WEBDAV
WebFuck
WebGo IS
WebLeacher
WebmasterWorldForumBot
WebPix
WebReaper
Webshag
WebsiteExtractor
Webster
WebSucker
Web Sucker
WebWhacker
Whacker
WiseGuys Robot
Wotbox
Wprecon
WPScan
WWW-Collector-E
WWWOFFLE
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
YoudaoBot
zauba.io
Zermelo
zgrab
ZmEu
ZumBot