404checker
80legs
ADmantX
AIBOT
ASPSeek
Aboundexbot
AhrefsBot
Alexibot
AllSubmitter
AlphaBot
Anarchy
Anarchy99
Apexoo
Asterias
Atomseobot
AwarioRssBot
BDFetch
BackStreet
BackWeb
Bandit
BetaBot
Bigfoot
BlackWidow
BlowFish
Boardreader
BotALot
Brandprotect
Brandwatch
Buck
Buddy
BuiltBotTough
Bullseye
BuzzSumo
CCBot
Calculon
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Collector
CopyRightCheck
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
CyotekWebCopy
DIIbot
DataCha0s
DatabaseDriverMysqli
Devil
DigitalPebble
Discobot
Discoverybot
Dotbot
Drip
ECCP/1.0
EasyDL
EirGrabber
Express WebPictures
ExtLinksBot
Extreme Picture Finder
Ezooms
FDM
Fimap
Firefox/7.0
FlashGet
Flunky
FrontPage
Fuzz
Fyrebot
GalaxyBot
GermCrawler
GetRight
Getintent
Gigabot
GoZilla
GrabNet
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
HTTP::Lite
HTTrack
Humanlinks
IlseBot
Indy Library
InternetSeer
Iskanie
JOC Web Spider
JamesBOT
JikeSpider
Joomla
JustView
LNSpiderguy
Lanshanbot
LexiBot
Lightspeedsystems
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
MIDown tool
MQQBrowser
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Mb2345Browser
Mediatoolkitbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
NPbot
Name Intelligence
Nameprotect
Navroad
Nessus
NetAnts
NetZIP
Netvibes
Nikto
Not
Nutch
Octopus
Offline Explorer
OpenVAS
Openfind
Page Analyzer
PageThing.com
PeoplePal
PictureFinder
Piepmatz
Pimonster
Pixray
PyCurl
QueryN Metasearch
RankActive
RealDownload
RebelMouse
RedesScrapy
Ripper
Rogerbot
SEOkicks
SEOkicks-Robot
Scanbot
ScoutJet
ScreenerBot
ScrepyBot
SearchmetricsBot
SemanticJuice
Semrush
SeobilityBot
Seomoz
Siphon
SiteLockSpider
SiteSucker
Siteimprove
SlySearch
SmartDownload
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
SputnikBot
Sqworm
Sucuri
SuperHTTP
Surfbot
Swiftbot
TeleportPro
Telesphoreo
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Titan
Turingos
Turnitin
TwengaBot
Twice
URLy.Warning
UnisterBot
Upflow
V-BOT
VB Project
VelenPublicWebCrawler
Virusdie
VoidEYE
WASALive-Bot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
WallpapersHD
WeSEE
Web Auto
Web Enhancer
Web Fuck
WebAuto
WebBandit
WebImageCollector
WebPix
WebReaper
WebStripper
WebSucker
WebmasterWorldForumBot
WebsiteExtractor
Whack
Whatweb
Woobot
YoudaoBot
Zade
Zauba
Zeus
ZmEu
ZyBorg
arquivo-web-crawler
cah.io.community
check1.exe
clark-crawler
demandbase-bot
domainsproject.org
instabid
iubenda-radar
lwp-request
netEstate NE Crawler
pcBrowser
s1z.ru
seoscanners
sexsearcher
sogouspider
spyfu
sysscan
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
webprosbot
x22Mozilla