01h4x.com
360Spider
ADmantX
Abonti
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
Aipbot
Alexibot
Anarchie
Anarchy99
Anthill
Asterias
Attach
BDFetch
BLEXBot
BackDoorBot
BackStreet
BackWeb
Bandit
Barkrowler
Black Hole
Blackboard
BlowFish
Boardreader
Bolt
Buddy
CSHttp
CazoodleBot
CheeseBot
CherryPicker
Cloud mapping
Cogentbot
Collector
Copier
DBLBot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Deusu
Discobot
DittoSpyder
DomCopBot
DomainAppender
DomainCrawler
DomainStatsBot
Ebingbong
Ecxi
EirGrabber
Evil
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
FDM
Fimap
Firefox/7.0
FlashGet
Foobot
Fyrebot
GT::WWW
Genieo
GetRight
Getintent
Go-Ahead-Got-It
GrabNet
Grabber
GrapeFX
HMView
HTMLparser
HTTrack
Haansoft
HaosouSpider
Heritrix
HybridBot
IRLbot
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
Internet Ninja
JamesBOT
JennyBot
JikeSpider
Joomla
Jyxobot
LNSpiderguy
LWP::Simple
Leap
LeechFTP
LibWeb
Libwhisker
Likse
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Litemage_walker
MSIECrawler
Magnet
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkMonitor
Mass Downloader
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft URL Control
Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
NICErsPRO
NetAnts
NetMechanic
Netcraft
Nettrack
NextGenSearchBot
Nibbler
NimbleCrawler
Nimbostratus
Nmap
Octopus
Offline Navigator
OnCrawl
Openfind
OrangeBot
OrangeSpider
PHPCrawl
PageGrabber
Petalbot
Pi-Monster
Pimonster
Pixray
PleaseCrawl
PyCurl
Quick-Crawler
RSSingBot
RankingBot2
Rankivabot
RealDownload
RebelMouse
RepoMonkey
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SISTRIX
SalesIntelligent
ScanAlert
Scanbot
Scrapy
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
SentiBot
Seomoz
Site Sucker
SiteSnagger
Sitebeam
Sitevigil
SocialRankIOBot
Sottopop
SpankBot
Spinn3r
Sqlworm
Sqworm
Sucker
Sucuri
SuperHTTP
Suzuran
Swiftbot
Teleport
TeleportPro
Telesoft
Telesphoreo
The Intraformant
TheNomad
Thumbor
TightTwatBot
Toata
Trendictionbot
True_Robot
Turnitin
TurnitinBot
TwengaBot
URLy.Warning
UnisterBot
V-BOT
WASALive-Bot
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
WeSEE
Web Auto
WebAuto
WebFetch
WebImageCollector
WebPix
WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
Webalta
WiseGuys Robot
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zeus
ZoomBot
arquivo-web-crawler
backlink-check
check1.exe
com.plumanalytics
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
heritrix
internetVista monitor
isitwp.com
lwp-trivial
magpie-crawler
meanpathbot
plumanalytics
polaris version
probe-image-size
scan.lol
seobility
seoscanners
seostar
siteripz
spyfu
ubermetrics-technologies.com
voyagerx.com
webpros.com
webprosbot
x22Mozilla
zauba.io