404checker
80legs
AIBOT
Aboundexbot
Acunetix
AhrefsBot
AlphaBot
Anarchie
BDFetch
BackDoorBot
BackStreet
BatchFTP
Bigfoot
Bitacle
Black Hole
Blackboard
Blow
Boardreader
BotALot
CATExplorador
CSHttp
CazoodleBot
Cegbfeieh
CherryPicker
Chlooe
Cliqzbot
Cogentbot
Copyscape
Craftbot
Crawling at Home Project
DSearch
DTS Agent
DataCha0s
DigitalPebble
Disco
Discobot
DnBCrawler-Analytics
DnyzBot
DomainStatsBot
Domains Project
Dotbot
ECCP/1.0
Ebingbong
EroCrawler
Evil
ExtLinksBot
Extractor
Ezooms
FemtosearchBot
Fimap
FlashGet
Foobot
Freeuploader
FrontPage
FyberSpider
GT::WWW
GalaxyBot
GetRight
Getintent
Gigabot
Go-Ahead-Got-It
GrabNet
Grafula
GrapeFX
HTMLparser
Haansoft
Humanlinks
Iblog
Id-search
IndeedBot
Indy Library
Intelliseek
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
JustView
Jyxobot
Kinza
Lanshanbot
Larbin
LeechFTP
LibWeb
Likse
LinkScan
LinkWalker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MJ12bot
MQQBrowser
MTRobot
Magnet
Majestic SEO
Mass Downloader
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MicroMessenger
Microsoft URL Control
Mister PiX
Mojolicious
NPbot
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
Nessus
NetZIP
NextGenSearchBot
Nikto
NimbleCrawler
Ninja
Nmap
Offline Explorer
Offline Navigator
OpenVAS
Openvas
OrangeBot
OutfoxBot
POE-Component-Client-HTTP
PageAnalyzer
Papa Foto
PeoplePal
Petalbot
Picscout
Pimonster
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
PyCurl
QueryN Metasearch
RankingBot
ReGet
RealDownload
Reaper
Recorder
RocketCrawler
SEOkicks
SEOkicks-Robot
SISTRIX
Scanbot
ScoutJet
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
Semrush
Siphon
SiteSucker
Sitebeam
Siteimprove
SlySearch
Sociscraper
Sogou web spider
Spanner
Spbot
Sqworm
Stripper
Sucker
SuperBot
Surfbot
SurveyBot
Swiftbot
Telesphorep
Toweyabot
Trendictionbot
True_Robot
Turingos
Typhoeus
URLy Warning
UnisterBot
V-BOT
VB Project
VCI
Voltron
WASALive-Bot
WEBDAV
WPScan
WWW-Collector-E
WWWOFFLE
Web Enhancer
Web Fetch
Web Sucker
WebAuto
WebCollage
WebFetch
WebImageCollector
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot
WebsiteExtractor
Webster
Whack
Whacker
Who.is Bot
WiseGuys Robot
Wonderbot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zermelo
Zeus
Zitebot
ZmEu
ZyBorg
arquivo-web-crawler
backlink-check
coccocbot-web
cognitiveseo
crawl.sogou.com
demandbase-bot
eCatch
facebookscraper
heritrix
internetVista monitor
lwp-request
muhstik-scan
oBot
page scorer
plumanalytics
polaris version
scan.lol
seoscanners
sogouspider
spyfu
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
webpros.com
x09Mozilla