360Spider
404enemy
80legs
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AlphaBot
Ankit
Apexoo
Asterias
Attach
BBBike
BDFetch
BackDoorBot
Badass
Blackboard
BotALot
Brandprotect
Buck
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CazoodleBot
CherryPicker
ChinaClaw
Claritybot
Cloud mapping
Cocolyzebot
Cogentbot
Copier
CopyRightCheck
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
DTS Agent
Devil
Digincore
DigitalPebble
Dirbuster
Discoverybot
Dispatch
DnyzBot
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Download Wonder
Dragonfly
EasyDL
ExtLinksBot
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Flunky
Foobot
FrontPage
G-i-g-a-b-o-t
GetRight
Gigabot
GoZilla
Grafula
HMView
HTMLparser
HTTP::Lite
Harvest
Heritrix
Humanlinks
HybridBot
IDBot
IRLbot
Iblog
Id-search
IndeedBot
InfoNaviRobot
InfoTekies
InterGET
InternetSeer
Iria
IstellaBot
JamesBOT
JetCar
Jorgee
JustView
Jyxobot
Kinza
LNSpiderguy
LWP::Simple
Leap
Libwhisker
Likse
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
MTRobot
Mail.RU_Bot
Majestic12
MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
MicroMessenger
Microsoft Data Access
Mojolicious
Morfeus Fucking Scanner
Mozlila
NPbot
Navroad
NearSite
Nessus
NetMechanic
NetZIP
NextGenSearchBot
Nibbler
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nmap
Nutch
OutclicksBot
PHPCrawl
Page Analyzer
PageGrabber
PageScorer
Panscient
PeoplePal
Pi-Monster
Picsearch
Pixray
PleaseCrawl
Pockey
ProPowerBot
Psbot
Pu_iN
Pump
PxBroker
Quick-Crawler
RankActiveLinkBot
RankingBot2
Rankivabot
RankurBot
Re-re
RedesScrapy
SBIder
SEOkicks
SEOkicks-Robot
SISTRIX
SMTBot
ScanAlert
Scrapy
SearchmetricsBot
SemrushBot
Seomoz
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Siteimprove
SlySearch
Snoopy
Sogou web spider
Sosospider
Sottopop
SpankBot
Sqlworm
Steeler
SurveyBot
Swiftbot
Szukacz
TeleportPro
Telesphoreo
Thumbor
Trendiction
Turnitin
Twice
Upflow
VB Project
VCI
Vacuum
VeriCiteCrawler
VidibleScraper
Voltron
WISENutbot
WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Auto
Web Enhancer
Web Fetch
WebAuto
WebCollage
WebFetch
WebFuck
WebSauger
WebStripper
Webalta
Webster
Whack
Whacker
Wonderbot
Wotbox
Wprecon
Xaldon WebSpider
Xenu
Zauba
ZmEu
ZoominfoBot
arquivo.pt
backlink-check
cah.io.community
coccocbot-web
crawl.sogou.com
facebookscraper
lwp-trivial
mediawords
netEstate NE Crawler
page scorer
probe-image-size
satoristudio.net
scan.lol
seobility
seoscanners
seostar
sitechecker.pro
sysscan
trendiction.com
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
x09Mozilla
zgrab