404enemy
80legs
ADmantX
AIBOT
ASPSeek
Abonti
Aboundexbot
AfD-Verbotsverfahren
AiHitBot
AllSubmitter
AlphaBot
Anthill
BBBike
BLEXBot
BackDoorBot
BackStreet
BackWeb
Barkrowler
Battleztar Bazinga
Black Hole
BlowFish
Boardreader
Bolt
Brandprotect
BuzzSumo
CATExplorador
CCBot
Calculon
Claritybot
Collector
CrazyWebCrawler
Crescent
Custo
CyotekWebCopy
DIIbot
DSearch
DigitalPebble
Dirbuster
Disco
Discoverybot
DnyzBot
DomainAppender
DomainCrawler
Domains Project
Dotbot
ECCP/1.0
EMail Siphon
EirGrabber
EroCrawler
Evil
Exabot
ExtractorPro
EyeNetIE
FHscan
Foobot
Freeuploader
FrontPage
Fuzz
FyberSpider
GrabNet
GridBot
HMView
HTTP::Lite
Haansoft
HaosouSpider
Havij
Humanlinks
IDBTE4M
IlseBot
Image Sucker
IndeedBot
Indy Library
Joomla
JustView
Keyword Density
LWP::Simple
Lanshanbot
LeechFTP
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
LinksManager
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MQQBrowser
Mag-Net
Mail.RU_Bot
Majestic-SEO
Majestic12
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Mister PiX
Moblie Safari
Mojeek
Mozlila
Mr.4x3
Navroad
Needle
Nessus
NetLyzer
NetSpider
NetZIP
Netcraft
Nettrack
Netvibes
Nibbler
Niki-bot
NimbleCrawler
Nmap
Nuclei
Octopus
OnCrawl
OpenLinkProfiler
Openfind
OrangeBot
OutclicksBot
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Panscient
PeoplePal
Picsearch
Pimonster
Pockey
Probethenet
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
RankurBot
ReGet
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SISTRIX
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
Screaming
ScreenerBot
Searchestate
SemrushBot
SeoSiteCheckup
SeobilityBot
Shodan
Siphon
SiteCheckerBotCrawler
SiteLockSpider
SiteSucker
Sitevigil
SmartDownload
Snapbot
Snoopy
Sociscraper
SpaceBison
Spammen
Spanner
Spinn3r
Sqlworm
Sqworm
Steeler
Stripper
SuperBot
Suzuran
T0PHackTeam
Teleport
TeleportPro
Tracemyfile
Twice
URLy Warning
URLy.Warning
UnisterBot
VCI
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voltron
WASALive-Bot
WBSearchBot
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Auto
Web Enhancer
Web Fetch
Web Pix
Web Sauger
Web Sucker
WebBandit
WebEnhancer
WebFuck
WebGo IS
WebLeacher
WebReaper
WebSauger
WebZIP
WebmasterWorldForumBot
WebsiteExtractor
Widow
WinHTTrack
Wonderbot
Wprecon
Xaldon WebSpider
YoudaoBot
Zade
Zauba
Zitebot
ZmEu
ZoomBot
ZumBot
arquivo-web-crawler
backlink-check
com.plumanalytics
demandbase-bot
domainsproject.org
facebookscraper
gopher
heritrix
instabid
internetVista monitor
ips-agent
lwp-request
magpie-crawler
oBot
page scorer
plumanalytics
probe-image-size
scan.lol
seobility
seostar
sogouspider
tAkeOut
webmeup-crawler
x09Mozilla
x22Mozilla