360Spider
80legs
ADmantX
ASPSeek
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
AllSubmitter
Alligator
Anarchie
Anarchy
Ankit
Anthill
AwarioRssBot
BDCbot
BackStreet
BackWeb
Badass
Barkrowler
Battleztar Bazinga
BetaBot
BlackWidow
Blow
BlowFish
Bolt
Brandwatch
Bullseye
Cegbfeieh
CherryPicker
Copyscape
Cosmos
CrunchBot
DSearch
Demon
Devil
Digincore
DigitalPebble
Dirbuster
Discoverybot
Dispatch
DomCopBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Download Wonder
Dragonfly
Drip
EMail Siphon
EasyDL
EirGrabber
EroCrawler
Exabot
Express WebPictures
Extractor
ExtractorPro
EyeNetIE
Fimap
Flunky
Foobot
FrontPage
Fuzz
Fyrebot
GT::WWW
GalaxyBot
Genieo
Getintent
Go-Ahead-Got-It
Gotit
Grabber
Grafula
GrapeFX
GridBot
HEADMasterSEO
HMView
Haansoft
HaosouSpider
Harvest
Havij
Heritrix
Hloader
HybridBot
IDBot
Id-search
Image Fetch
IndeedBot
InfoTekies
Iria
JOC Web Spider
JennyBot
Jetty
Joomla
Kenjin Spider
Kinza
LNSpiderguy
Leap
LeechFTP
LeechGet
LexiBot
LibWeb
LieBaoFast
Lightspeedsystems
Likse
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
MIIxpc
MJ12bot
Mag-Net
Majestic SEO
Majestic12
Mass Downloader
MauiBot
Meanpathbot
MegaIndex.ru
Microsoft URL Control
Mojolicious
MolokaiBot
Msrabot
Nameprotect
Nessus
NetMechanic
NetSpider
NextGenSearchBot
Niki-bot
Nimbostratus
Ninja
Nmap
Not
Nutch
Octopus
OrangeSpider
PECL::HTTP
PageAnalyzer
Pandalytics
PeoplePal
Petalbot
Pi-Monster
Pimonster
PleaseCrawl
Pockey
ProWebWalker
Pump
Quick-Crawler
RankFlex
Rankivabot
ReGet
Recorder
RedesScrapy
RepoMonkey
Rogerbot
SBIder
SMTBot
ScanAlert
Scanbot
ScreenerBot
ScrepyBot
Searchestate
Seekport
SemanticJuice
SemrushBot
SentiBot
SeobilityBot
Seomoz
Shodan
Site Sucker
SiteExplorer
Siteimprove
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sottopop
SpaceBison
Spanner
Spbot
Spinn3r
Stripper
SuperHTTP
Surfbot
SurveyBot
Suzuran
T8Abot
TeleportPro
Thumbor
TightTwatBot
Titan
Turnitin
URLy.Warning
VB Project
VCI
Vacuum
Vagabondo
VoidEYE
Voltron
WASALive-Bot
WWW::Mechanize
Wallpapers/3.0
WeSEE
Web Fetch
Web Pix
Web Sauger
WebEnhancer
WebFuck
WebWhacker
WebZIP
Webshag
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Widow
WinHTTrack
Wotbox
Wprecon
Xenu
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
cognitiveseo
crawl.sogou.com
crawler.feedback
crawler4j
facebookscraper
heritrix
internetVista monitor
lwp-request
oBot
page scorer
pcBrowser
polaris version
s1z.ru
satoristudio.net
scalaj-http
seobility
sexsearcher
sitechecker.pro
siteripz
sysscan
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webprosbot
x22Mozilla