360Spider
ADmantX
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Anarchie
Anthill
Aspiegel
Attach
BDCbot
BDFetch
Badass
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Black Hole
Blackboard
Brandprotect
BuiltWith
BunnySlippers
CATExplorador
CCBot
CheTeam
CheeseBot
Claritybot
Cliqzbot
Cocolyzebot
CrazyWebCrawler
Crescent
CrunchBot
CyotekWebCopy
DBLBot
DIIbot
DTS Agent
DatabaseDriverMysqli
DigitalPebble
DnBCrawler-Analytics
Domains Project
Dotbot
Dragonfly
EMail Wolf
EasyDL
Ecxi
EirGrabber
EroCrawler
Extreme Picture Finder
Ezooms
FHscan
Firefox/7.0
FlashGet
Flunky
Foobot
Freeuploader
FrontPage
G-i-g-a-b-o-t
GetWeb
Getintent
Go-Ahead-Got-It
Gotit
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HMView
Haansoft
Heritrix
Humanlinks
IDBot
Iblog
IlseBot
Image Sucker
InfoNaviRobot
InfoTekies
Internet Ninja
InternetSeer
Iria
JOC Web Spider
JennyBot
JikeSpider
Joomla
JustView
Kenjin Spider
Keybot Translation-Search-Machine
Leap
LeechGet
Libwhisker
Likse
LinkScan
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MSIECrawler
MTRobot
Mag-Net
Mail.RU_Bot
Majestic12
MarkWatch
Masscan
MauiBot
Mb2345Browser
MegaIndex.ru
MicroMessenger
Mister PiX
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Musobot
NPbot
Nessus
Net Vampire
NetAnts
NetLyzer
Netcraft
Netvibes
Nikto
Nmap
Openvas
OrangeBot
OutfoxBot
PageGrabber
Panscient
Papa Foto
Picscout
Picsearch
PictureFinder
Pixray
ProPowerBot
ProWebWalker
Psbot
Pump
PyCurl
Quick-Crawler
RSSingBot
RankFlex
RankingBot2
Re-re
ReGet
RebelMouse
RepoMonkey
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SISTRIX
SMTBot
ScanAlert
Scanbot
ScreenerBot
SearchmetricsBot
Semrush
SeoSiteCheckup
Site Sucker
SiteExplorer
SiteLockSpider
SiteSucker
Sitebeam
Siteimprove
SlySearch
Sociscraper
Sogou web spider
Sottopop
SpankBot
Spbot
Spinn3r
Sucker
SuperHTTP
Szukacz
Telesoft
Telesphoreo
The Intraformant
TheNomad
TightTwatBot
Toata
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
URLy.Warning
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Voltron
WBSearchBot
WEBDAV
WWW-Collector-E
Web Auto
Web Collage
Web Enhancer
Web Fetch
Web Pix
WebBandit
WebCollage
WebEnhancer
WebFuck
WebPix
WebSauger
WebWhacker
WebmasterWorldForumBot
Webshag
Website Quester
Whacker
Widow
WinHTTrack
Woobot
Xaldon WebSpider
YoudaoBot
Zauba
Zermelo
Zitebot
ZoominfoBot
adscanner
archive.org_bot
arquivo-web-crawler
autoemailspider
crawler4j
dataforseo.com
evc-batch
internetVista monitor
ips-agent
isitwp.com
linkdexbot
magpie-crawler
meanpathbot
netEstate NE Crawler
plumanalytics
ripz
seocompany.store
seoscanners
seostar
serpstatbot
sitechecker.pro
spyfu
tAkeOut
voyagerx.com
webpros.com
x22Mozilla