360Spider
80legs
Aboundexbot
Acunetix
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
AllSubmitter
Anarchie
Asterias
autoemailspider
BackDoorBot
backlink-check
BacklinkCrawler
Barkrowler
BBBike
BDCbot
BDFetch
BetaBot
Bigfoot
BlackWidow
BlowFish
Bolt
Brandprotect
Brandwatch
BunnySlippers
Calculon
CATExplorador
CCBot
Cegbfeieh
CherryPicker
Chlooe
coccocbot-web
Cogentbot
cognitiveseo
CopyRightCheck
Cosmos
Craftbot
crawl.sogou.com
DatabaseDriverMysqli
DataCha0s
DBLBot
Demon
Deusu
Digincore
DIIbot
Dirbuster
Discobot
Discoverybot
DittoSpyder
DnyzBot
Ecxi
EMail Siphon
EMail Wolf
Exabot
Extractor
ExtractorPro
facebookscraper
FemtosearchBot
FlashGet
Foobot
Freeuploader
FyberSpider
GermCrawler
G-i-g-a-b-o-t
Go-Ahead-Got-It
GoZilla
Go!Zilla
Grabber
Grafula
GridBot
GT::WWW
HaosouSpider
Harvest
Havij
Heritrix
Hloader
HTTrack
Humanlinks
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
internetVista monitor
Iskanie
JennyBot
JetCar
Jetty
Joomla
JustView
Keyword Density
Kozmosbot
Lanshanbot
Larbin
LeechFTP
Lightspeedsystems
Likse
LinkpadBot
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
Lmspider
Magnet
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic12
Majestic-SEO
MarkWatch
Masscan
MeanPath Bot
MegaIndex.ru
Metauri
MIDown tool
MIIxpc
Mister PiX
MJ12bot
Mojeek
Morfeus Fucking Scanner
Name Intelligence
Nameprotect
Needle
Nessus
NetAnts
NetLyzer
NetMechanic
NetSpider
Nettrack
Net Vampire
Netvibes
NetZIP
Nibbler
NPbot
Nutch
oBot
Octopus
OnCrawl
Openfind
OpenLinkProfiler
Openvas
OrangeSpider
OutfoxBot
page scorer
PageScorer
Pandalytics
Panscient
Papa Foto
PECL::HTTP
PeoplePal
PictureFinder
Pi-Monster
PleaseCrawl
Pockey
POE-Component-Client-HTTP
Probethenet
ProPowerBot
ProWebWalker
PxBroker
QueryN Metasearch
RankActive
RankingBot
RankingBot2
Reaper
RebelMouse
Ripper
Rogerbot
s1z.ru
SBIder
ScanAlert
scan.lol
ScoutJet
Scrapy
Screaming
ScreenerBot
SemrushBot
Shodan
SISTRIX
Siteimprove
SiteLockSpider
SiteSnagger
SiteSucker
SmartDownload
SocialRankIOBot
Sociscraper
Sogou web spider
Spammen
SpankBot
Spanner
Spbot
Spinn3r
spyfu
Steeler
Stripper
SuperHTTP
Surfbot
SurveyBot
Szukacz
T0PHackTeam
T8Abot
TeleportPro
Telesoft
Telesphoreo
Telesphorep
TheNomad
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
Typhoeus
URLy.Warning
Vacuum
Vagabondo
VB Project
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voil
WallpapersHD
WBSearchBot
Webalta
WebAuto
WebCollage
WebEnhancer
WebFetch
webmeup-crawler
WebSauger
Web Sauger
Web Sucker
WebZIP
WeSEE
Whacker
Who.is Bot
Widow
x09Mozilla
Xenu
YoudaoBot
Zauba
zauba.io
Zeus
zgrab
ZmEu
ZumBot