360Spider
404checker
Abonti
Aboundex
Aboundexbot
Acunetix
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
AiHitBot
Alexibot
AllSubmitter
Anarchie
archive.org_bot
ASPSeek
autoemailspider
BackDoorBot
BacklinkCrawler
Bandit
Bigfoot
Bitacle
BlackWidow
Boardreader
Bolt
Buddy
BunnySlippers
BuzzSumo
CATExplorador
CherryPicker
CheTeam
ChinaClaw
Chlooe
Cloud mapping
coccocbot-web
com.plumanalytics
Copier
CopyRightCheck
crawler4j
crawl.sogou.com
CrazyWebCrawler
Curious
DBLBot
Devil
Digincore
DigitalPebble
Dirbuster
Discobot
Discoverybot
DomainSigmaCrawler
Drip
DSearch
DTS Agent
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
evc-batch
Evil
ExtLinksBot
Extreme Picture Finder
FHscan
Freeuploader
Fyrebot
GalaxyBot
GermCrawler
Getintent
Gigabot
GoZilla
GrabNet
Grafula
GrapeshotCrawler
GT::WWW
Havij
HEADMasterSEO
Heritrix
HMView
HTMLparser
HTTP::Lite
HTTrack
Humanlinks
Iblog
Id-search
Image Fetch
Image Sucker
IndeedBot
Indy Library
InfoTekies
instabid
Intelliseek
InterGET
Internet Ninja
internetVista monitor
ips-agent
Iskanie
IstellaBot
JennyBot
JetCar
Jetty
JikeSpider
JustView
Jyxobot
Keyword Density
Lanshanbot
LeechGet
Lftp
Likse
Linkdexbot
LinkScan
LinkWalker
Lipperhey Spider
Lmspider
LNSpiderguy
Ltx71
Magnet
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic-SEO
Mass Downloader
Mata Hari
MauiBot
meanpathbot
Mediatoolkitbot
mediawords
MegaIndex.ru
Microsoft Data Access
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
MSIECrawler
muhstik-scan
Nameprotect
Navroad
Nessus
Netcraft
NetMechanic
Nettrack
Netvibes
NetZIP
Niki-bot
Ninja
NPbot
Octopus
OnCrawl
Openvas
OpenVAS
OrangeBot
OrangeSpider
OutfoxBot
PageScorer
Panscient
Papa Foto
Pavuk
PHPCrawl
Picscout
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
ProPowerBot
Pump
Reaper
Recorder
Ripper
RocketCrawler
RSSingBot
SalesIntelligent
scan.lol
ScoutJet
Scrapy
Screaming
Searchestate
SEOkicks
SEOkicks-Robot
Seomoz
seoscanners
serpstatbot
Shodan
SISTRIX
Siteimprove
SiteLockSpider
SiteSnagger
SiteSucker
SlySearch
Sociscraper
Sogou web spider
Sottopop
SpankBot
Spanner
spyfu
Stripper
Sucker
Sucuri
SuperHTTP
Szukacz
tAkeOut
TeleportPro
Telesoft
The Intraformant
Thumbor
Toata
Tracemyfile
Trendiction
trendiction.com
trendiction.de
UnisterBot
Upflow
Vagabondo
VCI
Voil
Webalta
Web Auto
WebCollage
Web Collage
WebCopier
WEBDAV
WebEnhancer
Web Fetch
WebFuck
Web Fuck
WebImageCollector
WebLeacher
WebPix
Web Pix
WebSauger
Web Sauger
WebsiteExtractor
WebsiteQuester
Website Quester
Webster
WebStripper
Web Sucker
WeSEE
Whack
Who.is Bot
WinHTTrack
WiseGuys Robot
WISENutbot
Wonderbot
Wotbox
WPScan
WWW-Collector-E
Xaldon WebSpider
Xaldon_WebSpider
Zauba
zauba.io
zgrab
ZumBot
ZyBorg