360Spider
404checker
404enemy
80legs
Abonti
Aboundex
Aboundexbot
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
Aipbot
Alexibot
Alligator
AlphaBot
Anarchie
Apexoo
archive.org_bot
autoemailspider
Backlink-Ceck
backlink-check
BacklinkCrawler
Bandit
BatchFTP
Battleztar Bazinga
BBBike
BDFetch
Bigfoot
Bitacle
Blackboard
Black Hole
BLEXBot
Blow
Boardreader
Brandprotect
BuiltBotTough
Bullseye
BuzzSumo
Calculon
CATExplorador
CazoodleBot
CCBot
CheeseBot
CheTeam
Cloud mapping
Collector
Copyscape
Crescent
CSHttp
Curious
DatabaseDriverMysqli
DataCha0s
DBLBot
DIIbot
Dirbuster
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainSigmaCrawler
Download Wonder
DTS Agent
Ebingbong
eCatch
EirGrabber
EMail Siphon
evc-batch
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
facebookscraper
FDM
Fimap
GalaxyBot
Getintent
Gigablast
G-i-g-a-b-o-t
Gotit
GoZilla
Grabber
GrapeshotCrawler
GT::WWW
Haansoft
HaosouSpider
Harvest
Heritrix
HTTP::Lite
HTTrack
Humanlinks
HybridBot
Id-search
IndeedBot
instabid
Intelliseek
ips-agent
IRLbot
IstellaBot
JamesBOT
JennyBot
JikeSpider
Jyxobot
Larbin
LeechFTP
LeechGet
Libwhisker
Lightspeedsystems
Linkdexbot
LinkpadBot
LinkScan
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey
Lmspider
LWP::Simple
Mag-Net
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
Mata Hari
meanpathbot
MeanPath Bot
Mediatoolkitbot
MFC_Tear_Sample
Microsoft Data Access
MIDown tool
MIIxpc
Mister PiX
MJ12bot
Mojeek
Mr.4x3
MSFrontPage
MSIECrawler
muhstik-scan
Musobot
Nameprotect
NearSite
Nessus
Netcraft
NetLyzer
Nettrack
Net Vampire
NextGenSearchBot
NICErsPRO
Niki-bot
NimbleCrawler
Ninja
Offline Navigator
OnCrawl
OpenVAS
OrangeBot
OutfoxBot
Page Analyzer
PageGrabber
Panscient
Papa Foto
PHPCrawl
Picsearch
Pimonster
Pi-Monster
plumanalytics
ProWebWalker
Pump
Quick-Crawler
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RealDownload
RedesScrapy
RSSingBot
s1z.ru
SalesIntelligent
SBIder
ScanAlert
Scanbot
ScoutJet
Screaming
ScreenerBot
Searchestate
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SeoSiteCheckup
SEOstats
serpstatbot
sexsearcher
Siphon
Siteimprove
SiteSnagger
Site Sucker
Snapbot
Sociscraper
sogouspider
Sogou web spider
Spammen
SpankBot
Spanner
SputnikBot
spyfu
Sqworm
Steeler
Sucker
Surfbot
SurveyBot
Suzuran
Swiftbot
tAkeOut
Teleport
TeleportPro
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Toata
Toweyabot
trendiction.de
TwengaBot
UnisterBot
Vacuum
Voil
Wallpapers/3.0
WebBandit
WebCopier
WEBDAV
WebFetch
Web Fetch
Web Fuck
WebLeacher
webmeup-crawler
WebReaper
Webshag
Webster
WebSucker
WeSEE
WISENutbot
Wonderbot
Woobot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
x22Mozilla
YoudaoBot
Zauba
zauba.io
zgrab
ZumBot