360Spider
404checker
Abonti
Aboundexbot
ADmantX
AfD-Verbotsverfahren
AhrefsBot
Alexibot
Alligator
AlphaBot
Anarchie
Apexoo
ASPSeek
Attach
autoemailspider
backlink-check
BackStreet
Bandit
Barkrowler
BatchFTP
BBBike
BDCbot
BDFetch
Bigfoot
Bitacle
Blackboard
Black Hole
BlowFish
Brandprotect
BuiltBotTough
BuiltWith
BunnySlippers
Calculon
CATExplorador
CCBot
CheTeam
ChinaClaw
Cliqzbot
cognitiveseo
com.plumanalytics
CopyRightCheck
Craftbot
crawler4j
crawl.sogou.com
DataCha0s
Demon
Deusu
Devil
Digincore
DigitalPebble
Discobot
Discoverybot
Dispatch
DomainCrawler
DomainSigmaCrawler
Drip
DSearch
Ebingbong
ECCP/1.0
Ecxi
EroCrawler
evc-batch
Exabot
Express WebPictures
ExtLinksBot
Extreme Picture Finder
EyeNetIE
Fimap
Firefox/7.0
Flunky
FrontPage
GalaxyBot
GermCrawler
GetRight
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
GrapeshotCrawler
GT::WWW
Haansoft
Heritrix
HMView
HTMLparser
HTTP::Lite
HybridBot
Iblog
IDBot
Image Sucker
IndeedBot
InfoTekies
InterGET
Internet Ninja
IRLbot
Iskanie
IstellaBot
JamesBOT
JennyBot
JOC Web Spider
JustView
Kozmosbot
LeechGet
Lftp
LinkextractorPro
LinkpadBot
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
Ltx71
lwp-request
lwp-trivial
Magnet
Mag-Net
magpie-crawler
Majestic12
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
Mata Hari
meanpathbot
Meanpathbot
MeanPath Bot
Mediatoolkitbot
MFC_Tear_Sample
Microsoft URL Control
Mister PiX
MJ12bot
Mojeek
Msrabot
MS Web Services Client Protocol
Musobot
Name Intelligence
Navroad
NearSite
Needle
NetAnts
Netcraft
NetSpider
Nettrack
Net Vampire
Niki-bot
NimbleCrawler
Nimbostratus
Offline Explorer
Openvas
OrangeBot
OrangeSpider
OutfoxBot
Page Analyzer
PageGrabber
PageScorer
Panscient
Papa Foto
PeoplePal
PictureFinder
Pimonster
Pi-Monster
PleaseCrawl
Pockey
POE-Component-Client-HTTP
ProPowerBot
ProWebWalker
PyCurl
RankingBot
RealDownload
RebelMouse
ReGet
RocketCrawler
Rogerbot
ScanAlert
scan.lol
Scrapy
SearchmetricsBot
SemrushBot
SEOkicks
Seomoz
seoscanners
SeoSiteCheckup
serpstatbot
Siphon
Sitebeam
SiteSucker
Sitevigil
SlySearch
SocialRankIOBot
Sociscraper
sogouspider
Sottopop
SpankBot
spyfu
Stripper
Sucker
SuperHTTP
Surfbot
T0PHackTeam
T8Abot
tAkeOut
TeleportPro
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
Titan
Tracemyfile
Trendiction
Trendictionbot
trendiction.com
TwengaBot
Upflow
URLy.Warning
Vacuum
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Wallpapers/3.0
WallpapersHD
WBSearchBot
WebAuto
Web Auto
WebBandit
WebCollage
Web Fetch
Web Fuck
WebGo IS
WebImageCollector
Web Pix
WebReaper
WebSauger
Web Sauger
Webshag
Website Quester
WeSEE
Whack
Whatweb
Who.is Bot
WiseGuys Robot
WPScan
WWW-Mechanize
WWWOFFLE
Zauba
zauba.io
Zermelo
Zeus
zgrab
Zitebot
ZmEu
ZyBorg