360Spider
ALittle Client
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
Alligator
Aspiegel
Asterias
AwarioRssBot
BLEXBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
Black Hole
Blow
BotALot
Bullseye
BunnySlippers
BuzzSumo
CCBot
CSHttp
Calculon
CheeseBot
ChinaClaw
Chlooe
Claritybot
Collector
Copier
Copyscape
Craftbot
Crawling at Home Project
Crescent
Curious
DTS Agent
Deusu
DigitalPebble
Dirbuster
Dispatch
DomainAppender
DomainStatsBot
Domains Project
Dotbot
Drip
ECCP/1.0
EasyDL
Ebingbong
EirGrabber
Evil
Express WebPictures
Extractor
ExtractorPro
FlashGet
Flunky
Foobot
Freeuploader
FyberSpider
G-i-g-a-b-o-t
Genieo
GermCrawler
GetRight
GetWeb
Getintent
GoZilla
Gotit
Grafula
GrapeFX
GrapeshotCrawler
HMView
HTTP::Lite
HaosouSpider
Havij
Heritrix
Hloader
IDBTE4M
IDBot
IRLbot
IlseBot
Image Sucker
IndeedBot
InterGET
Internet Ninja
InternetSeer
Iria
JOC Web Spider
Jbrofuzz
JennyBot
JetCar
Jorgee
Kozmosbot
LWP::Simple
Lanshanbot
Larbin
Leap
LeechGet
LibWeb
Libwhisker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
MIIxpc
MJ12bot
MSIECrawler
MTRobot
Mag-Net
Majestic-SEO
MarkWatch
Mb2345Browser
Metauri
MicroMessenger
Microsoft Data Access
Moblie Safari
Mojeek
Mozlila
Mr.4x3
Musobot
Needle
Nessus
Net Vampire
Nettrack
Niki-bot
Nuclei
Offline Explorer
OnCrawl
Openvas
OrangeBot
OutclicksBot
OutfoxBot
PECL::HTTP
Papa Foto
PeoplePal
Petalbot
Picsearch
Piepmatz
Pixray
Probethenet
Psbot
PyCurl
RSSingBot
RankActive
RankFlex
RankurBot
Re-re
RealDownload
RepoMonkey
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
SalesIntelligent
Scanbot
Scrapy
SemrushBot
SentiBot
Seomoz
Siphon
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Siteimprove
SmartDownload
Snake
Sociscraper
Sogou web spider
Spbot
Spinn3r
Stripper
SuperBot
Szukacz
Teleport
TeleportPro
Telesphoreo
The Intraformant
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendiction
True_Robot
URLy Warning
UnisterBot
VB Project
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WASALive-Bot
WPScan
WWW::Mechanize
Wallpapers
WeSEE
Web Sucker
WebBandit
WebCollage
WebEnhancer
WebFuck
WebGo IS
WebImageCollector
WebPix
WebReaper
WebStripper
WebSucker
WebWhacker
Webalta
Webshag
Website Quester
Whack
Whacker
Widow
WiseGuys Robot
Wotbox
Xaldon WebSpider
YoudaoBot
Zitebot
ZumBot
ZyBorg
arquivo-web-crawler
coccocbot-web
crawl.sogou.com
dataforseo.com
domainsproject.org
eCatch
facebookscraper
heritrix
internetVista monitor
lwp-trivial
mediawords
netEstate NE Crawler
oBot
page scorer
plumanalytics
probe-image-size
satoristudio.net
seoscanners
serpstatbot
sitechecker.pro
tAkeOut
ubermetrics-technologies.com
webpros.com
zauba.io