80legs
AIBOT
ALittle Client
ASPSeek
Aboundex
AfD-Verbotsverfahren
Aipbot
Alexibot
AllSubmitter
Alligator
Anarchy
Anarchy99
Ankit
Apexoo
AwarioRssBot
BDFetch
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Barkrowler
BetaBot
Bitacle
BlackWidow
Blackboard
Blow
BotALot
Brandprotect
Buck
Buddy
BuiltWith
Calculon
CensysInspect
CheTeam
CherryPicker
Citoid
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler
Custo
CyotekWebCopy
DatabaseDriverMysqli
DigitalPebble
Dirbuster
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomainStatsBot
Domains Project
Dotbot
Download Wonder
EMail Siphon
EMail Wolf
EasyDL
ExtLinksBot
Firefox/7.0
FlashGet
Fyrebot
GalaxyBot
Genieo
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrapeFX
HEADMasterSEO
HTMLparser
HTTrack
Haansoft
HaosouSpider
Havij
Heritrix
HybridBot
IDBTE4M
IRLbot
Id-search
IndeedBot
InfoNaviRobot
Intelliseek
InternetSeer
Iria
Iskanie
Jbrofuzz
Joomla
Jyxobot
Kenjin Spider
Kinza
LWP::Simple
LexiBot
LibWeb
Lightspeedsystems
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey
Lmspider
Ltx71
Magnet
Mail.RU_Bot
Majestic SEO
MarkMonitor
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MicroMessenger
Moblie Safari
Mojeek
Mozlila
Mr.4x3
NICErsPRO
Name Intelligence
Nameprotect
Net Vampire
NetAnts
NetLyzer
NetMechanic
NetSpider
Netcraft
Nimbostratus
Ninja
Octopus
Openfind
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
PageAnalyzer
PageThing.com
Pandalytics
Petalbot
Pi-Monster
PictureFinder
Piepmatz
PleaseCrawl
ProPowerBot
Probethenet
Psbot
PxBroker
PyCurl
Quick-Crawler
RankActive
RankFlex
Rankivabot
ReGet
Reaper
Recorder
RepoMonkey
Rogerbot
SEOkicks
SEOlyticsCrawler
SEOstats
ScoutJet
Scrapy
Screaming
Semrush
SeobilityBot
Shodan
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
Snapbot
SpankBot
Spanner
Spbot
Spinn3r
Sqlmap
Sqlworm
Sqworm
Sucker
SuperBot
SurveyBot
Swiftbot
Teleport
TeleportPro
Telesoft
Telesphoreo
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
True_Robot
Turnitin
TwengaBot
Twice
Typhoeus
VB Project
Vacuum
Vagabondo
VeriCiteCrawler
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers
WeSEE
Web Collage
Web Enhancer
Web Sucker
WebLeacher
WebReaper
Webalta
Website Quester
WebsiteExtractor
Whack
Whacker
Widow
WiseGuys Robot
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Zauba
Zeus
ZmEu
arquivo-web-crawler
arquivo.pt
cah.io.community
clark-crawler
coccocbot-web
cognitiveseo
crawler4j
domainsproject.org
evc-batch
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
oBot
pcBrowser
plumanalytics
probe-image-size
ripz
scan.lol
seobility
seocompany.store
sexsearcher
sogouspider
sp_auditbot
trendiction.de
voyagerx.com
webgains-bot
x22Mozilla
zgrab