404enemy
ALittle Client
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AllSubmitter
Alligator
Anarchie
Anarchy
Anarchy99
Ankit
Asterias
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
BetaBot
Bigfoot
BotALot
Brandwatch
BuiltBotTough
BuzzSumo
CSHttp
Calculon
ChinaClaw
Chlooe
Cocolyzebot
Copier
CopyRightCheck
Cosmos
Crawling at Home Project
Curious
Custo
CyotekWebCopy
DBLBot
DSearch
DatabaseDriverMysqli
Demon
Devil
Disco
Dispatch
Dotbot
Ebingbong
Ecxi
EirGrabber
EroCrawler
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
Ezooms
FHscan
Firefox/7.0
Foobot
Freeuploader
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
Genieo
GetRight
GetWeb
Getintent
Go!Zilla
Go-Ahead-Got-It
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HEADMasterSEO
HTMLparser
HaosouSpider
Havij
Humanlinks
IDBTE4M
IDBot
Id-search
IlseBot
InfoNaviRobot
InfoTekies
Intelliseek
Internet Ninja
InternetSeer
Iskanie
JOC Web Spider
Jbrofuzz
Joomla
Jorgee
JustView
Jyxobot
Keyword Density
Kinza
Kozmosbot
Lanshanbot
Larbin
LeechGet
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkWalker
LinkextractorPro
LinqiaMetadataDownloaderBot
Litemage_walker
MIDown tool
MQQBrowser
MSIECrawler
Magnet
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Meanpathbot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Mojolicious
Msrabot
Name Intelligence
NearSite
Nessus
NetLyzer
Netcraft
Nmap
Not
Nuclei
Nutch
Octopus
OpenVAS
OutclicksBot
PageGrabber
PageScorer
Pandalytics
Papa Foto
Pavuk
Petalbot
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
Pixray
Pockey
ProPowerBot
ProWebWalker
Pu_iN
RSSingBot
RankingBot
Rankivabot
ReGet
Reaper
RebelMouse
Recorder
Ripper
Rogerbot
SBIder
SISTRIX
Scanbot
ScoutJet
Scrapy
ScrepyBot
Searchestate
Seekport
Semrush
SentiBot
SeobilityBot
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Sitevigil
SmartDownload
Snapbot
Snoopy
Sottopop
SpankBot
Spanner
Spinn3r
Sqlmap
Sqlworm
Stripper
Sucuri
SuperBot
Swiftbot
TeleportPro
Telesoft
Telesphorep
TheNomad
Trendiction
Turingos
TurnitinBot
TwengaBot
Typhoeus
URLy.Warning
VidibleScraper
Virusdie
WEBDAV
WPScan
WWW-Collector-E
WWW::Mechanize
Web Auto
Web Enhancer
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebImageCollector
WebWhacker
Webalta
Webshag
WebsiteQuester
Webster
WinHTTrack
Woobot
Wprecon
Xaldon WebSpider
Xenu
Zermelo
arquivo-web-crawler
arquivo.pt
backlink-check
clark-crawler
cognitiveseo
demandbase-bot
facebookscraper
heritrix
lwp-request
mediawords
page scorer
polaris version
s1z.ru
seobility
seocompany.store
siteripz
sp_auditbot
x09Mozilla