360Spider
404enemy
Abonti
Aboundex
Aboundexbot
AfD-Verbotsverfahren
Aipbot
Apexoo
archive.org_bot
Attach
Backlink-Ceck
BackStreet
Badass
Bandit
BDCbot
Boardreader
Bolt
Brandprotect
Brandwatch
Buddy
BuiltWith
BunnySlippers
CATExplorador
CCBot
Cegbfeieh
CheeseBot
ChinaClaw
Chlooe
Cliqzbot
com.plumanalytics
Copyscape
crawler4j
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
CrunchBot
CSHttp
DataCha0s
DBLBot
demandbase-bot
Demon
Deusu
Devil
DigitalPebble
Dirbuster
Discobot
Discoverybot
DittoSpyder
DomainAppender
DomainStatsBot
Dotbot
Download Wonder
Ebingbong
ECCP/1.0
EirGrabber
Evil
Exabot
ExtractorPro
EyeNetIE
facebookscraper
FDM
FemtosearchBot
FHscan
Fimap
FyberSpider
GalaxyBot
GermCrawler
GetRight
Gigablast
Go-Ahead-Got-It
Grabber
Grafula
GT::WWW
Haansoft
Harvest
Hloader
HTTP::Lite
Iblog
IlseBot
Image Sucker
Indy Library
InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
ips-agent
Iria
Iskanie
IstellaBot
Jbrofuzz
JennyBot
JetCar
Jetty
JOC Web Spider
Joomla
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
Lightspeedsystems
Linkdexbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Lmspider
lwp-request
Majestic12
Majestic SEO
Majestic-SEO
MarkWatch
Masscan
Mass Downloader
MeanPath Bot
Mediatoolkitbot
mediawords
MegaIndex.ru
Metauri
Microsoft Data Access
MIIxpc
Mister PiX
Mr.4x3
MSFrontPage
MSIECrawler
Msrabot
MS Web Services Client Protocol
Name Intelligence
Nameprotect
NearSite
netEstate NE Crawler
NetMechanic
NetSpider
Net Vampire
Netvibes
NextGenSearchBot
NICErsPRO
Ninja
NPbot
Nutch
Octopus
Offline Navigator
OpenLinkProfiler
OpenVAS
Page Analyzer
page scorer
Pandalytics
pcBrowser
PeoplePal
Picsearch
PictureFinder
plumanalytics
POE-Component-Client-HTTP
Probethenet
PxBroker
QueryN Metasearch
Quick-Crawler
RankingBot2
RealDownload
Recorder
Ripper
Rogerbot
SalesIntelligent
scan.lol
ScoutJet
Scrapy
SearchmetricsBot
Semrush
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
seoscanners
SeoSiteCheckup
SEOstats
serpstatbot
sexsearcher
Shodan
Sitebeam
SiteExplorer
Siteimprove
SiteSucker
Site Sucker
SlySearch
SMTBot
Snake
Sociscraper
sogouspider
Sogou web spider
Sosospider
Sottopop
Spanner
sp_auditbot
Spbot
Spinn3r
Sqlmap
Steeler
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
T8Abot
Teleport
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Toata
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
trendiction.de
True_Robot
Turnitin
TurnitinBot
TwengaBot
Twice
UnisterBot
URLy Warning
Vagabondo
VeriCiteCrawler
VoidEYE
Voil
Wallpapers/3.0
WallpapersHD
Web Auto
WebBandit
WEBDAV
WebFetch
WebFuck
WebGo IS
WebImageCollector
webmeup-crawler
WebPix
Web Sauger
WebSucker
Widow
WISENutbot
Wotbox
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Xaldon WebSpider
Zade
zauba.io
Zeus
ZyBorg