360Spider
404checker
Abonti
Aboundexbot
Acunetix
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Apexoo
Attach
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BackWeb
Badass
BatchFTP
Battleztar Bazinga
BDCbot
BlackWidow
Blow
Boardreader
BotALot
Brandprotect
Buddy
BuiltWith
CazoodleBot
CCBot
Cegbfeieh
ChinaClaw
coccocbot-web
Collector
Copyscape
Craftbot
crawl.sogou.com
Crescent
CrunchBot
CSHttp
DatabaseDriverMysqli
DBLBot
Demon
Deusu
Digincore
Discobot
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainStatsBot
Dotbot
Dragonfly
Ebingbong
eCatch
EMail Siphon
EroCrawler
evc-batch
ExtLinksBot
ExtractorPro
Ezooms
FDM
Firefox/7.0
FrontPage
FyberSpider
GermCrawler
Gigablast
Go-Ahead-Got-It
Gotit
GoZilla
GrabNet
GT::WWW
HaosouSpider
Harvest
Havij
HEADMasterSEO
Heritrix
HMView
HTMLparser
HTTrack
Humanlinks
HybridBot
Iblog
Id-search
InfoNaviRobot
InfoTekies
instabid
Intelliseek
internetVista monitor
JamesBOT
JetCar
Jetty
JOC Web Spider
JustView
Jyxobot
Lanshanbot
LeechFTP
LexiBot
LinkextractorPro
LinkpadBot
LinkWalker
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
lwp-request
lwp-trivial
Magnet
Mail.RU_Bot
Majestic12
Majestic-SEO
MarkMonitor
Masscan
Meanpathbot
MeanPath Bot
MIIxpc
Mojeek
Mr.4x3
MSFrontPage
Msrabot
Name Intelligence
Nameprotect
NearSite
Needle
Netcraft
netEstate NE Crawler
NetMechanic
NetSpider
Nettrack
Net Vampire
Nibbler
NICErsPRO
Nikto
NimbleCrawler
Nimbostratus
Nmap
Nutch
Offline Navigator
OrangeBot
OutfoxBot
page scorer
PageScorer
Pavuk
PECL::HTTP
PeoplePal
Picscout
Picsearch
PictureFinder
Pi-Monster
PleaseCrawl
plumanalytics
Pockey
Psbot
RankActive
RankingBot
RankingBot2
RealDownload
RebelMouse
RepoMonkey
Ripper
Rogerbot
s1z.ru
Scanbot
ScoutJet
Scrapy
Screaming
SemrushBot
Seomoz
SEOprofiler
seoscanners
SeoSiteCheckup
Siphon
SISTRIX
Sitebeam
SiteExplorer
SiteSucker
Site Sucker
SlySearch
Snake
Snoopy
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
Sottopop
SpaceBison
Spammen
SputnikBot
spyfu
Sqlworm
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
Suzuran
sysscan
T0PHackTeam
T8Abot
TeleportPro
Telesphorep
TheNomad
Titan
Toata
Tracemyfile
Trendictionbot
trendiction.com
Turnitin
TwengaBot
Typhoeus
Upflow
URLy Warning
VeriCiteCrawler
Voil
Voltron
Wallpapers/3.0
WallpapersHD
WASALive-Bot
Webalta
WebBandit
WebCollage
WebCopier
WebEnhancer
Web Enhancer
WebFetch
WebFuck
WebGo IS
WebImageCollector
webmeup-crawler
Web Pix
Web Sauger
Webshag
Webster
WebSucker
Web Sucker
Who.is Bot
WinHTTrack
Woobot
Wotbox
WPScan
WWW-Mechanize
Xaldon WebSpider
Xenu
Zade
zauba.io
ZmEu
ZyBorg