404enemy
Abonti
Aboundexbot
Acunetix
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AlphaBot
Apexoo
archive.org_bot
arquivo.pt
ASPSeek
autoemailspider
AwarioSmartBot
Backlink-Ceck
BackStreet
Badass
Bandit
Barkrowler
BBBike
BetaBot
Bigfoot
BLEXBot
Boardreader
Brandwatch
Buddy
BuiltWith
Bullseye
BuzzSumo
Calculon
CazoodleBot
CCBot
CherryPicker
ChinaClaw
Cliqzbot
Cloud mapping
cognitiveseo
com.plumanalytics
Copier
Cosmos
Craftbot
crawl.sogou.com
Crescent
CSHttp
Curious
DataCha0s
DBLBot
Demon
Deusu
Devil
DigitalPebble
DIIbot
Disco
Discobot
Discoverybot
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Dragonfly
Drip
DSearch
DTS Agent
eCatch
ECCP/1.0
EirGrabber
EMail Wolf
Express WebPictures
Extractor
EyeNetIE
Ezooms
facebookscraper
FemtosearchBot
Fimap
Firefox/7.0
FyberSpider
Fyrebot
GalaxyBot
Genieo
Getintent
Gigabot
GrabNet
Grafula
GT::WWW
Haansoft
HEADMasterSEO
heritrix
Hloader
HTTP::Lite
Humanlinks
HybridBot
IDBot
IlseBot
InfoTekies
instabid
Intelliseek
InterGET
InternetSeer
internetVista monitor
ips-agent
IRLbot
JetCar
JikeSpider
JOC Web Spider
Joomla
Jyxobot
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LexiBot
Lftp
LibWeb
Libwhisker
Lightspeedsystems
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Litemage_walker
Lmspider
Ltx71
lwp-trivial
Mail.RU_Bot
Majestic12
MarkMonitor
Masscan
Mass Downloader
Mata Hari
MauiBot
Meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
MIIxpc
Mister PiX
Mojeek
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
muhstik-scan
Nameprotect
Needle
Nessus
netEstate NE Crawler
NetLyzer
Nettrack
Net Vampire
NetZIP
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Nutch
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeSpider
Page Analyzer
PageGrabber
page scorer
PageScorer
Panscient
pcBrowser
Pimonster
Pi-Monster
Pockey
QueryN Metasearch
Quick-Crawler
RankActive
RankingBot2
RankurBot
RealDownload
Reaper
RebelMouse
RedesScrapy
ReGet
RepoMonkey
RSSingBot
s1z.ru
SalesIntelligent
Scanbot
Scrapy
Searchestate
SemrushBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
Sitebeam
SiteLockSpider
SlySearch
SmartDownload
Snake
Snapbot
SocialRankIOBot
Sogou web spider
Spammen
Spbot
SputnikBot
spyfu
Sqlmap
Sucker
SuperBot
SurveyBot
Szukacz
T0PHackTeam
tAkeOut
TeleportPro
Telesphorep
Thumbor
Toata
Toweyabot
Trendictionbot
Twice
UnisterBot
URLy.Warning
VidibleScraper
Virusdie
WallpapersHD
WASALive-Bot
Webalta
WebAuto
WebCollage
Web Fetch
Web Fuck
WebImageCollector
WebLeacher
webmeup-crawler
Web Pix
WebReaper
WebsiteQuester
Website Quester
Webster
WebZIP
Who.is Bot
WISENutbot
Wonderbot
Wotbox
x09Mozilla
Xenu
zauba.io
zgrab
Zitebot