404checker
404enemy
ADmantX
AfD-Verbotsverfahren
AIBOT
Aipbot
archive.org_bot
ASPSeek
Asterias
Attach
Badass
Bandit
BatchFTP
BBBike
Bigfoot
Black Hole
BlowFish
Boardreader
Brandwatch
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
Cegbfeieh
CheeseBot
CherryPicker
CheTeam
Chlooe
coccocbot-web
Cogentbot
Collector
com.plumanalytics
Copyscape
Craftbot
crawler.feedback
crawl.sogou.com
CrunchBot
CSHttp
DatabaseDriverMysqli
DBLBot
Deusu
Devil
Dirbuster
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainCrawler
DomainStatsBot
Download Wonder
Dragonfly
DSearch
Ebingbong
ECCP/1.0
EMail Wolf
EroCrawler
Extractor
Extreme Picture Finder
Ezooms
facebookscraper
FemtosearchBot
FHscan
Fimap
Firefox/7.0
FlashGet
Flunky
Foobot
FrontPage
FyberSpider
Fyrebot
Genieo
GermCrawler
Gigablast
Grabber
Grafula
GT::WWW
Haansoft
HEADMasterSEO
Heritrix
HMView
HTMLparser
Id-search
Image Fetch
Image Sucker
InterGET
internetVista monitor
ips-agent
Iria
IRLbot
Iskanie
IstellaBot
JamesBOT
JennyBot
Joomla
Jorgee
JustView
Kenjin Spider
Keyword Density
Kozmosbot
Larbin
LeechFTP
LeechGet
LexiBot
Lightspeedsystems
LinkextractorPro
LinkpadBot
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey
LWP::Simple
lwp-trivial
Magnet
Mag-Net
Mail.RU_Bot
Majestic12
MarkWatch
Mass Downloader
meanpathbot
Meanpathbot
MegaIndex.ru
MFC_Tear_Sample
Microsoft URL Control
MIDown tool
MJ12bot
Mojeek
Mr.4x3
MS Web Services Client Protocol
Musobot
Nameprotect
Needle
Nessus
NetSpider
Nettrack
Net Vampire
NetZIP
NICErsPRO
NimbleCrawler
Nimbostratus
Ninja
NPbot
Octopus
OpenLinkProfiler
OrangeBot
OrangeSpider
OutfoxBot
PageGrabber
Pandalytics
pcBrowser
Pimonster
Pi-Monster
PleaseCrawl
POE-Component-Client-HTTP
Pump
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
RedesScrapy
RepoMonkey
Ripper
SalesIntelligent
ScanAlert
scan.lol
Scrapy
Screaming
Searchestate
SEOkicks
SEOstats
Sitebeam
SiteExplorer
Siteimprove
SiteSnagger
SiteSucker
Site Sucker
Sitevigil
SlySearch
Snake
SocialRankIOBot
Sogou web spider
Sosospider
SpaceBison
Spammen
Spanner
sp_auditbot
Spinn3r
SputnikBot
Steeler
Sucuri
SuperBot
SuperHTTP
Swiftbot
T8Abot
tAkeOut
Telesphorep
The Intraformant
TheNomad
Tracemyfile
True_Robot
Typhoeus
Upflow
URLy Warning
Vacuum
Vagabondo
VB Project
Voil
Voltron
Wallpapers/3.0
WASALive-Bot
Webalta
WebAuto
Web Auto
WebCollage
Web Collage
WebCopier
WEBDAV
Web Fetch
WebFuck
WebGo IS
WebLeacher
webmeup-crawler
WebPix
Web Pix
WebSauger
Web Sauger
WebsiteQuester
WebStripper
Web Sucker
WebWhacker
Whack
Whacker
Whatweb
WiseGuys Robot
WISENutbot
Wprecon
WWW-Collector-E
WWWOFFLE
Xaldon WebSpider
Xaldon_WebSpider
Zauba
Zermelo
Zeus