404enemy
80legs
Abonti
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
Alexibot
Alligator
AllSubmitter
AlphaBot
Anarchie
Apexoo
ASPSeek
Attach
BackDoorBot
Backlink-Ceck
backlink-check
BackWeb
Barkrowler
BatchFTP
BDCbot
Blackboard
BlackWidow
BLEXBot
BlowFish
Boardreader
Brandprotect
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye
CATExplorador
Cegbfeieh
CherryPicker
CheTeam
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
CrunchBot
CSHttp
Custo
demandbase-bot
Devil
Digincore
Disco
Discobot
Dotbot
Download Wonder
Drip
Ebingbong
eCatch
Ecxi
Evil
Exabot
Express WebPictures
ExtractorPro
Ezooms
facebookscraper
FemtosearchBot
FHscan
Fimap
Flunky
Freeuploader
Fyrebot
Genieo
GetWeb
Gigabot
GoZilla
GT::WWW
Harvest
HEADMasterSEO
Heritrix
HMView
HTTrack
Humanlinks
Iblog
IDBot
IndeedBot
InfoNaviRobot
InfoTekies
instabid
Intelliseek
InterGET
Internet Ninja
Iria
Iskanie
JamesBOT
JennyBot
JikeSpider
JOC Web Spider
Joomla
Jyxobot
Kozmosbot
Lanshanbot
Lftp
Likse
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
lwp-request
LWP::Simple
lwp-trivial
magpie-crawler
Majestic-SEO
MarkMonitor
Masscan
meanpathbot
MegaIndex.ru
Metauri
Microsoft URL Control
MIIxpc
MJ12bot
Morfeus Fucking Scanner
Mr.4x3
muhstik-scan
Name Intelligence
Nameprotect
Navroad
NearSite
Needle
Nessus
NetAnts
NetLyzer
NetSpider
Nettrack
Net Vampire
Netvibes
Nibbler
Nimbostratus
Ninja
Nmap
NPbot
Octopus
Offline Explorer
Offline Navigator
OpenVAS
OutclicksBot
OutfoxBot
page scorer
PHPCrawl
Picscout
Picsearch
PictureFinder
POE-Component-Client-HTTP
Probethenet
PxBroker
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
RealDownload
Reaper
RebelMouse
Recorder
RocketCrawler
RSSingBot
SalesIntelligent
scan.lol
ScoutJet
Searchestate
SEOkicks
SEOkicks-Robot
Seomoz
SEOprofiler
SeoSiteCheckup
SEOstats
serpstatbot
sexsearcher
Siphon
SISTRIX
SiteExplorer
Siteimprove
SiteLockSpider
SiteSnagger
SiteSucker
SMTBot
Snake
Snapbot
Sociscraper
sogouspider
Sottopop
Spammen
SpankBot
Spbot
Spinn3r
Sqworm
Steeler
Sucker
Sucuri
SuperBot
Surfbot
Suzuran
sysscan
Szukacz
TeleportPro
Telesoft
Telesphorep
The Intraformant
TheNomad
Toweyabot
Tracemyfile
trendiction.com
Typhoeus
URLy Warning
VB Project
VidibleScraper
Virusdie
VoidEYE
Wallpapers/3.0
WebCollage
WebCopier
Web Enhancer
WebFetch
WebImageCollector
WebLeacher
Web Pix
WebReaper
WebsiteExtractor
Web Sucker
WebWhacker
WebZIP
WeSEE
Whack
Whatweb
Who.is Bot
Widow
WISENutbot
Woobot
WWW-Mechanize
x22Mozilla
Xaldon_WebSpider
Zade
Zermelo
ZmEu
ZumBot