360Spider
404checker
Abonti
Aboundex
Aboundexbot
ADmantX
AfD-Verbotsverfahren
AIBOT
AllSubmitter
Anarchie
ASPSeek
Attach
autoemailspider
AwarioRssBot
BackDoorBot
BackWeb
Badass
Barkrowler
BDFetch
BetaBot
Blackboard
BlackWidow
Brandwatch
Buddy
BuiltWith
Bullseye
BunnySlippers
Calculon
CCBot
CherryPicker
Chlooe
Claritybot
Cliqzbot
cognitiveseo
Collector
CopyRightCheck
Craftbot
crawler.feedback
CrazyWebCrawler
Crescent
CrunchBot
CSHttp
Curious
demandbase-bot
Deusu
Devil
Digincore
DigitalPebble
DIIbot
Discobot
DittoSpyder
DnyzBot
Domains Project
DomainStatsBot
Dotbot
Dragonfly
Ebingbong
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
Foobot
Freeuploader
FrontPage
FyberSpider
Fyrebot
GalaxyBot
Genieo
GetRight
GetWeb
Gigablast
Go-Ahead-Got-It
Harvest
Havij
heritrix
Heritrix
HTTP::Lite
Humanlinks
Iblog
Id-search
Image Sucker
Indy Library
Intelliseek
Internet Ninja
ips-agent
IRLbot
JamesBOT
Jbrofuzz
JOC Web Spider
JustView
Lanshanbot
LeechGet
LexiBot
LinkpadBot
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Lmspider
LNSpiderguy
Ltx71
lwp-request
lwp-trivial
Mag-Net
Majestic12
MarkMonitor
Mata Hari
Mb2345Browser
meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
MIIxpc
Mister PiX
Mr.4x3
MSIECrawler
muhstik-scan
Musobot
Name Intelligence
Navroad
NearSite
Needle
NetLyzer
NetSpider
Netvibes
NimbleCrawler
Ninja
NPbot
oBot
Octopus
Offline Navigator
Openfind
OPPO A33
OrangeSpider
OutclicksBot
PageAnalyzer
PageGrabber
PageScorer
Panscient
pcBrowser
PECL::HTTP
Picsearch
Pimonster
Pi-Monster
PleaseCrawl
plumanalytics
Pockey
Probethenet
ProWebWalker
Psbot
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RealDownload
Reaper
ReGet
Ripper
RocketCrawler
SalesIntelligent
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
SemrushBot
Seomoz
SEOprofiler
sexsearcher
Sitebeam
SiteExplorer
SiteLockSpider
SiteSucker
SmartDownload
Snapbot
SocialRankIOBot
Sociscraper
sogouspider
Sottopop
SpaceBison
Spammen
Spanner
SputnikBot
spyfu
Steeler
SuperHTTP
Surfbot
SurveyBot
Suzuran
sysscan
Szukacz
T8Abot
Telesoft
Telesphorep
TheNomad
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turnitin
TurnitinBot
Twice
Upflow
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
Wallpapers/3.0
WallpapersHD
WBSearchBot
Webalta
WebAuto
Web Auto
WebCollage
Web Fetch
WebFuck
WebLeacher
WebmasterWorldForumBot
WebPix
Web Pix
WebSauger
WebsiteExtractor
Whack
Whacker
Who.is Bot
WinHTTrack
WiseGuys Robot
WISENutbot
Wonderbot
Woobot
Wotbox
WPScan
WWW-Collector-E
Xenu
xpymep1.exe
zauba.io
zgrab
ZmEu
ZyBorg