404checker
Abonti
Aboundex
Aboundexbot
Acunetix
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
Alligator
Anarchie
Apexoo
ASPSeek
Asterias
autoemailspider
BackDoorBot
Badass
Battleztar Bazinga
BDFetch
BetaBot
Bitacle
Black Hole
BlowFish
BotALot
Brandwatch
BunnySlippers
Calculon
CazoodleBot
CCBot
Cegbfeieh
ChinaClaw
Cloud mapping
coccocbot-web
cognitiveseo
Collector
Copier
CopyRightCheck
Cosmos
crawler4j
crawl.sogou.com
Crescent
CrunchBot
CSHttp
DataCha0s
DBLBot
demandbase-bot
Demon
Digincore
DigitalPebble
DIIbot
Discoverybot
DomainAppender
DomainCrawler
DomainStatsBot
Download Wonder
Drip
DSearch
EMail Siphon
EroCrawler
Exabot
Extreme Picture Finder
Ezooms
facebookscraper
FHscan
Fimap
Firefox/7.0
FlashGet
Foobot
FyberSpider
GermCrawler
GetWeb
Gigablast
G-i-g-a-b-o-t
Gotit
GrabNet
Haansoft
Harvest
HMView
HTTP::Lite
HybridBot
Iblog
Id-search
Image Sucker
IndeedBot
InfoTekies
Intelliseek
InterGET
Internet Ninja
Iria
Iskanie
JamesBOT
JennyBot
JetCar
Jetty
Joomla
Jyxobot
Keyword Density
Lanshanbot
LexiBot
Lftp
LibWeb
Likse
Linkdexbot
LinkextractorPro
LinkScan
LinqiaScrapeBot
Lipperhey
Litemage_walker
LNSpiderguy
lwp-request
Majestic SEO
MarkMonitor
MarkWatch
meanpathbot
MeanPath Bot
MegaIndex.ru
Metauri
Microsoft Data Access
MIDown tool
MIIxpc
MJ12bot
Mojeek
Morfeus Fucking Scanner
muhstik-scan
Name Intelligence
Nameprotect
Navroad
NearSite
Nessus
Netcraft
netEstate NE Crawler
NetSpider
Net Vampire
Netvibes
Nikto
Nimbostratus
NPbot
oBot
Octopus
OnCrawl
Openfind
OutclicksBot
PageAnalyzer
PageGrabber
page scorer
Papa Foto
Pavuk
pcBrowser
PECL::HTTP
PeoplePal
PHPCrawl
Pimonster
Pixray
PleaseCrawl
Pockey
POE-Component-Client-HTTP
ProWebWalker
Psbot
RankActive
RankActiveLinkBot
RankFlex
Rankivabot
RankurBot
RebelMouse
Recorder
ReGet
RepoMonkey
RSSingBot
SBIder
Scanbot
scan.lol
Scrapy
Screaming
Searchestate
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
seoscanners
SeoSiteCheckup
serpstatbot
SiteExplorer
SiteLockSpider
SiteSnagger
Snake
Snoopy
Sogou web spider
Sottopop
SpaceBison
Spammen
SpankBot
Spanner
Spinn3r
SputnikBot
spyfu
Sqlworm
Suzuran
T0PHackTeam
Teleport
Telesoft
Telesphoreo
TheNomad
Thumbor
TightTwatBot
Toweyabot
Trendiction
trendiction.de
Turnitin
TurnitinBot
Twice
Upflow
URLy.Warning
Vacuum
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
WebAuto
WebBandit
WebCollage
WebCopier
Web Enhancer
Web Fetch
Web Fuck
WebGo IS
WebLeacher
webmeup-crawler
WebReaper
WebsiteQuester
WebStripper
WebSucker
Web Sucker
WebZIP
WeSEE
Whack
Whacker
Whatweb
Who.is Bot
Woobot
Wprecon
WWW::Mechanize
WWWOFFLE
Xaldon_WebSpider
Xenu
xpymep1.exe
Zade
Zermelo
Zeus
zgrab
ZyBorg