404checker
404enemy
80legs
Aboundex
Aboundexbot
ADmantX
AfD-Verbotsverfahren
AIBOT
AiHitBot
Alexibot
Anarchie
Asterias
Attach
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BatchFTP
BDCbot
BetaBot
Bigfoot
Blackboard
Black Hole
BlackWidow
Blow
BlowFish
Bolt
Brandwatch
BuiltBotTough
BunnySlippers
CATExplorador
CazoodleBot
CCBot
CheeseBot
CheTeam
Claritybot
Cloud mapping
Cogentbot
Collector
CopyRightCheck
Cosmos
crawler.feedback
CrazyWebCrawler
Custo
DBLBot
demandbase-bot
Demon
Digincore
DigitalPebble
DIIbot
Discobot
Discoverybot
DittoSpyder
DomainSigmaCrawler
DSearch
eCatch
EirGrabber
EroCrawler
Evil
Exabot
ExtLinksBot
Extractor
FDM
FHscan
Fimap
Firefox/7.0
Flunky
Foobot
FrontPage
Fyrebot
GalaxyBot
GermCrawler
Gigablast
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GrapeFX
GT::WWW
Haansoft
HaosouSpider
Havij
Hloader
HMView
IDBot
Image Fetch
InfoNaviRobot
instabid
InterGET
Internet Ninja
InternetSeer
Iria
IRLbot
JamesBOT
JetCar
JikeSpider
JustView
Jyxobot
Kozmosbot
Lanshanbot
LeechFTP
LeechGet
LibWeb
Libwhisker
Lightspeedsystems
Linkdexbot
LinkextractorPro
LinkpadBot
LinkScan
LinksManager
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Lmspider
LNSpiderguy
Ltx71
lwp-request
lwp-trivial
Mail.RU_Bot
Majestic SEO
MarkWatch
Masscan
Meanpathbot
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MJ12bot
Mojeek
Mr.4x3
MSFrontPage
MSIECrawler
MS Web Services Client Protocol
Nameprotect
NetAnts
netEstate NE Crawler
NetMechanic
NetSpider
Nikto
Nimbostratus
Nmap
Nutch
Offline Explorer
OnCrawl
Openfind
OpenLinkProfiler
Openvas
OrangeSpider
OutfoxBot
PageAnalyzer
Page Analyzer
PageScorer
Pandalytics
Panscient
Papa Foto
Pavuk
PECL::HTTP
PeoplePal
PHPCrawl
PictureFinder
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
Probethenet
ProPowerBot
Pump
PyCurl
Quick-Crawler
RankActiveLinkBot
Rankivabot
RealDownload
RebelMouse
RepoMonkey
Rogerbot
scan.lol
ScoutJet
ScreenerBot
Searchestate
SearchmetricsBot
SemrushBot
SEOlyticsCrawler
SEOprofiler
seoscanners
Shodan
Siphon
Siteimprove
SiteLockSpider
SiteSnagger
SiteSucker
Site Sucker
Sitevigil
SlySearch
Snake
Snapbot
SocialRankIOBot
Sogou web spider
SpaceBison
Spammen
Spbot
spyfu
Steeler
Sucuri
SuperBot
SuperHTTP
SurveyBot
T0PHackTeam
T8Abot
Teleport
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
Toata
Tracemyfile
Trendiction
trendiction.de
Turingos
TurnitinBot
TwengaBot
Typhoeus
VB Project
VCI
VeriCiteCrawler
Virusdie
VoidEYE
Wallpapers/3.0
WallpapersHD
WASALive-Bot
WBSearchBot
Webalta
Web Collage
WebEnhancer
Web Enhancer
WebmasterWorldForumBot
Webshag
WebsiteQuester
Webster
WebSucker
Web Sucker
Wotbox
Wprecon
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
x22Mozilla
Xaldon_WebSpider
xpymep1.exe
Zauba
Zermelo
Zeus
ZumBot
ZyBorg