404enemy
Aboundex
Acunetix
ADmantX
AiHitBot
AllSubmitter
Apexoo
archive.org_bot
arquivo-web-crawler
ASPSeek
Asterias
Attach
BackDoorBot
BackStreet
Battleztar Bazinga
BBBike
BDCbot
Bolt
BotALot
BuiltWith
Calculon
CazoodleBot
Cegbfeieh
CheeseBot
ChinaClaw
Chlooe
Cliqzbot
Cogentbot
cognitiveseo
Collector
Copier
Craftbot
crawler4j
crawler.feedback
CrazyWebCrawler
CSHttp
Curious
DataCha0s
DBLBot
demandbase-bot
Demon
Deusu
Digincore
DigitalPebble
DIIbot
Disco
DnyzBot
DomainCrawler
Drip
EirGrabber
EMail Siphon
EroCrawler
Exabot
Extractor
FDM
Freeuploader
Genieo
Getintent
Go-Ahead-Got-It
Gotit
Grabber
GrabNet
Grafula
GrapeshotCrawler
GT::WWW
HaosouSpider
HEADMasterSEO
Heritrix
HMView
HTMLparser
HTTP::Lite
Humanlinks
HybridBot
Iblog
IDBot
Id-search
IlseBot
IndeedBot
Indy Library
InfoNaviRobot
instabid
internetVista monitor
ips-agent
Iria
Jbrofuzz
JennyBot
JetCar
JikeSpider
JOC Web Spider
Jorgee
JustView
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
Lanshanbot
LeechGet
LibWeb
Libwhisker
Lightspeedsystems
LinkpadBot
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lmspider
Ltx71
lwp-trivial
magpie-crawler
Majestic12
Majestic SEO
Majestic-SEO
MarkWatch
Mass Downloader
Mata Hari
Meanpathbot
MeanPath Bot
Mediatoolkitbot
MFC_Tear_Sample
Microsoft Data Access
Microsoft URL Control
MIIxpc
Mister PiX
MJ12bot
Mojolicious
Morfeus Fucking Scanner
MSFrontPage
MSIECrawler
Name Intelligence
Navroad
Needle
NetAnts
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
Netvibes
NetZIP
NICErsPRO
Niki-bot
Nimbostratus
Ninja
NPbot
Offline Explorer
OnCrawl
Openfind
OPPO A33
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
PageScorer
Pandalytics
Papa Foto
pcBrowser
PECL::HTTP
PeoplePal
PHPCrawl
Picsearch
PictureFinder
Pimonster
Pi-Monster
PleaseCrawl
Psbot
RankActiveLinkBot
RankFlex
RocketCrawler
Rogerbot
SBIder
Scanbot
ScreenerBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
serpstatbot
sexsearcher
SISTRIX
Sitebeam
Siteimprove
SiteLockSpider
Site Sucker
Sitevigil
SlySearch
Snoopy
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
SpankBot
Spanner
Spbot
Spinn3r
spyfu
Surfbot
SurveyBot
Suzuran
Swiftbot
sysscan
T0PHackTeam
Teleport
Telesoft
TheNomad
TightTwatBot
Titan
Toweyabot
Turingos
Turnitin
TurnitinBot
Typhoeus
URLy Warning
URLy.Warning
Vagabondo
VB Project
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
WallpapersHD
WASALive-Bot
Web Auto
WebBandit
WebCollage
WEBDAV
WebEnhancer
Web Enhancer
Web Fetch
WebFuck
WebmasterWorldForumBot
WebPix
WebSauger
Webshag
WebsiteExtractor
WebSucker
Web Sucker
WebWhacker
WeSEE
Whacker
Whatweb
Widow
WPScan
WWW::Mechanize
x22Mozilla
Xaldon_WebSpider
Xenu
Zauba
Zitebot
ZmEu