360Spider
404enemy
Abonti
Aboundexbot
Aipbot
Alligator
AlphaBot
Anarchie
Asterias
BackDoorBot
Bandit
BatchFTP
Battleztar Bazinga
BBBike
BDCbot
Bigfoot
Blackboard
Black Hole
BlackWidow
Blow
BlowFish
Bolt
Brandprotect
Brandwatch
Buddy
BuiltWith
Bullseye
BuzzSumo
Calculon
CCBot
Cegbfeieh
CheeseBot
ChinaClaw
Cogentbot
cognitiveseo
Cosmos
Craftbot
crawler4j
crawler.feedback
CSHttp
DatabaseDriverMysqli
Demon
DIIbot
Dirbuster
Disco
Dispatch
DnyzBot
DomainSigmaCrawler
DomainStatsBot
Download Wonder
DSearch
EasyDL
EirGrabber
EroCrawler
evc-batch
Evil
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
facebookscraper
FDM
Foobot
GetWeb
Gigablast
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
Grabber
GrabNet
Grafula
GrapeFX
GT::WWW
Haansoft
Havij
Heritrix
Hloader
HMView
HTMLparser
Humanlinks
IDBot
Image Fetch
IndeedBot
InfoNaviRobot
Intelliseek
Internet Ninja
InternetSeer
internetVista monitor
ips-agent
Iria
Iskanie
IstellaBot
JamesBOT
JennyBot
JetCar
Joomla
Jyxobot
Larbin
LexiBot
Lftp
Lightspeedsystems
Likse
LinkextractorPro
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot
Ltx71
LWP::Simple
Magnet
Mag-Net
Mail.RU_Bot
Majestic12
MarkMonitor
MarkWatch
Masscan
meanpathbot
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft URL Control
MIIxpc
MJ12bot
muhstik-scan
Musobot
Name Intelligence
NearSite
Nessus
NetAnts
Netcraft
netEstate NE Crawler
NetMechanic
Nibbler
NimbleCrawler
Ninja
Nutch
oBot
Octopus
OnCrawl
OpenVAS
PageAnalyzer
Page Analyzer
PageScorer
Panscient
Pavuk
PHPCrawl
Picsearch
PictureFinder
Pimonster
plumanalytics
Pockey
POE-Component-Client-HTTP
Psbot
Pump
PxBroker
RankingBot
RebelMouse
RedesScrapy
Ripper
RSSingBot
Scanbot
ScoutJet
Scrapy
ScreenerBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SEOstats
sexsearcher
Siteimprove
SiteLockSpider
SiteSnagger
Site Sucker
Sitevigil
SlySearch
SmartDownload
Snapbot
Snoopy
Sociscraper
Sogou web spider
Sosospider
Spammen
SpankBot
Spanner
Spinn3r
SputnikBot
spyfu
Sqlworm
Steeler
Stripper
Sucuri
SuperHTTP
Suzuran
Swiftbot
sysscan
Szukacz
T8Abot
Telesoft
TheNomad
Thumbor
TightTwatBot
Toweyabot
Trendiction
trendiction.de
True_Robot
Turnitin
TwengaBot
Twice
Typhoeus
URLy Warning
Vacuum
VCI
Virusdie
Voil
Wallpapers/3.0
WallpapersHD
Webalta
WebAuto
WebBandit
WebCollage
Web Collage
WebCopier
WebEnhancer
Web Enhancer
WebGo IS
WebImageCollector
Web Pix
WebsiteQuester
Website Quester
Webster
WebStripper
Web Sucker
WebWhacker
WebZIP
WeSEE
Whack
Whacker
WinHTTrack
WiseGuys Robot
Wonderbot
Wprecon
WPScan
x22Mozilla
Xaldon WebSpider
Zade
Zauba
Zermelo
Zitebot
ZumBot
ZyBorg