360Spider
404checker
404enemy
80legs
ALittle Client
Abonti
Aboundex
AiHitBot
AlphaBot
Anarchy
Anthill
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BackDoorBot
BackWeb
Badass
Barkrowler
Battleztar Bazinga
BetaBot
Black Hole
BlackWidow
Blackboard
BlowFish
Buddy
BunnySlippers
BuzzSumo
CCBot
CODE87
Calculon
CensysInspect
CherryPicker
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
Copier
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
Curious
CyotekWebCopy
DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli
Digincore
Discobot
Discoverybot
DnyzBot
DomainAppender
DomainStatsBot
Dragonfly
Drip
ECCP/1.0
EMail Siphon
Ecxi
EroCrawler
Extractor
Extreme Picture Finder
FHscan
FemtosearchBot
Firefox/7.0
Foobot
Freeuploader
FrontPage
Fyrebot
GT::WWW
Genieo
GetRight
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrabNet
GrapeFX
HTTP::Lite
HaosouSpider
Harvest
Heritrix
IDBot
IRLbot
Iskanie
JamesBOT
Jorgee
JustView
Keyword Density
LWP::Simple
Lanshanbot
LibWeb
Libwhisker
LinqiaMetadataDownloaderBot
MFC_Tear_Sample
MIDown tool
MTRobot
Magnet
Majestic12
MarkMonitor
Masscan
Mediatoolkitbot
MegaIndex.ru
Metauri
MolokaiBot
Mr.4x3
NPbot
Name Intelligence
NearSite
Needle
NetMechanic
NetZIP
Netcraft
Netvibes
NimbleCrawler
Nimbostratus
Nmap
Nuclei
Nutch
Octopus
Offline Navigator
Openfind
OrangeBot
OutclicksBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Pavuk
Pi-Monster
Picsearch
PictureFinder
Pimonster
Pixray
ProPowerBot
ProWebWalker
RankActive
RankActiveLinkBot
Rankivabot
RankurBot
Re-re
ReGet
RealDownload
RedesScrapy
Rogerbot
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
Scanbot
ScreenerBot
SearchmetricsBot
Seomoz
Site Sucker
SiteLockSpider
SiteSucker
SlySearch
Snake
SocialRankIOBot
Sottopop
SpaceBison
Spammen
SpankBot
Spbot
SputnikBot
Sqlmap
SuperBot
Swiftbot
T8Abot
Telesphoreo
The Intraformant
TightTwatBot
Toata
Toweyabot
Trendiction
Trendictionbot
TurnitinBot
TwengaBot
Typhoeus
URLy.Warning
UnisterBot
VCI
Vagabondo
VidibleScraper
Virusdie
VoidEYE
Voltron
WEBDAV
WWW-Collector-E
WWW::Mechanize
Wallpapers
WallpapersHD
Web Auto
Web Fuck
Web Pix
Web Sucker
WebBandit
WebFuck
WebImageCollector
WebPix
WebStripper
WebSucker
WebZIP
WebmasterWorldForumBot
WebsiteQuester
Whacker
Whatweb
Widow
Wonderbot
Woobot
Zade
Zauba
Zermelo
Zitebot
ZmEu
ZoominfoBot
ZyBorg
arquivo.pt
check1.exe
cognitiveseo
crawler.feedback
crawler4j
dataforseo.com
domainsproject.org
heritrix
lwp-trivial
netEstate NE Crawler
oBot
page scorer
pcBrowser
probe-image-size
s1z.ru
scalaj-http
scan.lol
seoscanners
serpstatbot
sogouspider
sp_auditbot
trendiction.com
voyagerx.com
webmeup-crawler
webpros.com
x22Mozilla
xpymep1.exe
zauba.io
zgrab