404checker
404enemy
80legs
ALittle Client
ASPSeek
Aboundexbot
Acunetix
AhrefsBot
AllSubmitter
AlphaBot
AwarioRssBot
BDCbot
BDFetch
BLEXBot
BackDoorBot
Bandit
Barkrowler
Bitacle
Black Hole
Blackboard
Blow
Boardreader
Bolt
BotALot
Buck
Buddy
Bullseye
BunnySlippers
BuzzSumo
CazoodleBot
CheTeam
Citoid
Claritybot
Cliqzbot
Copier
CopyRightCheck
Cosmos
CrazyWebCrawler
CyotekWebCopy
DIIbot
DSearch
DataCha0s
Dirbuster
Disco
Discoverybot
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
Domains Project
Dotbot
Dragonfly
Drip
EasyDL
Ecxi
EroCrawler
Evil
Exabot
Extractor
Extreme Picture Finder
FDM
FlashGet
Freeuploader
FrontPage
GalaxyBot
GetWeb
Gigabot
Gotit
GrabNet
GrapeFX
HMView
HTTP::Lite
HTTrack
HaosouSpider
IDBot
Iblog
Id-search
IlseBot
Image Sucker
Indy Library
InfoTekies
Internet Ninja
Iria
Iskanie
JetCar
Jetty
JikeSpider
Kozmosbot
LNSpiderguy
Lanshanbot
Larbin
LeechFTP
Lftp
Libwhisker
LieBaoFast
LinkWalker
LinksManager
LinqiaRSSBot
Litemage_walker
Ltx71
MIIxpc
MJ12bot
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
Mata Hari
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Moblie Safari
Mojeek
Mojolicious
Mr.4x3
NICErsPRO
Nameprotect
Nessus
NetAnts
NetLyzer
NetSpider
Nettrack
Netvibes
Nibbler
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nutch
Offline Navigator
OpenVAS
PECL::HTTP
PageAnalyzer
PageScorer
Panscient
Papa Foto
Pi-Monster
Piepmatz
PleaseCrawl
ProWebWalker
Pu_iN
PyCurl
QueryN Metasearch
Quick-Crawler
RankFlex
RankingBot
RankurBot
Reaper
Ripper
RocketCrawler
Rogerbot
SEOkicks
SEOlyticsCrawler
SEOprofiler
ScanAlert
Scrapy
ScreenerBot
Searchestate
SemanticJuice
SemrushBot
SeobilityBot
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
Siteimprove
SlySearch
Snake
Snapbot
SocialRankIOBot
Sosospider
SpaceBison
Spammen
SpankBot
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqworm
Sucker
SuperHTTP
Swiftbot
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesphoreo
Telesphorep
Toata
Toweyabot
Tracemyfile
Trendiction
Turnitin
TurnitinBot
TwengaBot
URLy Warning
V-BOT
VB Project
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
VoidEYE
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers
Web Auto
Web Collage
WebCopier
WebEnhancer
WebFetch
WebImageCollector
WebSucker
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Who.is Bot
Widow
WinHTTrack
Woobot
Wprecon
Xaldon WebSpider
Zade
ZoominfoBot
ZyBorg
arquivo.pt
backlink-check
crawler.feedback
facebookscraper
gopher
isitwp.com
lwp-request
magpie-crawler
netEstate NE Crawler
page scorer
plumanalytics
s1z.ru
satoristudio.net
seostar
sexsearcher
spyfu
tAkeOut
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
zauba.io