360Spider
404checker
80legs
Abonti
Acunetix
ADmantX
AhrefsBot
AIBOT
AiHitBot
Alexibot
Anarchie
Anarchy
Anarchy99
Anthill
Apexoo
archive.org_bot
arquivo-web-crawler
Asterias
Attach
AwarioRssBot
BackDoorBot
Backlink-Ceck
backlink-check
BacklinkCrawler
BackStreet
Bandit
Barkrowler
BBBike
BDCbot
Bigfoot
Blackboard
Bolt
BuiltBotTough
Bullseye
BuzzSumo
CazoodleBot
CCBot
check1.exe
CheeseBot
ChinaClaw
Claritybot
Cliqzbot
Cocolyzebot
cognitiveseo
Collector
Craftbot
crawler4j
crawl.sogou.com
CrunchBot
CyotekWebCopy
DBLBot
Demon
Digincore
DIIbot
Discobot
Discoverybot
Dispatch
DittoSpyder
DnyzBot
DomainAppender
DomainSigmaCrawler
domainsproject.org
DomCopBot
Dotbot
DSearch
EasyDL
EirGrabber
evc-batch
Exabot
Extractor
ExtractorPro
Ezooms
facebookscraper
FDM
FHscan
Firefox/7.0
Flunky
Foobot
FrontPage
GalaxyBot
Genieo
Getintent
GetWeb
Gigablast
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GoZilla
GrabNet
GridBot
GT::WWW
Haansoft
HaosouSpider
Harvest
heritrix
Heritrix
HTTrack
IDBot
IDBTE4M
instabid
InternetSeer
Iria
isitwp.com
IstellaBot
Jbrofuzz
JetCar
Jetty
Jorgee
JustView
Jyxobot
Lanshanbot
LeechFTP
LibWeb
Lightspeedsystems
Likse
Linkbot
LinkWalker
lwp-request
LWP::Simple
lwp-trivial
magpie-crawler
Majestic-SEO
MarkMonitor
Masscan
meanpathbot
mediawords
MFC_Tear_Sample
MIDown tool
Mister PiX
Morfeus Fucking Scanner
MQQBrowser
Msrabot
muhstik-scan
Nameprotect
Needle
Nessus
Netcraft
NetMechanic
NextGenSearchBot
Niki-bot
Ninja
Nmap
Nuclei
oBot
Octopus
Openfind
OrangeSpider
OutclicksBot
OutfoxBot
Page Analyzer
PageGrabber
PageScorer
PageThing.com
Papa Foto
PECL::HTTP
Picscout
Pimonster
Pixray
PleaseCrawl
Pockey
polaris version
ProWebWalker
Pump
QueryN Metasearch
Quick-Crawler
RankFlex
RankingBot
RebelMouse
Recorder
RedesScrapy
Ripper
ripz
s1z.ru
satoristudio.net
scalaj-http
ScanAlert
ScreenerBot
Searchestate
SentiBot
SEOlyticsCrawler
serpstatbot
Siphon
SISTRIX
sitechecker.pro
Siteimprove
SiteSnagger
SiteSucker
Site Sucker
Sitevigil
SmartDownload
Snake
Snapbot
SocialRankIOBot
sogouspider
Sottopop
Spanner
sp_auditbot
SputnikBot
Steeler
Stripper
Sucuri
SurveyBot
Swiftbot
Szukacz
The Intraformant
Thumbor
Toweyabot
Tracemyfile
trendiction.com
trendiction.de
True_Robot
Turingos
Turnitin
TwengaBot
Twice
UnisterBot
URLy Warning
URLy.Warning
Vagabondo
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voltron
WallpapersHD
Webalta
WebCollage
Web Collage
WebFetch
WebGo IS
WebPix
Web Pix
Website Quester
Webster
WebStripper
Whack
Whacker
Whatweb
Who.is Bot
Widow
WWW::Mechanize
WWWOFFLE
x22Mozilla
Xaldon WebSpider
Zade
Zauba
Zitebot
ZmEu
ZoomBot
ZyBorg