404checker
80legs
ALittle Client
Abonti
Aboundexbot
Acunetix
AiHitBot
Alexibot
Anarchy99
Anthill
Asterias
AwarioRssBot
BBBike
BDCbot
BacklinkCrawler
Bandit
Battleztar Bazinga
Bitacle
Black Hole
Blackboard
Brandwatch
Buck
Buddy
BuiltWith
Bullseye
BunnySlippers
CATExplorador
CazoodleBot
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Cogentbot
Copyscape
Crawling at Home Project
CrazyWebCrawler
Curious
Custo
CyotekWebCopy
DBLBot
DTS Agent
DataCha0s
DatabaseDriverMysqli
Devil
Digincore
DigitalPebble
Discoverybot
Dispatch
DomainStatsBot
Dotbot
Dragonfly
EMail Siphon
Ebingbong
Ecxi
Express WebPictures
ExtLinksBot
EyeNetIE
FHscan
Firefox/7.0
Flunky
Foobot
FyberSpider
GT::WWW
Genieo
GetWeb
Getintent
Go-Ahead-Got-It
GrabNet
Grafula
HTMLparser
HTTrack
HaosouSpider
Havij
Heritrix
HybridBot
Iblog
IlseBot
IndeedBot
InfoNaviRobot
IstellaBot
JennyBot
JetCar
Jorgee
Jyxobot
Keyword Density
LWP::Simple
Lanshanbot
Larbin
LeechGet
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
LinksManager
Litemage_walker
Lmspider
MFC_Tear_Sample
MIIxpc
Majestic SEO
MarkMonitor
Mass Downloader
MauiBot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Moblie Safari
Morfeus Fucking Scanner
Mozlila
Msrabot
NPbot
Needle
Nessus
NetAnts
NetLyzer
NetSpider
NetZIP
Netcraft
Nettrack
Nibbler
NimbleCrawler
Nuclei
Nutch
Offline Navigator
OpenLinkProfiler
OpenVAS
Openfind
OrangeSpider
OutclicksBot
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageThing.com
Panscient
PeoplePal
Petalbot
Pi-Monster
Picscout
Probethenet
Psbot
Pump
PxBroker
RSSingBot
RankFlex
RankingBot
Re-re
ReGet
RealDownload
RebelMouse
RedesScrapy
Rogerbot
SEOlyticsCrawler
SEOprofiler
SMTBot
ScreenerBot
ScrepyBot
SearchmetricsBot
Shodan
SiteLockSpider
SiteSnagger
Siteimprove
SocialRankIOBot
Sociscraper
Sogou web spider
Sosospider
SpaceBison
Spanner
Spbot
Sqworm
Steeler
Surfbot
Teleport
TeleportPro
Telesphoreo
TheNomad
Thumbor
TightTwatBot
Tracemyfile
Trendiction
True_Robot
Turnitin
TurnitinBot
Twice
VB Project
VCI
VeriCiteCrawler
VidibleScraper
VoidEYE
WBSearchBot
WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers
Web Auto
Web Pix
Web Sucker
WebAuto
WebBandit
WebCollage
WebImageCollector
WebPix
WebReaper
WebStripper
Webshag
WebsiteExtractor
Webster
Whack
Who.is Bot
WinHTTrack
Woobot
Wotbox
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zeus
ZoomBot
ZoominfoBot
arquivo-web-crawler
check1.exe
coccocbot-web
cognitiveseo
com.plumanalytics
crawl.sogou.com
dataforseo.com
demandbase-bot
eCatch
facebookscraper
internetVista monitor
muhstik-scan
oBot
pcBrowser
polaris version
scalaj-http
scan.lol
seocompany.store
serpstatbot
sexsearcher
sogouspider
sp_auditbot
sysscan
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
webprosbot
x09Mozilla
zgrab