404checker
AIBOT
ALittle Client
Aboundex
AhrefsBot
AiHitBot
Alexibot
Anarchie
Anarchy
Anarchy99
Anthill
Aspiegel
Asterias
AwarioSmartBot
BBBike
BDFetch
BackStreet
BackWeb
Bandit
Barkrowler
Battleztar Bazinga
Black Hole
Blow
BlowFish
BotALot
Brandwatch
BuiltBotTough
BuzzSumo
CensysInspect
CheeseBot
CherryPicker
Chlooe
Cloud mapping
Cocolyzebot
Cogentbot
Copier
Cosmos
Crawling at Home Project
CrazyWebCrawler
CrunchBot
Curious
Custo
DBLBot
DIIbot
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
DnyzBot
DomCopBot
DomainAppender
Domains Project
Dotbot
Dragonfly
EMail Wolf
EasyDL
Ebingbong
EroCrawler
Evil
Exabot
ExtLinksBot
Extractor
EyeNetIE
Ezooms
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Foobot
Fuzz
FyberSpider
G-i-g-a-b-o-t
GetWeb
Getintent
Go!Zilla
Go-Ahead-Got-It
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
HTTrack
Harvest
Hloader
Humanlinks
HybridBot
IDBot
Iblog
Image Sucker
InfoTekies
JOC Web Spider
JikeSpider
JustView
Kozmosbot
LNSpiderguy
LeechFTP
LexiBot
LinkScan
Linkbot
LinkpadBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Majestic-SEO
MarkWatch
Mata Hari
Mb2345Browser
MegaIndex.ru
Microsoft Data Access
Mister PiX
Mojolicious
NPbot
Name Intelligence
NearSite
NetSpider
Netvibes
NextGenSearchBot
Nibbler
Nimbostratus
Ninja
Nmap
Nutch
Offline Explorer
OpenVAS
OrangeBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
Papa Foto
Pavuk
Petalbot
Picsearch
PictureFinder
Pixray
PxBroker
QueryN Metasearch
Quick-Crawler
Re-re
ReGet
Recorder
RepoMonkey
Ripper
Rogerbot
SEOkicks-Robot
SMTBot
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Screaming
Searchestate
SeobilityBot
Siphon
SiteSnagger
Sitebeam
Siteimprove
SmartDownload
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
SpankBot
Spbot
SputnikBot
Sqlmap
Sqworm
Sucuri
Suzuran
Swiftbot
T8Abot
Telesoft
Telesphoreo
TheNomad
Toata
Toweyabot
Trendiction
TwengaBot
VeriCiteCrawler
Virusdie
Voil
WISENutbot
WPScan
WWW-Collector-E
WWW::Mechanize
WallpapersHD
Web Pix
Web Sauger
WebAuto
WebBandit
WebCollage
WebEnhancer
WebReaper
WebStripper
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Whatweb
Widow
WinHTTrack
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
YoudaoBot
Zauba
Zitebot
ZumBot
archive.org_bot
arquivo-web-crawler
autoemailspider
clark-crawler
demandbase-bot
evc-batch
instabid
ips-agent
lwp-request
magpie-crawler
meanpathbot
mediawords
muhstik-scan
oBot
plumanalytics
probe-image-size
s1z.ru
scalaj-http
seobility
seoscanners
serpstatbot
sexsearcher
sitechecker.pro
sogouspider
spyfu
sysscan
trendiction.com
trendiction.de
webpros.com
xpymep1.exe
zauba.io