404checker
404enemy
80legs
ALittle Client
Abonti
Acunetix
AiHitBot
Alligator
Anarchy
Anarchy99
Ankit
Anthill
Aspiegel
Atomseobot
AwarioSmartBot
BBBike
BDFetch
BackDoorBot
BackWeb
BacklinkCrawler
Blackboard
Blow
BlowFish
Buck
Buddy
BuiltBotTough
BuzzSumo
CATExplorador
CODE87
CSHttp
Cegbfeieh
Cosmos
Crawling at Home Project
CrazyWebCrawler
Curious
DBLBot
DSearch
DataCha0s
Deusu
DigitalPebble
Discobot
Discoverybot
DittoSpyder
DnyzBot
DomainSigmaCrawler
Dotbot
Ebingbong
Ecxi
EirGrabber
EroCrawler
Express WebPictures
ExtractorPro
Extreme Picture Finder
EyeNetIE
Firefox/7.0
Flunky
Freeuploader
FrontPage
Fuzz
Genieo
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
HMView
HTTrack
Haansoft
Harvest
HonoluluBot
Id-search
IndeedBot
Indy Library
InfoNaviRobot
JOC Web Spider
JamesBOT
JetCar
Joomla
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Leap
LeechFTP
Lftp
Lightspeedsystems
Likse
LinkWalker
LinkextractorPro
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic12
MarkMonitor
Mb2345Browser
MeanPath Bot
MicroMessenger
Microsoft URL Control
Mister PiX
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NPbot
Navroad
Needle
NetZIP
Netvibes
Nimbostratus
Ninja
Nmap
Not
Nutch
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OrangeBot
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
PageThing.com
Pandalytics
PictureFinder
Pimonster
Pixray
Pockey
Probethenet
Psbot
Pu_iN
PxBroker
RankActive
RankingBot
RankurBot
Reaper
Recorder
RedesScrapy
Ripper
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
ScanAlert
ScreenerBot
SearchmetricsBot
SemanticJuice
SemrushBot
SentiBot
SeobilityBot
SiteCheckerBotCrawler
SiteSucker
SlySearch
SmartDownload
Snapbot
SocialRankIOBot
Sogou web spider
SpaceBison
SpankBot
Spanner
Spinn3r
Sqlmap
Sqlworm
Sucuri
SurveyBot
Suzuran
Szukacz
T8Abot
Telesoft
Telesphorep
TheNomad
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
True_Robot
TurnitinBot
VB Project
VCI
VeriCiteCrawler
Voil
Voltron
WBSearchBot
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE
Web Auto
Web Collage
WebCollage
WebCopier
WebFetch
WebReaper
WebSauger
WebSucker
WebWhacker
Webshag
WebsiteExtractor
WebsiteQuester
Who.is Bot
Widow
WiseGuys Robot
Wotbox
Xaldon_WebSpider
Xenu
Zauba
Zermelo
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
autoemailspider
crawler.feedback
crawler4j
demandbase-bot
evc-batch
internetVista monitor
linkdexbot
lwp-request
mediawords
muhstik-scan
oBot
plumanalytics
s1z.ru
satoristudio.net
seobility
seocompany.store
seoscanners
seostar
sitechecker.pro
siteripz
sp_auditbot
spyfu
trendiction.de
voyagerx.com
x22Mozilla
xpymep1.exe
zgrab