360Spider
404checker
80legs
AhrefsBot
AIBOT
AiHitBot
Alexibot
Anarchie
Ankit
Anthill
ASPSeek
Attach
autoemailspider
BackDoorBot
Backlink-Ceck
BackStreet
BBBike
BDCbot
Bitacle
Blackboard
BotALot
Brandwatch
Buck
Bullseye
CATExplorador
CensysInspect
check1.exe
CheTeam
Chlooe
Cliqzbot
Cloud mapping
coccocbot-web
CODE87
Cogentbot
Collector
com.plumanalytics
Copyscape
Cosmos
crawler.feedback
crawl.sogou.com
Crescent
CyotekWebCopy
DatabaseDriverMysqli
DataCha0s
demandbase-bot
Dirbuster
Disco
DnyzBot
DomainCrawler
DomainStatsBot
Dotbot
Drip
EasyDL
ECCP/1.0
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
evc-batch
Exabot
Express WebPictures
ExtLinksBot
Extreme Picture Finder
EyeNetIE
Ezooms
FemtosearchBot
FHscan
Firefox/7.0
FlashGet
Foobot
Freeuploader
FrontPage
Fyrebot
GalaxyBot
Genieo
GermCrawler
GetWeb
Gigabot
GoZilla
Go!Zilla
GrabNet
Grafula
GrapeshotCrawler
Haansoft
HaosouSpider
HEADMasterSEO
Heritrix
Hloader
Humanlinks
HybridBot
IDBTE4M
Image Sucker
IndeedBot
Internet Ninja
InternetSeer
IRLbot
Iskanie
IstellaBot
Jbrofuzz
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Larbin
LeechFTP
LeechGet
LibWeb
Libwhisker
Lightspeedsystems
Linkdexbot
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey Spider
Litemage_walker
Lmspider
LNSpiderguy
LWP::Simple
lwp-trivial
Majestic-SEO
MarkWatch
Mass Downloader
Meanpathbot
Mediatoolkitbot
Metauri
Microsoft Data Access
MIDown tool
MQQBrowser
Mr.4x3
MSIECrawler
Musobot
Name Intelligence
Nameprotect
Navroad
Needle
NetMechanic
NetSpider
Net Vampire
Netvibes
Niki-bot
Nmap
NPbot
OPPO A33
OrangeBot
OutfoxBot
PageAnalyzer
PageScorer
Panscient
Papa Foto
PeoplePal
Petalbot
Picsearch
Pimonster
Pixray
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
polaris version
Probethenet
ProPowerBot
Psbot
PxBroker
PyCurl
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Rankivabot
RankurBot
Recorder
RocketCrawler
Rogerbot
s1z.ru
Scrapy
Screaming
Semrush
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
Shodan
SISTRIX
Sitebeam
SiteCheckerBotCrawler
sitechecker.pro
SiteExplorer
SiteLockSpider
Site Sucker
SlySearch
SmartDownload
Snake
sogouspider
Sogou web spider
SpaceBison
Spammen
SputnikBot
spyfu
Sqlworm
SurveyBot
Suzuran
Teleport
TeleportPro
Telesoft
Telesphorep
Trendiction
Trendictionbot
trendiction.com
True_Robot
Turingos
UnisterBot
Upflow
URLy Warning
Vacuum
VelenPublicWebCrawler
Virusdie
Voil
Wallpapers/3.0
WebAuto
Web Auto
WebCollage
WEBDAV
WebFetch
Web Fetch
WebFuck
WebGo IS
WebmasterWorldForumBot
WebPix
Web Pix
Webshag
WebsiteExtractor
WebStripper
WebSucker
WebZIP
Whack
Whacker
Who.is Bot
WinHTTrack
WiseGuys Robot
WISENutbot
WWW-Mechanize
WWWOFFLE
x09Mozilla
x22Mozilla
xpymep1.exe
YoudaoBot
zauba.io
zgrab
ZmEu
ZumBot