404enemy
Aboundexbot
Acunetix
ADmantX
AhrefsBot
AIBOT
AiHitBot
Alexibot
Anarchie
archive.org_bot
Aspiegel
ASPSeek
Asterias
autoemailspider
AwarioSmartBot
Backlink-Ceck
BacklinkCrawler
Badass
Battleztar Bazinga
BBBike
BDFetch
Bitacle
Blackboard
BlackWidow
BotALot
Brandprotect
BuiltWith
Bullseye
BunnySlippers
CazoodleBot
CheTeam
Chlooe
Cliqzbot
Cloud mapping
coccocbot-web
Collector
CopyRightCheck
Copyscape
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
Crescent
CSHttp
Curious
DBLBot
DIIbot
Dirbuster
Disco
DittoSpyder
Download Wonder
DSearch
Ebingbong
eCatch
EirGrabber
EMail Siphon
evc-batch
Evil
Exabot
Express WebPictures
ExtLinksBot
Extractor
Ezooms
facebookscraper
FDM
FemtosearchBot
FHscan
Firefox/7.0
Foobot
Freeuploader
FyberSpider
GermCrawler
Getintent
GetRight
GetWeb
Gigabot
Go-Ahead-Got-It
GoZilla
GrabNet
Grafula
GridBot
GT::WWW
HaosouSpider
Harvest
Havij
HMView
HTMLparser
HTTP::Lite
HTTrack
Iblog
Id-search
Image Fetch
InfoNaviRobot
instabid
Internet Ninja
internetVista monitor
Iria
isitwp.com
Jbrofuzz
Joomla
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
Kinza
LeechFTP
LexiBot
Lftp
LinkextractorPro
LinksManager
Lipperhey Spider
LNSpiderguy
Ltx71
Magnet
Majestic12
Majestic-SEO
Mata Hari
MauiBot
Mb2345Browser
Mediatoolkitbot
mediawords
Metauri
MFC_Tear_Sample
MicroMessenger
MIDown tool
MIIxpc
Morfeus Fucking Scanner
Msrabot
Musobot
Name Intelligence
Nameprotect
Navroad
NearSite
Nessus
NetAnts
Netcraft
NetLyzer
NetMechanic
Nettrack
Net Vampire
NextGenSearchBot
NICErsPRO
Nmap
NPbot
oBot
Openfind
OpenVAS
OutclicksBot
OutfoxBot
page scorer
Papa Foto
pcBrowser
PECL::HTTP
PeoplePal
PHPCrawl
Picsearch
PictureFinder
Pi-Monster
PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP
polaris version
ProPowerBot
ProWebWalker
Psbot
PxBroker
RankActive
RankingBot2
RankurBot
RealDownload
RebelMouse
Recorder
RocketCrawler
Rogerbot
s1z.ru
SalesIntelligent
satoristudio.net
SBIder
ScoutJet
Scrapy
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
Shodan
Siphon
Sitebeam
SiteCheckerBotCrawler
SiteLockSpider
Snoopy
Sociscraper
Sosospider
SpaceBison
SpankBot
sp_auditbot
Spinn3r
Sqlworm
Steeler
Sucuri
Surfbot
SurveyBot
Swiftbot
Szukacz
tAkeOut
Teleport
Toweyabot
trendiction.com
Turnitin
TurnitinBot
TwengaBot
Typhoeus
Upflow
URLy.Warning
VCI
VeriCiteCrawler
Webalta
Web Auto
Web Collage
WebCopier
WebGo IS
WebmasterWorldForumBot
webmeup-crawler
Web Sauger
WebsiteQuester
Website Quester
Web Sucker
Whack
Whatweb
WiseGuys Robot
Woobot
Wotbox
Wprecon
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
zauba.io
Zeus
zgrab
Zitebot
ZumBot