404checker
Aboundex
Aboundexbot
AhrefsBot
AIBOT
Aipbot
Alexibot
archive.org_bot
autoemailspider
Backlink-Ceck
BackWeb
Barkrowler
Battleztar Bazinga
BetaBot
Bigfoot
Bitacle
Black Hole
BLEXBot
BlowFish
Bolt
BotALot
Brandwatch
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CCBot
ChinaClaw
Claritybot
Cogentbot
Collector
com.plumanalytics
CopyRightCheck
Craftbot
Crescent
CSHttp
Curious
Custo
DataCha0s
DBLBot
demandbase-bot
DigitalPebble
Disco
Discoverybot
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
EasyDL
ECCP/1.0
EMail Siphon
evc-batch
Evil
Express WebPictures
ExtractorPro
Extreme Picture Finder
facebookscraper
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
FrontPage
GalaxyBot
GermCrawler
Getintent
Go-Ahead-Got-It
GoZilla
Grabber
HEADMasterSEO
Hloader
HTTP::Lite
HybridBot
IDBot
Indy Library
InfoTekies
instabid
Intelliseek
InterGET
Internet Ninja
InternetSeer
ips-agent
IRLbot
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
Jorgee
JustView
Lanshanbot
LexiBot
Lightspeedsystems
Linkdexbot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lmspider
lwp-trivial
Mail.RU_Bot
MarkWatch
meanpathbot
MeanPath Bot
MegaIndex.ru
Metauri
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
Mojeek
Morfeus Fucking Scanner
MSFrontPage
MSIECrawler
Msrabot
MS Web Services Client Protocol
muhstik-scan
Musobot
Needle
Netcraft
netEstate NE Crawler
Nettrack
Netvibes
NextGenSearchBot
NimbleCrawler
Nimbostratus
Nmap
NPbot
Nutch
Octopus
Offline Navigator
OnCrawl
Openfind
Openvas
OrangeBot
OrangeSpider
Page Analyzer
PageScorer
Pandalytics
Panscient
pcBrowser
PHPCrawl
Pixray
ProPowerBot
Psbot
PxBroker
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
RankurBot
Reaper
RebelMouse
ReGet
Ripper
RocketCrawler
Rogerbot
s1z.ru
SalesIntelligent
SBIder
Scanbot
scan.lol
Scrapy
Searchestate
SearchmetricsBot
Semrush
SemrushBot
Seomoz
SEOprofiler
seoscanners
Shodan
Sitebeam
SiteExplorer
SiteSucker
Site Sucker
SMTBot
Snake
Snapbot
Snoopy
Sogou web spider
SpaceBison
SpankBot
Spanner
spyfu
Sqlmap
Sqworm
Steeler
Sucker
Sucuri
SuperHTTP
Surfbot
Swiftbot
T8Abot
Teleport
TeleportPro
Telesoft
TheNomad
TightTwatBot
Toata
Toweyabot
Trendiction
Turingos
Turnitin
TurnitinBot
TwengaBot
URLy.Warning
VidibleScraper
Virusdie
Voil
Voltron
WallpapersHD
WASALive-Bot
Web Collage
WebEnhancer
WebFuck
WebGo IS
WebImageCollector
WebLeacher
Web Pix
WebReaper
Web Sauger
WebsiteExtractor
WebsiteQuester
Website Quester
Webster
Web Sucker
WeSEE
Whacker
Who.is Bot
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
WWW::Mechanize
x09Mozilla
Xenu
xpymep1.exe
Zade
Zauba
zauba.io
Zermelo
Zeus
Zitebot
ZmEu
ZumBot
ZyBorg