360Spider
404checker
80legs
Abonti
ADmantX
AhrefsBot
AIBOT
AiHitBot
Alexibot
AllSubmitter
AlphaBot
Anthill
Apexoo
AwarioRssBot
Backlink-Ceck
backlink-check
BacklinkCrawler
Badass
BatchFTP
BBBike
BDCbot
BetaBot
Bigfoot
Bitacle
BlackWidow
BLEXBot
Blow
BlowFish
Bolt
BotALot
Buddy
BunnySlippers
Calculon
CCBot
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
Cliqzbot
Cloud mapping
coccocbot-web
Cocolyzebot
Cogentbot
Collector
Copier
Cosmos
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
CrazyWebCrawler
Crescent
CSHttp
Curious
CyotekWebCopy
DatabaseDriverMysqli
DataCha0s
DBLBot
Demon
Digincore
DigitalPebble
DIIbot
Dirbuster
Discobot
Discoverybot
DittoSpyder
Dotbot
Dragonfly
DTS Agent
EasyDL
Ebingbong
EroCrawler
Evil
Exabot
ExtLinksBot
Extractor
facebookscraper
FHscan
Fimap
Firefox/7.0
Foobot
Freeuploader
GalaxyBot
Genieo
GetWeb
G-i-g-a-b-o-t
Go!Zilla
GrabNet
GrapeFX
Harvest
heritrix
Heritrix
Hloader
HMView
HTTP::Lite
HTTrack
Humanlinks
HybridBot
Id-search
IlseBot
Image Sucker
InfoNaviRobot
internetVista monitor
isitwp.com
JennyBot
JetCar
JikeSpider
JOC Web Spider
Jorgee
Keyword Density
Lanshanbot
Larbin
LeechFTP
LibWeb
Lightspeedsystems
Likse
LinksManager
LinqiaRSSBot
Lmspider
LNSpiderguy
Magnet
Mag-Net
magpie-crawler
Mail.RU_Bot
Majestic12
Masscan
Mass Downloader
MFC_Tear_Sample
Microsoft URL Control
Morfeus Fucking Scanner
Msrabot
muhstik-scan
Name Intelligence
Needle
Nessus
Netcraft
NetMechanic
Nettrack
Netvibes
NextGenSearchBot
Nibbler
NICErsPRO
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
OpenLinkProfiler
OpenVAS
OPPO A33
OrangeBot
OrangeSpider
PageGrabber
Papa Foto
pcBrowser
Petalbot
Picscout
Picsearch
PictureFinder
Pi-Monster
Probethenet
PxBroker
QueryN Metasearch
RankFlex
RankingBot
RankingBot2
Rankivabot
Reaper
RedesScrapy
RepoMonkey
RSSingBot
SalesIntelligent
satoristudio.net
ScanAlert
scan.lol
Screaming
Searchestate
Semrush
SemrushBot
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
sexsearcher
Shodan
Site Sucker
SlySearch
SmartDownload
Snake
SocialRankIOBot
Sogou web spider
Sottopop
SpankBot
Spanner
sp_auditbot
SputnikBot
spyfu
Sqlmap
Steeler
Sucuri
SuperBot
SuperHTTP
SurveyBot
Suzuran
TeleportPro
Telesoft
The Intraformant
TheNomad
TightTwatBot
Toata
trendiction.com
trendiction.de
Turingos
URLy Warning
Vacuum
VCI
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
WallpapersHD
WASALive-Bot
WBSearchBot
Webalta
WebAuto
WebBandit
WebCollage
WebCopier
WebEnhancer
Web Fetch
WebGo IS
WebImageCollector
WebLeacher
WebPix
Website Quester
WebSucker
Web Sucker
WebZIP
Whacker
Widow
WinHTTrack
WPScan
WWW::Mechanize
WWWOFFLE
x22Mozilla
Xaldon_WebSpider
xpymep1.exe
zauba.io
Zermelo
Zeus
Zitebot
ZumBot