404checker
404enemy
80legs
Abonti
Acunetix
AiHitBot
Anarchie
Ankit
Aspiegel
Attach
AwarioRssBot
BBBike
BLEXBot
BackWeb
Battleztar Bazinga
BetaBot
BlowFish
Bolt
BotALot
Brandwatch
Buck
Buddy
Bullseye
BunnySlippers
BuzzSumo
CensysInspect
CheeseBot
ChinaClaw
Citoid
Cliqzbot
Cloud mapping
Cocolyzebot
Cogentbot
Copier
CopyRightCheck
Copyscape
Crescent
DBLBot
DSearch
DTS Agent
DatabaseDriverMysqli
Deusu
Digincore
DigitalPebble
Dirbuster
Disco
Discobot
DnBCrawler-Analytics
DomainSigmaCrawler
Domains Project
Dotbot
Dragonfly
EasyDL
Ecxi
Evil
Exabot
ExtractorPro
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
Freeuploader
GT::WWW
GalaxyBot
Genieo
GetRight
Getintent
Gigabot
HTMLparser
HTTP::Lite
IDBTE4M
Iblog
Image Sucker
InfoTekies
InterGET
InternetSeer
Iskanie
IstellaBot
Jbrofuzz
Jetty
JikeSpider
JustView
Jyxobot
LWP::Simple
Leap
LeechFTP
LexiBot
Lftp
LieBaoFast
Lightspeedsystems
Likse
LinkpadBot
LinksManager
Litemage_walker
Lmspider
MIIxpc
MJ12bot
MQQBrowser
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Mister PiX
Mojolicious
Mozlila
Nameprotect
NearSite
Needle
Net Vampire
NetLyzer
NextGenSearchBot
Nikto
NimbleCrawler
Nimbostratus
Nuclei
OpenVAS
Openvas
OutclicksBot
Page Analyzer
PageAnalyzer
PageGrabber
PageThing.com
Pandalytics
Pavuk
PeoplePal
Piepmatz
Pimonster
Pixray
PleaseCrawl
Pockey
ProPowerBot
Probethenet
Pu_iN
Pump
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
Re-re
RealDownload
RebelMouse
Recorder
Ripper
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot
ScreenerBot
SearchmetricsBot
SemanticJuice
Semrush
Shodan
Siphon
Site Sucker
SiteSnagger
Snapbot
Sociscraper
Sosospider
SpaceBison
SpankBot
Spanner
Spbot
Sqlworm
Sucker
SuperHTTP
Surfbot
Suzuran
T8Abot
Teleport
Telesoft
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Toata
Toweyabot
Trendiction
True_Robot
Turnitin
Twice
URLy.Warning
V-BOT
VB Project
Vacuum
Vagabondo
VidibleScraper
Virusdie
VoidEYE
Voil
WISENutbot
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers
WebBandit
WebCollage
WebFetch
WebImageCollector
WebLeacher
WebSauger
WebSucker
WebWhacker
WebZIP
Webshag
WebsiteExtractor
Whacker
WinHTTrack
WiseGuys Robot
Wotbox
Xenu
YoudaoBot
Zermelo
Zeus
ZoomBot
ZyBorg
archive.org_bot
com.plumanalytics
crawler4j
dataforseo.com
eCatch
evc-batch
internetVista monitor
ips-agent
lwp-trivial
oBot
pcBrowser
polaris version
probe-image-size
satoristudio.net
seobility
seostar
sexsearcher
sitechecker.pro
siteripz
sysscan
trendiction.de
ubermetrics-technologies.com
webgains-bot
x09Mozilla
x22Mozilla
zauba.io
zgrab