404checker
80legs
ADmantX
AIBOT
Abonti
Aboundex
Alexibot
AlphaBot
Anarchie
Ankit
Asterias
AwarioSmartBot
BDCbot
BDFetch
BLEXBot
BackStreet
Backlink-Ceck
Badass
Battleztar Bazinga
BetaBot
Bigfoot
Black Hole
BlackWidow
Boardreader
Bolt
BotALot
Buck
Buddy
BuiltWith
Bullseye
BunnySlippers
CCBot
CODE87
CSHttp
CazoodleBot
CensysInspect
Chlooe
Citoid
Copyscape
Cosmos
Craftbot
Crawling at Home Project
CyotekWebCopy
DBLBot
DTS Agent
DataCha0s
Disco
DittoSpyder
DomainAppender
DomainCrawler
Domains Project
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
EirGrabber
Evil
FDM
FHscan
Fimap
Foobot
Genieo
GermCrawler
GetRight
Gotit
Grafula
GrapeFX
HaosouSpider
Hloader
Humanlinks
HybridBot
IDBot
IRLbot
Image Fetch
Indy Library
Intelliseek
Iria
Iskanie
JOC Web Spider
Jbrofuzz
JennyBot
Joomla
Jorgee
JustView
Jyxobot
Kenjin Spider
Kinza
LNSpiderguy
LWP::Simple
Lanshanbot
Leap
Lftp
LieBaoFast
LinkScan
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MSIECrawler
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Mass Downloader
Mb2345Browser
Meanpathbot
Metauri
Microsoft URL Control
Mister PiX
Name Intelligence
Navroad
NetAnts
Nettrack
Nibbler
NimbleCrawler
Nimbostratus
Ninja
Nuclei
Nutch
OnCrawl
Openfind
Openvas
OrangeBot
OutclicksBot
PECL::HTTP
PHPCrawl
PageThing.com
Panscient
Papa Foto
Pavuk
Pi-Monster
Picscout
PictureFinder
ProPowerBot
Probethenet
PxBroker
RankActiveLinkBot
RankFlex
RankingBot
ReGet
RealDownload
RebelMouse
RepoMonkey
Ripper
RocketCrawler
SBIder
SEOkicks
SEOprofiler
SMTBot
SalesIntelligent
Scanbot
ScrepyBot
Semrush
SentiBot
SeobilityBot
Shodan
Site Sucker
SiteLockSpider
Sitebeam
Siteimprove
SmartDownload
Sogou web spider
Sottopop
Spammen
SpankBot
Spanner
Spbot
Spinn3r
Sqworm
Steeler
Sucuri
SuperBot
Surfbot
SurveyBot
Suzuran
T0PHackTeam
Teleport
TeleportPro
Telesphoreo
The Intraformant
Titan
Toweyabot
Tracemyfile
Trendiction
Turingos
TwengaBot
Twice
Typhoeus
URLy.Warning
UnisterBot
Upflow
VB Project
Virusdie
Voil
WBSearchBot
WPScan
WWW-Collector-E
WWW::Mechanize
Wallpapers
Web Sucker
WebAuto
WebBandit
WebCopier
WebFetch
WebFuck
WebPix
WebReaper
WebSucker
WebZIP
WebmasterWorldForumBot
WebsiteExtractor
Whacker
Whatweb
Who.is Bot
Widow
Woobot
Wprecon
Xaldon WebSpider
Zermelo
Zeus
Zitebot
ZoominfoBot
ZumBot
autoemailspider
check1.exe
clark-crawler
coccocbot-web
cognitiveseo
crawler4j
facebookscraper
heritrix
internetVista monitor
isitwp.com
lwp-trivial
magpie-crawler
mediawords
ripz
seoscanners
sogouspider
sp_auditbot
spyfu
trendiction.com
webmeup-crawler
webprosbot
x09Mozilla
x22Mozilla
zauba.io