404checker
ALittle Client
Abonti
Aboundex
Acunetix
AiHitBot
Alligator
AlphaBot
Anarchie
Anarchy99
Anthill
Apexoo
Aspiegel
Asterias
Atomseobot
Attach
BLEXBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Bandit
Battleztar Bazinga
Blackboard
Blow
Brandprotect
Brandwatch
BuiltBotTough
CSHttp
Calculon
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
CherryPicker
ChinaClaw
Cliqzbot
Cloud mapping
Collector
Crawling at Home Project
DBLBot
DIIbot
DSearch
Digincore
Discobot
Dispatch
DnyzBot
DomainSigmaCrawler
Dotbot
EMail Siphon
EasyDL
EirGrabber
ExtLinksBot
Ezooms
FDM
Firefox/7.0
FlashGet
Flunky
Foobot
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
Genieo
GermCrawler
GetWeb
Gigabot
GrapeFX
HEADMasterSEO
HTTrack
Haansoft
HaosouSpider
Harvest
Havij
Heritrix
HonoluluBot
Humanlinks
IRLbot
Id-search
IndeedBot
InfoNaviRobot
InfoTekies
Internet Ninja
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
JennyBot
Jetty
Joomla
Keybot Translation-Search-Machine
Kozmosbot
LWP::Simple
Lanshanbot
Larbin
Leap
LeechFTP
Lftp
Likse
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MIIxpc
MSIECrawler
Mag-Net
Majestic SEO
Majestic12
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Microsoft Data Access
Minefield
Mister PiX
Morfeus Fucking Scanner
Msrabot
Net Vampire
NetAnts
NetSpider
Nibbler
Nmap
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
Page Analyzer
PageGrabber
PageScorer
Pi-Monster
Piepmatz
Pimonster
Pixray
Probethenet
Psbot
Pu_iN
PyCurl
RSSingBot
Re-re
ReGet
Reaper
RebelMouse
Recorder
Ripper
Rogerbot
SBIder
SEOkicks
SEOstats
ScanAlert
ScoutJet
Scrapy
ScrepyBot
Semrush
SeobilityBot
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
Siteimprove
Snake
Snapbot
Sosospider
Sottopop
SpaceBison
SpankBot
Spanner
SputnikBot
Sqlmap
Sqworm
Sucker
Sucuri
SuperBot
Surfbot
SurveyBot
Swiftbot
Szukacz
Teleport
Telesphorep
Trendiction
Turingos
TwengaBot
Twice
Upflow
V-BOT
VB Project
VelenPublicWebCrawler
VidibleScraper
VoidEYE
Voil
Voltron
WASALive-Bot
WWW-Mechanize
WWW::Mechanize
Web Auto
Web Fuck
Web Pix
Web Sucker
WebBandit
WebFuck
WebPix
WebStripper
WebWhacker
WebmasterWorldForumBot
Website Quester
Webster
Whack
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Wprecon
Xaldon WebSpider
Xenu
Zade
Zauba
Zeus
Zitebot
ZmEu
ZoomBot
ZumBot
cah.io.community
clark-crawler
coccocbot
cognitiveseo
crawler.feedback
domainsproject.org
facebookscraper
gopher
heritrix
isitwp.com
mediawords
netEstate NE Crawler
oBot
page scorer
pcBrowser
s1z.ru
scan.lol
sogouspider
tAkeOut
trendiction.com
ubermetrics-technologies.com
webgains-bot
webprosbot
x09Mozilla
xpymep1.exe
zauba.io
zgrab