404checker
80legs
Aboundex
AhrefsBot
AIBOT
AiHitBot
AlphaBot
arquivo.pt
arquivo-web-crawler
autoemailspider
BackDoorBot
Backlink-Ceck
BacklinkCrawler
BackStreet
BackWeb
Badass
Barkrowler
BatchFTP
Battleztar Bazinga
BBBike
BDCbot
Bigfoot
BLEXBot
Bolt
Brandprotect
Brandwatch
Bullseye
BuzzSumo
CazoodleBot
CCBot
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
coccocbot-web
Cogentbot
Copyscape
Cosmos
Craftbot
crawler4j
CrazyWebCrawler
Crescent
CrunchBot
DataCha0s
demandbase-bot
Demon
Deusu
DigitalPebble
Disco
Discobot
Discoverybot
DnyzBot
Dragonfly
Drip
DSearch
DTS Agent
EasyDL
eCatch
Ecxi
EirGrabber
EMail Wolf
EroCrawler
evc-batch
Evil
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FDM
FlashGet
Flunky
FrontPage
Fyrebot
Genieo
Gigablast
Gigabot
Go-Ahead-Got-It
Gotit
GoZilla
GrabNet
Grafula
GrapeFX
GT::WWW
Haansoft
Harvest
Havij
HMView
HTTP::Lite
HTTrack
Humanlinks
IDBot
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
InternetSeer
internetVista monitor
ips-agent
IstellaBot
Jbrofuzz
JikeSpider
Joomla
Jorgee
JustView
Keyword Density
Kozmosbot
Lanshanbot
LeechGet
Lftp
Lightspeedsystems
LinkextractorPro
LinkpadBot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Lmspider
LWP::Simple
Mail.RU_Bot
Majestic12
MarkWatch
Masscan
meanpathbot
Metauri
Microsoft URL Control
MJ12bot
Mojeek
Mr.4x3
muhstik-scan
Nameprotect
NearSite
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
Nettrack
Netvibes
NetZIP
Niki-bot
NimbleCrawler
Nmap
Nutch
oBot
Octopus
Openfind
OpenLinkProfiler
OutfoxBot
Page Analyzer
PageScorer
Pavuk
pcBrowser
PeoplePal
Picsearch
plumanalytics
POE-Component-Client-HTTP
Psbot
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RealDownload
RebelMouse
Recorder
RedesScrapy
ReGet
RSSingBot
ScanAlert
Scanbot
ScoutJet
ScreenerBot
Searchestate
SearchmetricsBot
SemrushBot
SEOkicks
seoscanners
SeoSiteCheckup
SEOstats
Siphon
Siteimprove
SiteLockSpider
SiteSnagger
Sitevigil
SlySearch
SmartDownload
SMTBot
Snapbot
Snoopy
Sogou web spider
Sosospider
SpaceBison
SpankBot
sp_auditbot
Spbot
Spinn3r
Sqworm
Sucker
Sucuri
SuperBot
Swiftbot
Szukacz
Teleport
TeleportPro
Telesphoreo
TightTwatBot
Toata
Tracemyfile
True_Robot
Turingos
TwengaBot
UnisterBot
URLy.Warning
Vagabondo
VCI
VeriCiteCrawler
VoidEYE
Voil
WallpapersHD
WASALive-Bot
Web Collage
WebCopier
Web Enhancer
WebFuck
Web Fuck
WebGo IS
WebPix
WebReaper
WebSauger
Webshag
WebsiteQuester
Webster
WebStripper
Whack
WinHTTrack
WiseGuys Robot
WISENutbot
Wonderbot
Woobot
Wotbox
WWW-Mechanize
WWWOFFLE
Xaldon WebSpider
Xenu
xpymep1.exe
Zermelo
ZmEu