404checker
Abonti
Aboundexbot
Acunetix
Aipbot
Alexibot
Alligator
AlphaBot
Ankit
Anthill
archive.org_bot
arquivo-web-crawler
ASPSeek
autoemailspider
AwarioRssBot
backlink-check
BackStreet
BackWeb
Battleztar Bazinga
BDCbot
BDFetch
Black Hole
Boardreader
Bolt
Brandwatch
Calculon
CATExplorador
CazoodleBot
CherryPicker
Cliqzbot
CODE87
Cogentbot
cognitiveseo
com.plumanalytics
Copier
crawler4j
crawl.sogou.com
DatabaseDriverMysqli
DBLBot
Demon
Devil
DIIbot
Dirbuster
Dispatch
DomainSigmaCrawler
Domains Project
Drip
DSearch
DTS Agent
EasyDL
Ebingbong
EirGrabber
EMail Siphon
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
Extractor
EyeNetIE
Ezooms
facebookscraper
FDM
Fimap
Foobot
FyberSpider
Fyrebot
Getintent
GetRight
GetWeb
Gigablast
Gigabot
G-i-g-a-b-o-t
Go!Zilla
GrapeFX
GridBot
GT::WWW
Haansoft
heritrix
HTTP::Lite
Humanlinks
Iblog
IDBTE4M
Id-search
IlseBot
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja
InternetSeer
internetVista monitor
isitwp.com
Iskanie
IstellaBot
Jetty
Joomla
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
Larbin
LeechGet
LexiBot
Linkdexbot
LinkextractorPro
LinkWalker
LinqiaRSSBot
Lipperhey
LNSpiderguy
lwp-request
Magnet
Mail.RU_Bot
Majestic12
Majestic-SEO
MarkMonitor
Mass Downloader
Mb2345Browser
meanpathbot
Meanpathbot
Microsoft URL Control
MIIxpc
Mr.4x3
MSFrontPage
MSIECrawler
Musobot
NearSite
Needle
Nessus
NetAnts
NetLyzer
NetMechanic
NetSpider
Nettrack
Net Vampire
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Nmap
NPbot
Offline Navigator
OpenLinkProfiler
Openvas
OrangeBot
OutfoxBot
Pandalytics
pcBrowser
PeoplePal
PHPCrawl
Picscout
Picsearch
Pimonster
Pixray
PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP
ProWebWalker
Pump
Quick-Crawler
RankActive
RankFlex
RankingBot2
Reaper
Recorder
ReGet
Ripper
RSSingBot
s1z.ru
SalesIntelligent
satoristudio.net
ScanAlert
scan.lol
Scrapy
ScreenerBot
SemrushBot
SEOkicks-Robot
seoscanners
SEOstats
sexsearcher
Siphon
Sitebeam
SiteCheckerBotCrawler
sitechecker.pro
SiteExplorer
SiteSnagger
SiteSucker
Sitevigil
Snake
Sogou web spider
Sosospider
SpaceBison
sp_auditbot
Spbot
SputnikBot
spyfu
Sqlworm
Steeler
Sucker
SuperBot
SuperHTTP
Surfbot
Swiftbot
tAkeOut
Telesphorep
TheNomad
Thumbor
TightTwatBot
Toweyabot
Tracemyfile
Trendictionbot
trendiction.com
TwengaBot
Twice
URLy Warning
URLy.Warning
Vacuum
VCI
VeriCiteCrawler
VidibleScraper
Voil
Voltron
Wallpapers/3.0
WallpapersHD
WASALive-Bot
Web Collage
WebCopier
WEBDAV
WebFuck
WebmasterWorldForumBot
webmeup-crawler
WebPix
WebSucker
Web Sucker
WebZIP
Whack
Widow
Wonderbot
Wotbox
WWW-Mechanize
x22Mozilla
Xaldon WebSpider
Zauba
zauba.io
zgrab
ZmEu
ZyBorg