80legs
Abonti
Aboundexbot
AiHitBot
Aipbot
Alexibot
AlphaBot
Anarchy99
Ankit
Anthill
Asterias
AwarioRssBot
AwarioSmartBot
BBBike
BackDoorBot
BackWeb
BacklinkCrawler
Badass
Blackboard
BlowFish
Boardreader
Brandprotect
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
Calculon
Citoid
Claritybot
Cocolyzebot
Cogentbot
Cosmos
Craftbot
Crawling at Home Project
Crescent
Curious
Custo
CyotekWebCopy
DSearch
DTS Agent
Disco
Dispatch
DnBCrawler-Analytics
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
ECCP/1.0
Ebingbong
Exabot
Ezooms
FDM
FHscan
Firefox/7.0
FlashGet
Foobot
Fuzz
FyberSpider
GT::WWW
Genieo
GetRight
GetWeb
Gotit
GrabNet
Grabber
Grafula
GrapeFX
GridBot
HTTrack
Havij
Heritrix
Hloader
IDBot
IlseBot
Indy Library
InfoTekies
InterGET
Internet Ninja
InternetSeer
IstellaBot
Jorgee
Kenjin Spider
Keyword Density
LNSpiderguy
Lanshanbot
Larbin
LeechGet
LexiBot
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
LinksManager
LinqiaRSSBot
Lipperhey
MFC_Tear_Sample
MIDown tool
MSIECrawler
MTRobot
Magnet
Mail.RU_Bot
MarkWatch
Mass Downloader
Mata Hari
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Metauri
MicroMessenger
Microsoft Data Access
Mojeek
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Msrabot
Nessus
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Nibbler
NimbleCrawler
Ninja
Octopus
Offline Navigator
OrangeBot
PHPCrawl
PageThing.com
Panscient
Papa Foto
PeoplePal
Pi-Monster
Pimonster
PleaseCrawl
Pockey
Probethenet
Pu_iN
QueryN Metasearch
RankActive
RankFlex
RankingBot
RankurBot
RealDownload
Recorder
RedesScrapy
Rogerbot
SBIder
SMTBot
ScanAlert
Scanbot
Scrapy
Searchestate
SemanticJuice
SemrushBot
SeobilityBot
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SmartDownload
SocialRankIOBot
Sogou web spider
SpankBot
Spbot
SputnikBot
Sqlmap
Sucker
SuperHTTP
SurveyBot
Suzuran
T0PHackTeam
Telesoft
Telesphorep
Thumbor
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
TurnitinBot
TwengaBot
Twice
Upflow
VelenPublicWebCrawler
VidibleScraper
VoidEYE
WEBDAV
WWW-Collector-E
WWWOFFLE
WallpapersHD
Web Auto
Web Collage
Web Sauger
WebAuto
WebBandit
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSauger
WebZIP
WinHTTrack
Woobot
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
Zermelo
Zeus
Zitebot
ZoominfoBot
ZumBot
ZyBorg
arquivo.pt
autoemailspider
cah.io.community
clark-crawler
cognitiveseo
crawler4j
heritrix
internetVista monitor
ips-agent
netEstate NE Crawler
oBot
page scorer
pcBrowser
polaris version
scalaj-http
seocompany.store
serpstatbot
sitechecker.pro
sogouspider
sysscan
trendiction.com
trendiction.de
webgains-bot
webmeup-crawler
x09Mozilla
zgrab