01h4x.com
404checker
80legs
AIBOT
ALittle Client
Aboundexbot
AhrefsBot
Aipbot
AllSubmitter
Anarchie
Anthill
Aspiegel
Asterias
Atomseobot
Attach
BackDoorBot
BackStreet
BackWeb
Bandit
Bitacle
Black Hole
BlackWidow
Blackboard
Blow
Buddy
BuiltBotTough
BuzzSumo
CensysInspect
CheTeam
CherryPicker
Chlooe
Citoid
Cliqzbot
Cloud mapping
Cocolyzebot
Collector
CrazyWebCrawler
CrunchBot
Curious
Custo
DBLBot
DataCha0s
Devil
Digincore
DigitalPebble
Disco
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
EMail Wolf
Ebingbong
Ecxi
EirGrabber
EroCrawler
ExtLinksBot
ExtractorPro
EyeNetIE
FlashGet
Foobot
Freeuploader
Fuzz
FyberSpider
Fyrebot
GalaxyBot
GermCrawler
Go!Zilla
Gotit
GrapeFX
HEADMasterSEO
HTMLparser
HTTrack
Haansoft
Havij
HonoluluBot
Humanlinks
IDBTE4M
IDBot
IRLbot
Iblog
Image Fetch
IndeedBot
Indy Library
InterGET
Internet Ninja
Iria
Iskanie
JamesBOT
Jbrofuzz
Jetty
Keyword Density
Lanshanbot
Larbin
Leap
LeechFTP
Libwhisker
Likse
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
MIDown tool
MJ12bot
MSFrontPage
Magnet
Majestic SEO
Majestic-SEO
Mass Downloader
Masscan
Mata Hari
MegaIndex.ru
MicroMessenger
Minefield
Moblie Safari
Mojolicious
MolokaiBot
Mr.4x3
Msrabot
Musobot
NICErsPRO
Nameprotect
Navroad
NearSite
NetLyzer
NetZIP
Netcraft
Netvibes
Nibbler
Nikto
Ninja
Nmap
Nutch
Offline Explorer
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageThing.com
Pavuk
Pixray
PleaseCrawl
Pu_iN
RankActive
RankingBot2
Rankivabot
ReGet
Recorder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SMTBot
Seekport
SemanticJuice
SeobilityBot
Site Sucker
SiteLockSpider
Sitebeam
Siteimprove
Sitevigil
Sogou web spider
SputnikBot
Sqlmap
Sqworm
Sucker
Sucuri
Swiftbot
T8Abot
TeleportPro
Telesoft
Toata
Toweyabot
Trendiction
Trendictionbot
True_Robot
Twice
URLy.Warning
UnisterBot
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
Voltron
WASALive-Bot
WWW-Collector-E
WWW::Mechanize
Wallpapers
WeSEE
Web Collage
Web Fuck
Web Sucker
WebCollage
WebCopier
WebEnhancer
WebFuck
WebLeacher
WebSauger
WebWhacker
Webalta
Website Quester
Whacker
Widow
Woobot
Wotbox
Xaldon WebSpider
YoudaoBot
Zauba
Zermelo
Zitebot
ZmEu
ZoomBot
ZyBorg
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
cah.io.community
coccocbot
crawl.sogou.com
crawler4j
eCatch
evc-batch
gopher
ips-agent
iubenda-radar
lwp-request
lwp-trivial
magpie-crawler
mediawords
oBot
page scorer
polaris version
satoristudio.net
seocompany.store
serpstatbot
sp_auditbot
trendiction.com
trendiction.de
webmeup-crawler
webpros.com
webprosbot
x09Mozilla
zgrab