404checker
80legs
ADmantX
Acunetix
AhrefsBot
Anarchy
Ankit
Anthill
Apexoo
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BackDoorBot
BackStreet
Bandit
Barkrowler
BatchFTP
BetaBot
Blackboard
Boardreader
Bolt
BotALot
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
Cegbfeieh
CheeseBot
CherryPicker
Chlooe
Cloud mapping
Cocolyzebot
Cogentbot
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
Curious
CyotekWebCopy
DSearch
DataCha0s
Demon
DigitalPebble
Disco
DomCopBot
DomainAppender
Dotbot
Dragonfly
EMail Siphon
Ebingbong
ExtLinksBot
FHscan
Fimap
Flunky
Freeuploader
G-i-g-a-b-o-t
GermCrawler
GetWeb
Go-Ahead-Got-It
GoZilla
GrabNet
Grafula
GrapeshotCrawler
Haansoft
Havij
HonoluluBot
HybridBot
IDBTE4M
IDBot
Id-search
IlseBot
Image Sucker
Indy Library
InfoTekies
InterGET
InternetSeer
JennyBot
JetCar
JustView
Kenjin Spider
LWP::Simple
Lanshanbot
Lftp
Likse
LinkScan
LinkWalker
Linkbot
LinkpadBot
LinksManager
Lipperhey
Litemage_walker
MJ12bot
MSIECrawler
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
Mass Downloader
Masscan
Mata Hari
MeanPath Bot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Mister PiX
Morfeus Fucking Scanner
Nameprotect
Navroad
NearSite
Needle
NetZIP
Netcraft
NextGenSearchBot
Niki-bot
Ninja
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
Openvas
OrangeBot
OrangeSpider
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
PageThing.com
PeoplePal
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
Probethenet
Psbot
PyCurl
QueryN Metasearch
Quick-Crawler
RankingBot
RankingBot2
Rankivabot
ReGet
RebelMouse
RepoMonkey
Ripper
Rogerbot
SEOlyticsCrawler
SEOprofiler
Scanbot
ScoutJet
Scrapy
ScreenerBot
SentiBot
SeobilityBot
Seomoz
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
SiteSucker
Siteimprove
Snapbot
Sociscraper
Sottopop
Spanner
Spbot
Steeler
Stripper
SuperHTTP
T8Abot
TeleportPro
Telesoft
Telesphorep
TheNomad
TightTwatBot
Titan
Toata
Toweyabot
Trendiction
Turingos
TurnitinBot
VB Project
VeriCiteCrawler
Virusdie
VoidEYE
Voil
WEBDAV
WPScan
WWW-Collector-E
WWWOFFLE
Wallpapers
Web Fetch
Web Pix
WebCopier
WebFetch
WebGo IS
WebImageCollector
WebReaper
WebStripper
Webalta
WebsiteQuester
WiseGuys Robot
Woobot
Xaldon_WebSpider
YoudaoBot
Zade
Zauba
Zermelo
Zeus
ZoomBot
ZumBot
arquivo-web-crawler
backlink-check
clark-crawler
crawl.sogou.com
crawler.feedback
crawler4j
dataforseo.com
eCatch
evc-batch
instabid
internetVista monitor
isitwp.com
linkdexbot
lwp-trivial
magpie-crawler
meanpathbot
page scorer
plumanalytics
polaris version
ripz
satoristudio.net
scalaj-http
scan.lol
seocompany.store
sexsearcher
sysscan
tAkeOut
trendiction.com
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com
webprosbot
zauba.io
zgrab