80legs
ALittle Client
Aboundexbot
AhrefsBot
Aipbot
AllSubmitter
AlphaBot
Anarchy99
Ankit
Anthill
Aspiegel
Asterias
BDFetch
Bandit
Barkrowler
BetaBot
Black Hole
Blow
BlowFish
Brandprotect
Bullseye
CSHttp
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
CheeseBot
Chlooe
Claritybot
Cloud mapping
Copyscape
CrazyWebCrawler
Crescent
CrunchBot
Curious
Custo
CyotekWebCopy
Demon
DigitalPebble
Discoverybot
DnBCrawler-Analytics
DnyzBot
DomainAppender
Download Wonder
Dragonfly
EMail Wolf
Ecxi
Evil
Express WebPictures
EyeNetIE
Ezooms
FDM
FHscan
FlashGet
Flunky
Freeuploader
FrontPage
Fyrebot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GermCrawler
GetWeb
Go-Ahead-Got-It
Gotit
GrapeshotCrawler
HTTP::Lite
Haansoft
Havij
Hloader
Humanlinks
HybridBot
IDBTE4M
Image Fetch
Image Sucker
IndeedBot
InfoNaviRobot
Intelliseek
InternetSeer
Iskanie
IstellaBot
JamesBOT
JetCar
Jyxobot
LNSpiderguy
LWP::Simple
LeechGet
Libwhisker
Lightspeedsystems
LinkScan
Linkbot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Ltx71
MJ12bot
MQQBrowser
Mag-Net
Mail.RU_Bot
Majestic12
Mass Downloader
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Metauri
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield
Mojolicious
Mozlila
Mr.4x3
NICErsPRO
Name Intelligence
NearSite
Needle
Nessus
NetAnts
NetLyzer
NetSpider
NetZIP
Netcraft
Nettrack
NextGenSearchBot
Nibbler
Nutch
OpenLinkProfiler
Openfind
OrangeBot
OrangeSpider
Page Analyzer
PageGrabber
PeoplePal
Pi-Monster
Picscout
Piepmatz
PleaseCrawl
Probethenet
PxBroker
PyCurl
RankActive
RankFlex
RankingBot
ReGet
RealDownload
RebelMouse
Ripper
Rogerbot
SEOlyticsCrawler
SMTBot
Scrapy
Screaming
Seekport
SemanticJuice
Semrush
SemrushBot
SeoSiteCheckup
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
Siteimprove
Sitevigil
Snapbot
Sosospider
Sqlworm
Steeler
Stripper
SuperBot
SuperHTTP
Suzuran
T8Abot
Teleport
Telesoft
Telesphoreo
TheNomad
Thumbor
Tracemyfile
Trendiction
Trendictionbot
True_Robot
Turnitin
Typhoeus
URLy Warning
Upflow
V-BOT
VB Project
Vagabondo
VeriCiteCrawler
Virusdie
Voil
Voltron
WASALive-Bot
WBSearchBot
WISENutbot
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Auto
Web Collage
Web Fetch
Web Sauger
WebCollage
WebEnhancer
WebFetch
WebImageCollector
WebPix
WebReaper
WebSauger
WebWhacker
Website Quester
WebsiteExtractor
Who.is Bot
WinHTTrack
Wotbox
Wprecon
YoudaoBot
Zermelo
Zitebot
ZoomBot
ZumBot
adscanner
coccocbot
com.plumanalytics
demandbase-bot
facebookscraper
instabid
internetVista monitor
ips-agent
lwp-request
meanpathbot
muhstik-scan
page scorer
polaris version
ripz
scan.lol
seocompany.store
seoscanners
serpstatbot
siteripz
spyfu
tAkeOut
webpros.com
webprosbot
zauba.io
zgrab