404checker
404enemy
ASPSeek
Acunetix
Aipbot
AllSubmitter
Ankit
AwarioSmartBot
BBBike
BackStreet
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
Bitacle
BlackWidow
Blow
Bolt
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
Cegbfeieh
CheeseBot
Cliqzbot
Collector
Copier
Craftbot
DIIbot
DSearch
DatabaseDriverMysqli
Deusu
DigitalPebble
Disco
Dispatch
DittoSpyder
DomCopBot
DomainCrawler
Download Wonder
Dragonfly
EMail Wolf
Ebingbong
Ecxi
EroCrawler
ExtLinksBot
ExtractorPro
Extreme Picture Finder
FDM
FemtosearchBot
Fimap
FlashGet
Flunky
Foobot
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GetRight
GetWeb
Getintent
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
Haansoft
Havij
Heritrix
IlseBot
Image Sucker
IndeedBot
Indy Library
InternetSeer
Iskanie
JOC Web Spider
JamesBOT
Jetty
JikeSpider
Jorgee
Kinza
Kozmosbot
Lanshanbot
LeechGet
LibWeb
LinkWalker
Linkdexbot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
MJ12bot
Mail.RU_Bot
Mass Downloader
Mata Hari
Meanpathbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mozlila
Mr.4x3
Msrabot
NICErsPRO
NPbot
Name Intelligence
Navroad
NearSite
Needle
Nessus
Net Vampire
NetMechanic
Nettrack
Nibbler
Nikto
NimbleCrawler
Not
Nuclei
OpenVAS
Openfind
Openvas
OutfoxBot
PECL::HTTP
Page Analyzer
PageGrabber
Pavuk
PeoplePal
Pi-Monster
Picsearch
Piepmatz
Pixray
ProPowerBot
ProWebWalker
Probethenet
Psbot
QueryN Metasearch
RSSingBot
RankActive
RankingBot2
Rankivabot
ReGet
Reaper
SEOkicks
SISTRIX
ScanAlert
ScoutJet
Screaming
ScreenerBot
ScrepyBot
Seekport
Semrush
Siphon
Site Sucker
SiteExplorer
SiteSucker
Siteimprove
Sitevigil
Snapbot
Snoopy
Sosospider
Sottopop
SpankBot
Spbot
Spinn3r
Sqlmap
Sqworm
Sucker
Sucuri
SuperBot
Suzuran
Szukacz
T0PHackTeam
TeleportPro
Telesoft
Telesphorep
The Intraformant
TightTwatBot
Trendiction
Trendictionbot
True_Robot
Turnitin
Twice
Typhoeus
URLy.Warning
Upflow
Vacuum
Vagabondo
VelenPublicWebCrawler
Virusdie
VoidEYE
Voil
WBSearchBot
WWW-Collector-E
WeSEE
Web Fetch
Web Fuck
Web Sucker
WebBandit
WebFuck
WebGo IS
WebImageCollector
WebStripper
WebWhacker
WebZIP
WebsiteExtractor
Whatweb
Woobot
Xaldon_WebSpider
Xenu
Zade
Zermelo
Zitebot
ZyBorg
arquivo.pt
autoemailspider
check1.exe
cognitiveseo
com.plumanalytics
crawl.sogou.com
crawler.feedback
dataforseo.com
instabid
ips-agent
isitwp.com
iubenda-radar
lwp-request
lwp-trivial
meanpathbot
mediawords
muhstik-scan
netEstate NE Crawler
page scorer
plumanalytics
scalaj-http
scan.lol
seobility
seoscanners
seostar
sp_auditbot
sysscan
tAkeOut
ubermetrics-technologies.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla
zgrab