404checker
404enemy
80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Aboundex
Aboundexbot
AlphaBot
Apexoo
Aspiegel
Asterias
BDCbot
BLEXBot
BackDoorBot
BackWeb
Backlink-Ceck
Bandit
BatchFTP
BetaBot
BlowFish
Bolt
Buck
Buddy
Bullseye
CATExplorador
CCBot
CazoodleBot
Cegbfeieh
CheTeam
Chlooe
Citoid
Cocolyzebot
Copier
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Curious
Custo
DBLBot
DIIbot
DSearch
DTS Agent
Deusu
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DittoSpyder
EMail Wolf
EasyDL
Ebingbong
Ecxi
Extractor
Extreme Picture Finder
Ezooms
FemtosearchBot
Foobot
Fuzz
FyberSpider
GermCrawler
GetRight
GetWeb
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrapeshotCrawler
HTTP::Lite
HaosouSpider
Harvest
HonoluluBot
HybridBot
IDBTE4M
IDBot
IRLbot
Iblog
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
JOC Web Spider
JennyBot
JetCar
Jetty
JikeSpider
Jorgee
Jyxobot
Kenjin Spider
Kinza
Larbin
LeechGet
LexiBot
LibWeb
LinkScan
LinkWalker
LinkextractorPro
LinksManager
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Ltx71
MIDown tool
MJ12bot
MTRobot
Magnet
Mail.RU_Bot
Majestic12
Mediatoolkitbot
Metauri
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Navroad
Needle
Nessus
NetAnts
NetLyzer
Netcraft
Nettrack
Nibbler
Nikto
NimbleCrawler
Nuclei
Octopus
Offline Navigator
OpenVAS
Openvas
OrangeBot
OrangeSpider
PECL::HTTP
POE-Component-Client-HTTP
PageGrabber
PageScorer
Panscient
Papa Foto
PeoplePal
Picscout
Picsearch
PictureFinder
Piepmatz
Pimonster
PleaseCrawl
Psbot
Pu_iN
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankurBot
RebelMouse
Recorder
RepoMonkey
RocketCrawler
SBIder
SISTRIX
Scrapy
ScrepyBot
Searchestate
SemanticJuice
Semrush
SemrushBot
SeoSiteCheckup
SeobilityBot
Shodan
SiteSnagger
Siteimprove
Sitevigil
SlySearch
Snake
Snoopy
Sosospider
Sottopop
Spammen
SpankBot
Spbot
Steeler
Sucker
Surfbot
T8Abot
Telesphorep
The Intraformant
Tracemyfile
Trendictionbot
True_Robot
Turnitin
URLy Warning
URLy.Warning
UnisterBot
Upflow
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Voil
WISENutbot
WPScan
WWW-Collector-E
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Fetch
Web Fuck
WebAuto
WebFetch
WebPix
WebReaper
WebSauger
WebWhacker
WebZIP
WebsiteQuester
Webster
Whatweb
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zade
Zitebot
ZmEu
ZoomBot
ZyBorg
arquivo-web-crawler
clark-crawler
coccocbot-web
crawler.feedback
dataforseo.com
heritrix
internetVista monitor
iubenda-radar
muhstik-scan
page scorer
ripz
scalaj-http
seoscanners
serpstatbot
siteripz
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
zauba.io
zgrab