404checker
80legs
ADmantX
ASPSeek
Aboundex
Aboundexbot
Acunetix
AhrefsBot
Aipbot
Alexibot
AllSubmitter
Anarchy
Anarchy99
Aspiegel
Asterias
AwarioRssBot
BDCbot
BDFetch
Badass
Bandit
Barkrowler
BetaBot
Bigfoot
Bitacle
Blow
BotALot
Brandprotect
Buddy
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
Citoid
Cliqzbot
Collector
Copier
CopyRightCheck
Copyscape
Cosmos
Curious
Custo
DSearch
DTS Agent
Dispatch
DnBCrawler-Analytics
DomainSigmaCrawler
ECCP/1.0
EasyDL
EirGrabber
EroCrawler
ExtLinksBot
Extreme Picture Finder
EyeNetIE
FHscan
FemtosearchBot
Fimap
Fyrebot
GalaxyBot
Gotit
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HTTP::Lite
Havij
Hloader
Humanlinks
HybridBot
IDBTE4M
Id-search
IndeedBot
InternetSeer
Iskanie
JamesBOT
JetCar
Joomla
Jorgee
Jyxobot
Kinza
LWP::Simple
LeechGet
Libwhisker
Lightspeedsystems
LinkextractorPro
Lipperhey
MQQBrowser
MSFrontPage
MSIECrawler
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
Mass Downloader
Masscan
Mata Hari
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Minefield
Mister PiX
Mojeek
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Msrabot
Nameprotect
Needle
Nessus
Net Vampire
NetLyzer
Netcraft
Nettrack
NextGenSearchBot
Nikto
NimbleCrawler
Nimbostratus
Nmap
Not
Offline Explorer
Openfind
Openvas
OrangeSpider
OutclicksBot
PHPCrawl
PageGrabber
Panscient
Papa Foto
Petalbot
Picscout
Piepmatz
PleaseCrawl
Probethenet
Pump
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
ReGet
RebelMouse
Ripper
SBIder
SEOkicks-Robot
SMTBot
Scanbot
Scrapy
Screaming
SemanticJuice
Shodan
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitevigil
SlySearch
SmartDownload
Snake
Snoopy
SocialRankIOBot
Sogou web spider
Spammen
SpankBot
Spanner
Spbot
Spinn3r
Sqlworm
Sucker
Sucuri
SuperBot
Surfbot
SurveyBot
Suzuran
Swiftbot
T0PHackTeam
T8Abot
The Intraformant
Titan
Toata
Toweyabot
Trendictionbot
Turnitin
TurnitinBot
Typhoeus
URLy.Warning
UnisterBot
Upflow
Vagabondo
VidibleScraper
Virusdie
VoidEYE
Voltron
Wallpapers/3.0
WallpapersHD
Web Collage
Web Fetch
Web Fuck
WebCollage
WebFetch
WebImageCollector
WebSauger
Webalta
Webshag
Webster
Whack
WiseGuys Robot
Wonderbot
Wotbox
Wprecon
Xenu
Zermelo
Zitebot
ZoomBot
ZoominfoBot
adscanner
archive.org_bot
arquivo-web-crawler
backlink-check
cah.io.community
clark-crawler
coccocbot
cognitiveseo
dataforseo.com
eCatch
gopher
heritrix
internetVista monitor
linkdexbot
lwp-request
lwp-trivial
magpie-crawler
muhstik-scan
page scorer
polaris version
ripz
satoristudio.net
scalaj-http
scan.lol
siteripz
sogouspider
sysscan
trendiction.com
voyagerx.com
webmeup-crawler
x22Mozilla
xpymep1.exe