404checker
Abonti
Aboundexbot
AIBOT
Aipbot
AllSubmitter
AlphaBot
Apexoo
archive.org_bot
Asterias
BackDoorBot
backlink-check
Badass
Bandit
Barkrowler
BBBike
BDCbot
BetaBot
Bigfoot
Bitacle
Blackboard
BlackWidow
BlowFish
Boardreader
Bolt
BotALot
Brandwatch
Buddy
Bullseye
BunnySlippers
BuzzSumo
Calculon
Cegbfeieh
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cliqzbot
coccocbot-web
cognitiveseo
com.plumanalytics
Copier
CopyRightCheck
Copyscape
Cosmos
crawler4j
crawl.sogou.com
CrunchBot
Custo
DataCha0s
Deusu
Digincore
DigitalPebble
DIIbot
Discoverybot
DomainCrawler
DomainStatsBot
Download Wonder
Drip
DTS Agent
Ebingbong
eCatch
ECCP/1.0
Ecxi
EMail Siphon
Exabot
facebookscraper
FemtosearchBot
Fimap
Firefox/7.0
Fyrebot
GalaxyBot
Genieo
GermCrawler
GetWeb
Gigablast
GrapeFX
GrapeshotCrawler
GridBot
GT::WWW
Havij
HEADMasterSEO
Heritrix
HTTP::Lite
HTTrack
Iblog
IDBot
IlseBot
Image Sucker
IndeedBot
InfoNaviRobot
InterGET
InternetSeer
internetVista monitor
Iria
IRLbot
JetCar
Joomla
Jorgee
Jyxobot
Kenjin Spider
Kozmosbot
Lanshanbot
LeechFTP
LeechGet
LexiBot
Libwhisker
Linkdexbot
LinkextractorPro
LinkScan
LinqiaMetadataDownloaderBot
Lipperhey
LNSpiderguy
lwp-request
LWP::Simple
lwp-trivial
Majestic SEO
Majestic-SEO
Mass Downloader
Mata Hari
mediawords
Microsoft Data Access
Microsoft URL Control
Mojeek
Morfeus Fucking Scanner
MSFrontPage
MS Web Services Client Protocol
muhstik-scan
Musobot
NetAnts
NetMechanic
NetSpider
Nettrack
Net Vampire
NICErsPRO
Nikto
NimbleCrawler
Nimbostratus
Nmap
oBot
Offline Explorer
OnCrawl
OpenVAS
OrangeBot
OutclicksBot
Page Analyzer
PageScorer
Pandalytics
Picsearch
Pimonster
Pixray
QueryN Metasearch
RankActive
RankurBot
RebelMouse
Recorder
RedesScrapy
Ripper
SalesIntelligent
SBIder
ScoutJet
Scrapy
Screaming
Semrush
SemrushBot
Seomoz
seoscanners
SeoSiteCheckup
SEOstats
Siphon
SISTRIX
Sitebeam
SiteLockSpider
SiteSucker
Snapbot
SocialRankIOBot
sogouspider
Sogou web spider
Sosospider
Sottopop
SpaceBison
SpankBot
sp_auditbot
SputnikBot
Sqlmap
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
SurveyBot
Suzuran
sysscan
T8Abot
TeleportPro
The Intraformant
Thumbor
Titan
Toata
trendiction.de
True_Robot
Turingos
Turnitin
TurnitinBot
Vagabondo
VB Project
VCI
Virusdie
VoidEYE
Voil
Voltron
Wallpapers/3.0
WallpapersHD
WASALive-Bot
WebAuto
Web Auto
WebCopier
WebEnhancer
Web Enhancer
WebFuck
Web Fuck
WebGo IS
WebImageCollector
WebLeacher
WebmasterWorldForumBot
WebsiteQuester
Webster
WebStripper
Web Sucker
WebWhacker
WebZIP
Whacker
Who.is Bot
Wonderbot
Wotbox
Wprecon
WPScan
WWW-Mechanize
WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zauba
zauba.io
zgrab
Zitebot
ZyBorg