404checker
404enemy
Aboundex
AhrefsBot
AiHitBot
Aipbot
Alexibot
Anarchie
Anarchy
Ankit
Anthill
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BDCbot
BackDoorBot
BacklinkCrawler
Badass
Bandit
BlackWidow
Blackboard
Blow
Boardreader
Buck
BunnySlippers
CATExplorador
CCBot
CazoodleBot
Cegbfeieh
CheTeam
Chlooe
Cliqzbot
Collector
CopyRightCheck
Copyscape
Custo
DBLBot
DSearch
DTS Agent
DataCha0s
Demon
Deusu
Discobot
Discoverybot
DittoSpyder
DomainAppender
Domains Project
Drip
EMail Siphon
EMail Wolf
EasyDL
Ecxi
Express WebPictures
Extractor
ExtractorPro
EyeNetIE
Ezooms
FDM
FemtosearchBot
FlashGet
Flunky
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
GetRight
GetWeb
Getintent
Go-Ahead-Got-It
GoZilla
Grafula
GrapeFX
HTTrack
Harvest
Havij
Hloader
HybridBot
IRLbot
Iblog
Image Sucker
InterGET
Iria
IstellaBot
JamesBOT
Jbrofuzz
Jorgee
LNSpiderguy
Lanshanbot
LexiBot
LibWeb
LieBaoFast
Lightspeedsystems
Likse
Linkbot
Linkdexbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
MIDown tool
MIIxpc
MTRobot
Mag-Net
Magnet
Majestic SEO
Majestic12
Masscan
Mata Hari
Mediatoolkitbot
Metauri
Microsoft URL Control
Mojeek
Mojolicious
Mozlila
NICErsPRO
NPbot
Nameprotect
Navroad
NetLyzer
NetMechanic
NetSpider
Nettrack
Nibbler
Niki-bot
Nikto
Nmap
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
OutclicksBot
PECL::HTTP
PageAnalyzer
PageGrabber
Papa Foto
Picscout
PictureFinder
Pimonster
PleaseCrawl
ProPowerBot
Psbot
Pump
Quick-Crawler
RankActive
RankActiveLinkBot
Rankivabot
RealDownload
RebelMouse
Recorder
Ripper
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SMTBot
ScanAlert
SearchmetricsBot
SeoSiteCheckup
Shodan
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Sitebeam
Siteimprove
SlySearch
Snapbot
Sogou web spider
Sosospider
Spammen
SpankBot
Spanner
Sqlworm
Sqworm
Steeler
Sucker
SurveyBot
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesoft
TheNomad
Thumbor
Toweyabot
Trendiction
Trendictionbot
TurnitinBot
TwengaBot
Typhoeus
Upflow
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
VoidEYE
Voil
WBSearchBot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WeSEE
Web Enhancer
Web Fetch
Web Fuck
WebBandit
WebCollage
WebFetch
WebFuck
WebGo IS
WebLeacher
WebPix
WebZIP
Webalta
Website Quester
WebsiteQuester
Whatweb
Widow
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
ZmEu
ZoomBot
backlink-check
cognitiveseo
crawl.sogou.com
domainsproject.org
gopher
instabid
internetVista monitor
ips-agent
isitwp.com
mediawords
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
plumanalytics
polaris version
ripz
s1z.ru
scalaj-http
scan.lol
seobility
serpstatbot
sogouspider
sp_auditbot
zauba.io