404checker
404enemy
80legs
Abonti
Aboundex
Aboundexbot
ADmantX
AhrefsBot
AiHitBot
Alexibot
AlphaBot
archive.org_bot
arquivo.pt
backlink-check
BacklinkCrawler
Badass
Battleztar Bazinga
BDFetch
BetaBot
Blackboard
BlowFish
Boardreader
BotALot
BuiltBotTough
BunnySlippers
CATExplorador
CherryPicker
CheTeam
Chlooe
Cliqzbot
Cloud mapping
coccocbot-web
Cosmos
crawl.sogou.com
CrazyWebCrawler
DatabaseDriverMysqli
Deusu
Devil
DittoSpyder
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
DSearch
DTS Agent
Ebingbong
ECCP/1.0
Ecxi
EirGrabber
EroCrawler
evc-batch
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
facebookscraper
FDM
FHscan
FlashGet
FrontPage
Fyrebot
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
Grabber
GT::WWW
HaosouSpider
Harvest
Havij
HEADMasterSEO
HTTrack
Humanlinks
Iblog
Id-search
IlseBot
IndeedBot
InfoTekies
Intelliseek
InternetSeer
internetVista monitor
IstellaBot
Jetty
Jorgee
JustView
Jyxobot
Kenjin Spider
Keyword Density
Larbin
LeechFTP
Libwhisker
Lightspeedsystems
Linkdexbot
LinkpadBot
LinkScan
LinksManager
Lipperhey Spider
LNSpiderguy
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
Mata Hari
meanpathbot
mediawords
MFC_Tear_Sample
Microsoft Data Access
MIDown tool
MIIxpc
Mister PiX
MJ12bot
Mr.4x3
MSFrontPage
MSIECrawler
Msrabot
muhstik-scan
Needle
Netcraft
netEstate NE Crawler
NetLyzer
NetSpider
Net Vampire
Niki-bot
Nikto
Nmap
Nutch
oBot
Offline Explorer
Offline Navigator
Openfind
OpenLinkProfiler
OrangeSpider
OutfoxBot
PageGrabber
Papa Foto
Pavuk
PECL::HTTP
PHPCrawl
Picscout
PictureFinder
Pi-Monster
Pixray
PleaseCrawl
plumanalytics
Probethenet
ProPowerBot
ProWebWalker
Psbot
PxBroker
QueryN Metasearch
RankActiveLinkBot
RankingBot
RankingBot2
Reaper
RebelMouse
Recorder
RepoMonkey
Rogerbot
SBIder
Searchestate
Semrush
SemrushBot
SEOkicks
SEOkicks-Robot
seoscanners
SeoSiteCheckup
sexsearcher
Shodan
Siphon
SISTRIX
SiteExplorer
SiteSnagger
SiteSucker
SmartDownload
SocialRankIOBot
Sociscraper
sogouspider
Sogou web spider
Sottopop
SpankBot
sp_auditbot
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Steeler
Stripper
Surfbot
Suzuran
Swiftbot
sysscan
tAkeOut
TeleportPro
Telesoft
Telesphoreo
The Intraformant
TightTwatBot
Toata
trendiction.de
True_Robot
Turingos
TwengaBot
Twice
Upflow
URLy.Warning
VoidEYE
Voil
Wallpapers/3.0
WASALive-Bot
WBSearchBot
Webalta
WebAuto
Web Auto
WEBDAV
Web Fetch
Web Fuck
WebGo IS
WebImageCollector
WebLeacher
WebmasterWorldForumBot
WebPix
WebReaper
Web Sauger
Webshag
WebsiteQuester
Website Quester
Webster
WebStripper
Web Sucker
WebWhacker
Whack
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
Woobot
Wprecon
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Xaldon_WebSpider
Xenu
xpymep1.exe
Zade
zauba.io
Zermelo
Zeus
Zitebot
ZumBot