360Spider
404enemy
Acunetix
ADmantX
AiHitBot
Aipbot
Asterias
Backlink-Ceck
BackStreet
Battleztar Bazinga
BBBike
BDFetch
Bigfoot
Bitacle
Black Hole
BLEXBot
Blow
BlowFish
Boardreader
BotALot
Brandprotect
BuiltBotTough
Bullseye
BunnySlippers
Cegbfeieh
CherryPicker
Claritybot
Cloud mapping
coccocbot-web
com.plumanalytics
CopyRightCheck
Copyscape
CrunchBot
CSHttp
Curious
DatabaseDriverMysqli
Devil
Digincore
DIIbot
Discoverybot
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Dragonfly
Drip
DSearch
Ecxi
EMail Siphon
EMail Wolf
EroCrawler
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
facebookscraper
FDM
FHscan
Freeuploader
GalaxyBot
Genieo
GermCrawler
Getintent
GetWeb
Gigablast
Gigabot
Gotit
Grabber
GrabNet
GrapeFX
Harvest
Havij
HMView
Humanlinks
Id-search
IlseBot
Intelliseek
InterGET
Internet Ninja
ips-agent
IRLbot
Iskanie
JamesBOT
JennyBot
JetCar
JikeSpider
JOC Web Spider
Joomla
Jorgee
Kozmosbot
LeechGet
LinkextractorPro
LinkpadBot
LinqiaScrapeBot
Litemage_walker
LNSpiderguy
Ltx71
lwp-request
lwp-trivial
Majestic12
Majestic SEO
MarkMonitor
Masscan
Mass Downloader
Mata Hari
MauiBot
meanpathbot
Meanpathbot
Mediatoolkitbot
mediawords
MegaIndex.ru
Metauri
Microsoft Data Access
Mister PiX
Mojeek
Mr.4x3
MSFrontPage
muhstik-scan
Name Intelligence
Nameprotect
Navroad
Needle
NetAnts
Netcraft
netEstate NE Crawler
NetMechanic
Nettrack
NICErsPRO
Niki-bot
Nimbostratus
Ninja
Nmap
Nutch
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
PageScorer
Pandalytics
Papa Foto
PECL::HTTP
PeoplePal
Picscout
PictureFinder
Pi-Monster
PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP
Probethenet
ProWebWalker
Psbot
PyCurl
RankActiveLinkBot
RealDownload
Recorder
RedesScrapy
Ripper
RocketCrawler
s1z.ru
ScanAlert
Scanbot
ScoutJet
ScreenerBot
Searchestate
SearchmetricsBot
SEOkicks
SEOkicks-Robot
seoscanners
SeoSiteCheckup
SEOstats
serpstatbot
Shodan
Siphon
SISTRIX
Sitebeam
SiteExplorer
Sitevigil
SmartDownload
SMTBot
Snake
Snapbot
Sociscraper
Sogou web spider
Sosospider
sp_auditbot
Spbot
Sqlmap
Sqlworm
Steeler
Stripper
SurveyBot
Suzuran
Swiftbot
Szukacz
T8Abot
tAkeOut
Telesphoreo
Telesphorep
The Intraformant
TightTwatBot
Titan
Toata
Toweyabot
Trendictionbot
True_Robot
Turingos
TurnitinBot
Twice
URLy Warning
VeriCiteCrawler
Virusdie
Voil
Wallpapers/3.0
WallpapersHD
WASALive-Bot
Web Collage
WEBDAV
WebEnhancer
Web Enhancer
WebGo IS
WebImageCollector
webmeup-crawler
Web Pix
WebReaper
WebSauger
WebsiteExtractor
Website Quester
WebStripper
WeSEE
Whack
Whacker
Whatweb
Who.is Bot
WinHTTrack
WISENutbot
Wotbox
WWW-Collector-E
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
zauba.io
zgrab
ZyBorg