404checker
404enemy
ADmantX
AIBOT
AiHitBot
Alexibot
Alligator
AllSubmitter
AlphaBot
Anarchie
Anarchy
Anarchy99
Ankit
Anthill
archive.org_bot
arquivo.pt
ASPSeek
Asterias
AwarioSmartBot
BackDoorBot
Backlink-Ceck
BackStreet
BackWeb
Badass
BatchFTP
BDFetch
BetaBot
Bitacle
Black Hole
BLEXBot
BlowFish
Brandwatch
Buck
Buddy
BunnySlippers
CazoodleBot
CCBot
Cegbfeieh
check1.exe
CheeseBot
ChinaClaw
Chlooe
Claritybot
coccocbot-web
Cocolyzebot
Cogentbot
cognitiveseo
CopyRightCheck
Copyscape
Cosmos
crawler.feedback
crawl.sogou.com
Curious
DatabaseDriverMysqli
DBLBot
Deusu
Digincore
DIIbot
Dirbuster
Disco
Discoverybot
DomainCrawler
DomainSigmaCrawler
DomCopBot
Dotbot
Download Wonder
Dragonfly
Drip
DTS Agent
EirGrabber
EMail Wolf
Evil
Exabot
Express WebPictures
Ezooms
Fimap
FlashGet
Flunky
FrontPage
FyberSpider
Gotit
Grabber
GrabNet
GrapeshotCrawler
Harvest
Havij
HEADMasterSEO
HMView
HTTP::Lite
HTTrack
Iblog
IDBTE4M
Id-search
Image Fetch
InfoNaviRobot
Intelliseek
InternetSeer
ips-agent
IRLbot
isitwp.com
Iskanie
Jbrofuzz
JikeSpider
Joomla
Keyword Density
Kinza
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LeechGet
Lftp
Lightspeedsystems
Linkbot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
Litemage_walker
LNSpiderguy
Ltx71
LWP::Simple
lwp-trivial
Mail.RU_Bot
Mass Downloader
Meanpathbot
mediawords
MFC_Tear_Sample
Microsoft URL Control
MIDown tool
MIIxpc
MJ12bot
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Navroad
NetAnts
NetLyzer
NetMechanic
NetZIP
Nikto
Ninja
Nmap
NPbot
Nutch
oBot
Offline Explorer
Openfind
OpenLinkProfiler
OpenVAS
OPPO A33
OrangeSpider
OutfoxBot
Page Analyzer
page scorer
Panscient
pcBrowser
PECL::HTTP
PeoplePal
Petalbot
Picsearch
Probethenet
ProPowerBot
PxBroker
PyCurl
RankFlex
RankingBot
RealDownload
Reaper
RebelMouse
Re-re
ripz
Rogerbot
SalesIntelligent
scalaj-http
Scanbot
scan.lol
Screaming
ScreenerBot
SearchmetricsBot
SentiBot
SeobilityBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SeoSiteCheckup
Shodan
SISTRIX
sitechecker.pro
siteripz
SiteSnagger
Site Sucker
Sitevigil
SlySearch
SmartDownload
SMTBot
Snapbot
SocialRankIOBot
sogouspider
Sogou web spider
Sottopop
SpaceBison
Spanner
Spbot
Spinn3r
Sqlmap
Stripper
Sucker
Sucuri
SuperHTTP
SurveyBot
Suzuran
Telesoft
Thumbor
TightTwatBot
Tracemyfile
Trendiction
True_Robot
TwengaBot
Twice
Upflow
URLy Warning
Vacuum
VeriCiteCrawler
Virusdie
Webalta
Web Auto
Web Collage
WebGo IS
WebImageCollector
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
Web Pix
WebReaper
WebsiteExtractor
WebsiteQuester
Webster
WebStripper
WeSEE
Whacker
WinHTTrack
Woobot
Wotbox
WWW-Collector-E
WWW-Mechanize
Zade
zauba.io
Zitebot
ZoomBot