404checker
80legs
Aboundex
Aboundexbot
Acunetix
AhrefsBot
Aipbot
Anarchie
AwarioSmartBot
BBBike
BLEXBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Badass
Battleztar Bazinga
Bitacle
Black Hole
BlackWidow
Boardreader
Bolt
Brandprotect
Brandwatch
CATExplorador
CCBot
Calculon
CazoodleBot
CensysInspect
CheTeam
CheeseBot
ChinaClaw
Cocolyzebot
Cogentbot
Collector
Copier
Crescent
CrunchBot
Curious
Custo
DBLBot
DatabaseDriverMysqli
Deusu
Devil
Dirbuster
Discoverybot
Dispatch
DomainSigmaCrawler
Domains Project
Dotbot
Download Wonder
Dragonfly
ECCP/1.0
EMail Siphon
EasyDL
Ebingbong
EirGrabber
Exabot
Express WebPictures
ExtLinksBot
Extreme Picture Finder
Fimap
Firefox/7.0
FlashGet
Flunky
FrontPage
GalaxyBot
Genieo
GetRight
Getintent
Go!Zilla
Go-Ahead-Got-It
Gotit
GrabNet
Grafula
GridBot
HTMLparser
HTTP::Lite
Haansoft
HaosouSpider
Havij
Hloader
Humanlinks
HybridBot
IDBTE4M
IDBot
InfoNaviRobot
InterGET
JamesBOT
Jetty
JikeSpider
Joomla
Jorgee
Jyxobot
Kinza
Kozmosbot
LNSpiderguy
Lanshanbot
Larbin
LeechGet
Lightspeedsystems
Likse
LinkScan
LinkWalker
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
Lipperhey
Lmspider
MIDown tool
MJ12bot
MQQBrowser
Mag-Net
Mail.RU_Bot
Majestic12
Mass Downloader
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft URL Control
Mojeek
Morfeus Fucking Scanner
Musobot
Name Intelligence
Nameprotect
NearSite
Nessus
Net Vampire
NetSpider
NetZIP
Nettrack
NextGenSearchBot
Nibbler
Nikto
Nimbostratus
Offline Explorer
OpenVAS
Openvas
OutfoxBot
PHPCrawl
PageScorer
Pandalytics
Pavuk
PeoplePal
Pi-Monster
Picsearch
Pixray
Psbot
PxBroker
PyCurl
QueryN Metasearch
Quick-Crawler
RankFlex
RankingBot2
RankurBot
Reaper
RepoMonkey
Ripper
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOprofiler
SMTBot
SalesIntelligent
Scanbot
ScoutJet
Scrapy
SemrushBot
Seomoz
Shodan
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
Sitebeam
Siteimprove
SlySearch
SmartDownload
Snoopy
Sogou web spider
SputnikBot
Sqlmap
Sqlworm
Sqworm
Sucker
SuperHTTP
SurveyBot
Suzuran
Swiftbot
T8Abot
Telesoft
TheNomad
TightTwatBot
Toweyabot
Turingos
TurnitinBot
Typhoeus
URLy Warning
VelenPublicWebCrawler
VeriCiteCrawler
Voil
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Fetch
WebCopier
WebEnhancer
WebGo IS
WebSucker
WebmasterWorldForumBot
Website Quester
WebsiteQuester
Whack
Who.is Bot
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
Xenu
YoudaoBot
Zeus
ZmEu
ZoomBot
ZumBot
check1.exe
clark-crawler
coccocbot-web
crawl.sogou.com
crawler.feedback
evc-batch
facebookscraper
ips-agent
isitwp.com
lwp-request
muhstik-scan
netEstate NE Crawler
plumanalytics
polaris version
satoristudio.net
scalaj-http
scan.lol
serpstatbot
sexsearcher
sp_auditbot
trendiction.de
ubermetrics-technologies.com
webprosbot
zauba.io