360Spider
404checker
404enemy
Abonti
Aboundexbot
Acunetix
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
AllSubmitter
Anarchie
ASPSeek
Asterias
Attach
autoemailspider
BackDoorBot
BacklinkCrawler
Bandit
Barkrowler
BatchFTP
BetaBot
Bigfoot
Bitacle
BlackWidow
BlowFish
Bolt
Brandprotect
Buddy
BuiltBotTough
CATExplorador
CCBot
Cegbfeieh
CheeseBot
CherryPicker
Cliqzbot
Cloud mapping
Collector
Copier
CopyRightCheck
Copyscape
crawler4j
crawler.feedback
crawl.sogou.com
Crescent
Curious
Custo
DatabaseDriverMysqli
DataCha0s
Demon
Deusu
Devil
Digincore
DigitalPebble
DIIbot
Dirbuster
Disco
Discobot
Discoverybot
DnyzBot
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Download Wonder
ECCP/1.0
evc-batch
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
FemtosearchBot
Firefox/7.0
FlashGet
Foobot
Freeuploader
FrontPage
GermCrawler
Getintent
Gigablast
Gigabot
G-i-g-a-b-o-t
Go!Zilla
GrapeFX
Haansoft
Harvest
HMView
HTTP::Lite
HTTrack
IDBot
IlseBot
Image Fetch
instabid
Internet Ninja
ips-agent
Iskanie
IstellaBot
Jbrofuzz
JetCar
JikeSpider
JOC Web Spider
JustView
Kozmosbot
Lanshanbot
LeechGet
LexiBot
LibWeb
Likse
LinkpadBot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Ltx71
lwp-request
lwp-trivial
Mail.RU_Bot
MarkMonitor
Masscan
MegaIndex.ru
MIDown tool
MIIxpc
Mister PiX
MJ12bot
MS Web Services Client Protocol
muhstik-scan
Musobot
Needle
NetAnts
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
Nettrack
Net Vampire
NetZIP
Nibbler
NICErsPRO
Niki-bot
Nmap
NPbot
Octopus
OpenVAS
OrangeBot
PageGrabber
page scorer
Panscient
pcBrowser
PECL::HTTP
PeoplePal
PictureFinder
Pimonster
Pixray
Pockey
ProWebWalker
PxBroker
Quick-Crawler
RankActive
RankingBot
RankingBot2
RebelMouse
RedesScrapy
RepoMonkey
Ripper
SBIder
ScanAlert
Scanbot
Scrapy
Searchestate
SearchmetricsBot
SEOlyticsCrawler
SEOprofiler
SeoSiteCheckup
Siphon
Sitebeam
SiteExplorer
Siteimprove
SiteLockSpider
Site Sucker
Sitevigil
Snoopy
Sociscraper
Sogou web spider
Spanner
sp_auditbot
Spinn3r
SputnikBot
Sqlworm
Steeler
Sucuri
Swiftbot
Szukacz
T0PHackTeam
T8Abot
tAkeOut
Teleport
Telesphoreo
TightTwatBot
Titan
Tracemyfile
Trendiction
Trendictionbot
trendiction.com
Turnitin
TurnitinBot
TwengaBot
Twice
UnisterBot
Upflow
URLy Warning
URLy.Warning
VB Project
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
Wallpapers/3.0
WASALive-Bot
WBSearchBot
Webalta
Web Auto
Web Collage
WebEnhancer
WebFetch
WebImageCollector
webmeup-crawler
Web Pix
Web Sauger
WebsiteQuester
Webster
WebStripper
Web Sucker
WebZIP
WeSEE
Whack
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
WISENutbot
Woobot
Wprecon
WWW::Mechanize
xpymep1.exe
zauba.io
Zermelo
Zeus
zgrab