360Spider
404checker
404enemy
ASPSeek
AfD-Verbotsverfahren
AlphaBot
Anarchie
Asterias
BBBike
Backlink-Ceck
Badass
Barkrowler
BatchFTP
BetaBot
Bigfoot
Bitacle
BlackWidow
Blow
BlowFish
Boardreader
Bolt
BuiltBotTough
CheeseBot
CherryPicker
Chlooe
Cogentbot
Collector
Crawling at Home Project
CyotekWebCopy
DBLBot
Deusu
Digincore
Disco
DomCopBot
DomainSigmaCrawler
Domains Project
Dragonfly
EMail Siphon
EMail Wolf
Ebingbong
Ecxi
EirGrabber
Evil
Exabot
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
FrontPage
FyberSpider
GT::WWW
Gigabot
GrabNet
GrapeFX
GrapeshotCrawler
HTTP::Lite
Haansoft
IDBot
Id-search
Image Sucker
Indy Library
InfoTekies
Intelliseek
InterGET
Iskanie
JamesBOT
JikeSpider
JustView
Kozmosbot
LNSpiderguy
Lanshanbot
Leap
LeechGet
LibWeb
LieBaoFast
LinkScan
Linkdexbot
LinkextractorPro
LinkpadBot
LinqiaScrapeBot
Lmspider
Ltx71
MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
Mata Hari
Mediatoolkitbot
Metauri
Microsoft Data Access
Microsoft URL Control
Mister PiX
Musobot
NearSite
Needle
NetMechanic
Nettrack
Netvibes
Nibbler
Niki-bot
Nikto
Nimbostratus
Ninja
Not
Nuclei
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
PageScorer
Pandalytics
Panscient
Papa Foto
Pi-Monster
Picscout
Picsearch
Pimonster
Pockey
ProWebWalker
Pu_iN
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
Re-re
RealDownload
RebelMouse
Recorder
RocketCrawler
Rogerbot
SEOkicks-Robot
SalesIntelligent
ScanAlert
Scanbot
Scrapy
Searchestate
Semrush
SeobilityBot
Siphon
SiteSucker
SlySearch
SmartDownload
SocialRankIOBot
Sogou web spider
Sosospider
Sottopop
Spanner
Spbot
Spinn3r
SputnikBot
Sqworm
Steeler
SuperBot
SurveyBot
Suzuran
Szukacz
T8Abot
TeleportPro
Telesoft
Telesphorep
Thumbor
Toata
Trendiction
True_Robot
Twice
Upflow
V-BOT
Vacuum
VelenPublicWebCrawler
Voil
WPScan
WWW-Mechanize
WWW::Mechanize
WeSEE
Web Auto
Web Enhancer
Web Fuck
Web Pix
Web Sauger
Web Sucker
WebAuto
WebCopier
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebPix
WebSauger
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Webster
Whack
Whacker
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Xenu
YoudaoBot
Zermelo
arquivo-web-crawler
check1.exe
clark-crawler
cognitiveseo
com.plumanalytics
crawl.sogou.com
dataforseo.com
demandbase-bot
evc-batch
heritrix
isitwp.com
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
netEstate NE Crawler
page scorer
pcBrowser
plumanalytics
ripz
seobility
seocompany.store
seoscanners
serpstatbot
sexsearcher
siteripz
sogouspider
spyfu
sysscan
tAkeOut
x22Mozilla
zauba.io
zgrab