404checker
AIBOT
ALittle Client
Abonti
Acunetix
AfD-Verbotsverfahren
Aipbot
Alexibot
AlphaBot
Anthill
Asterias
BBBike
BDFetch
BLEXBot
BackStreet
BacklinkCrawler
Bandit
BetaBot
Bigfoot
Bitacle
Black Hole
Bolt
Brandprotect
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CODE87
Cegbfeieh
CheeseBot
Chlooe
Claritybot
Collector
CopyRightCheck
Copyscape
Curious
Custo
DBLBot
DIIbot
DataCha0s
Deusu
Disco
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainAppender
DomainSigmaCrawler
ECCP/1.0
EMail Wolf
Ebingbong
EirGrabber
Exabot
ExtLinksBot
EyeNetIE
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
Flunky
Foobot
Fyrebot
G-i-g-a-b-o-t
GetRight
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
Haansoft
HybridBot
IDBTE4M
IDBot
IRLbot
Id-search
IlseBot
Image Sucker
Indy Library
InfoTekies
InterGET
InternetSeer
IstellaBot
Jbrofuzz
JennyBot
JikeSpider
Jorgee
Keyword Density
LNSpiderguy
LWP::Simple
Lightspeedsystems
LinkScan
Linkdexbot
Lipperhey Spider
MQQBrowser
MSIECrawler
Mag-Net
Mail.RU_Bot
MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
Meanpathbot
MicroMessenger
Microsoft URL Control
Mojolicious
MolokaiBot
Morfeus Fucking Scanner
Msrabot
NICErsPRO
Name Intelligence
Nameprotect
Needle
NetMechanic
Niki-bot
Ninja
Not
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
PECL::HTTP
PageAnalyzer
PageGrabber
Pi-Monster
PictureFinder
PleaseCrawl
Pockey
ProWebWalker
Pump
Quick-Crawler
RankActiveLinkBot
Re-re
ReGet
RedesScrapy
RocketCrawler
Rogerbot
SEOkicks
SEOstats
SISTRIX
ScanAlert
Scanbot
ScreenerBot
Seekport
SemanticJuice
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
Site Sucker
Sitebeam
Sitevigil
Sociscraper
Spinn3r
Steeler
Stripper
Suzuran
Swiftbot
T8Abot
Telesphorep
The Intraformant
Titan
Toata
Trendiction
Trendictionbot
True_Robot
Turingos
TurnitinBot
Twice
Typhoeus
UnisterBot
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voil
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WWW-Mechanize
WWWOFFLE
Wallpapers
WeSEE
Web Enhancer
WebBandit
WebCollage
WebEnhancer
WebFetch
WebImageCollector
WebReaper
WebSauger
WebSucker
WebZIP
Webshag
WebsiteExtractor
Webster
Whacker
Wonderbot
Wotbox
Wprecon
Xaldon_WebSpider
Xenu
YoudaoBot
Zade
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZoomBot
ZoominfoBot
ZumBot
ZyBorg
adscanner
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
cah.io.community
check1.exe
clark-crawler
coccocbot
crawl.sogou.com
crawler.feedback
domainsproject.org
facebookscraper
gopher
mediawords
oBot
pcBrowser
plumanalytics
scalaj-http
seostar
serpstatbot
sexsearcher
sp_auditbot
spyfu
trendiction.com
webgains-bot
webpros.com
zauba.io
zgrab