404enemy
ADmantX
ALittle Client
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
Alligator
Anarchy
Ankit
Apexoo
AwarioRssBot
BDCbot
BLEXBot
Backlink-Ceck
Bandit
BatchFTP
BlackWidow
Bolt
Brandwatch
Buck
BuiltBotTough
BunnySlippers
CODE87
CSHttp
CazoodleBot
Cegbfeieh
CensysInspect
CheTeam
Cocolyzebot
Cogentbot
Collector
CopyRightCheck
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
Crescent
Curious
Custo
DataCha0s
DatabaseDriverMysqli
Demon
Devil
Digincore
DnyzBot
DomCopBot
DomainSigmaCrawler
DomainStatsBot
Dotbot
Dragonfly
EMail Siphon
Ebingbong
EirGrabber
Evil
ExtLinksBot
Extreme Picture Finder
EyeNetIE
Ezooms
FDM
Fimap
Firefox/7.0
FlashGet
Flunky
Freeuploader
FrontPage
Fyrebot
GalaxyBot
Genieo
GetRight
Go-Ahead-Got-It
Grafula
GrapeFX
GrapeshotCrawler
HTTP::Lite
HaosouSpider
Harvest
Havij
Humanlinks
IDBTE4M
IDBot
Iblog
Id-search
IlseBot
Image Fetch
Indy Library
InfoNaviRobot
InternetSeer
JamesBOT
JennyBot
JikeSpider
Jorgee
Keybot Translation-Search-Machine
LNSpiderguy
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
LieBaoFast
LinkScan
LinkWalker
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
MFC_Tear_Sample
MIIxpc
MSFrontPage
Majestic12
MarkMonitor
MarkWatch
Mass Downloader
MauiBot
Mb2345Browser
MicroMessenger
Microsoft Data Access
Minefield
Mister PiX
Mojeek
MolokaiBot
Musobot
NICErsPRO
Nameprotect
NearSite
NetSpider
NetZIP
Netcraft
Nibbler
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Nuclei
Nutch
Offline Explorer
Offline Navigator
OrangeBot
OrangeSpider
PECL::HTTP
PeoplePal
Pi-Monster
Picscout
Picsearch
Pu_iN
QueryN Metasearch
RSSingBot
RankFlex
RankingBot
Rankivabot
RealDownload
RebelMouse
RepoMonkey
Ripper
SBIder
SEOkicks-Robot
SEOprofiler
Scrapy
Searchestate
Seekport
SemrushBot
SentiBot
Seomoz
Siphon
Site Sucker
SiteExplorer
SiteLockSpider
SiteSnagger
SiteSucker
Sitevigil
SmartDownload
Snake
Sociscraper
SpaceBison
Spammen
Sqlmap
Sqlworm
Sqworm
SuperBot
SuperHTTP
Suzuran
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
TheNomad
Thumbor
Titan
Toata
Tracemyfile
Trendiction
TwengaBot
VB Project
Vacuum
Vagabondo
VeriCiteCrawler
Voil
WEBDAV
WISENutbot
WPScan
WWW-Mechanize
Wallpapers/3.0
Web Enhancer
Web Pix
WebCollage
WebImageCollector
WebLeacher
WebSauger
WebStripper
WebWhacker
Webshag
Website Quester
WebsiteExtractor
Whacker
Widow
Wonderbot
Wprecon
Xenu
YoudaoBot
Zauba
Zermelo
ZmEu
arquivo.pt
autoemailspider
backlink-check
coccocbot
crawler.feedback
crawler4j
eCatch
facebookscraper
heritrix
isitwp.com
iubenda-radar
linkdexbot
lwp-request
meanpathbot
mediawords
muhstik-scan
oBot
seoscanners
seostar
sexsearcher
ubermetrics-technologies.com
voyagerx.com
webpros.com
zgrab