404checker
404enemy
Abonti
Aboundex
ADmantX
AfD-Verbotsverfahren
AIBOT
Alexibot
Alligator
Apexoo
archive.org_bot
autoemailspider
Backlink-Ceck
BatchFTP
BDFetch
Bigfoot
Bitacle
Blackboard
Black Hole
BlackWidow
BLEXBot
Bolt
Brandprotect
Buddy
BuiltWith
CazoodleBot
CCBot
CheeseBot
CherryPicker
CheTeam
coccocbot-web
Cogentbot
Collector
Cosmos
crawler4j
crawler.feedback
crawl.sogou.com
Crescent
CSHttp
Curious
DatabaseDriverMysqli
DataCha0s
DBLBot
demandbase-bot
Devil
DigitalPebble
DIIbot
Disco
Discoverybot
DomainAppender
Dotbot
Dragonfly
DSearch
DTS Agent
Ebingbong
ECCP/1.0
EirGrabber
EMail Siphon
EMail Wolf
evc-batch
Exabot
Extreme Picture Finder
FHscan
FlashGet
Foobot
Freeuploader
FrontPage
Fyrebot
Genieo
GermCrawler
Getintent
GetWeb
Gigabot
Gotit
GoZilla
GrabNet
GrapeFX
Haansoft
HaosouSpider
Havij
Heritrix
Hloader
HMView
HTMLparser
HTTP::Lite
Humanlinks
HybridBot
Iblog
Id-search
Image Fetch
Indy Library
InterGET
Internet Ninja
InternetSeer
ips-agent
Iskanie
IstellaBot
Jbrofuzz
JikeSpider
Jorgee
Kozmosbot
Lanshanbot
Larbin
LexiBot
Lftp
Libwhisker
Likse
LinkWalker
Lipperhey Spider
Lmspider
LNSpiderguy
lwp-request
LWP::Simple
Mag-Net
Majestic SEO
Majestic-SEO
MarkWatch
Masscan
Mass Downloader
Mata Hari
MauiBot
meanpathbot
MeanPath Bot
Mediatoolkitbot
Metauri
Microsoft URL Control
MIIxpc
MJ12bot
Mojeek
MS Web Services Client Protocol
Navroad
NetMechanic
Nettrack
Net Vampire
Nibbler
NimbleCrawler
Nimbostratus
Ninja
NPbot
Octopus
Offline Explorer
Openfind
OpenLinkProfiler
OpenVAS
OrangeBot
PageAnalyzer
PageGrabber
page scorer
Panscient
Papa Foto
PECL::HTTP
PHPCrawl
Pimonster
POE-Component-Client-HTTP
Psbot
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankingBot
Rankivabot
RealDownload
Reaper
RedesScrapy
RocketCrawler
Rogerbot
SBIder
ScanAlert
scan.lol
ScoutJet
ScreenerBot
SearchmetricsBot
SemrushBot
SEOkicks
Seomoz
SEOprofiler
seoscanners
SEOstats
Shodan
Siphon
SiteExplorer
Siteimprove
Site Sucker
Snake
Snapbot
Snoopy
SocialRankIOBot
sogouspider
Sosospider
SpaceBison
sp_auditbot
spyfu
Sqlmap
Sqlworm
Steeler
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
T0PHackTeam
Thumbor
TightTwatBot
Toata
Trendictionbot
trendiction.de
Turnitin
UnisterBot
URLy Warning
Vacuum
Vagabondo
VoidEYE
Voil
Voltron
WallpapersHD
WASALive-Bot
Web Auto
WebCopier
WEBDAV
WebEnhancer
Web Fetch
WebImageCollector
WebmasterWorldForumBot
webmeup-crawler
WebPix
Webshag
WebsiteQuester
Website Quester
WebStripper
Web Sucker
Whack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Wprecon
WWW-Mechanize
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zermelo
zgrab
ZmEu
ZumBot
ZyBorg