360Spider
404checker
404enemy
Abonti
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alligator
Apexoo
Aspiegel
autoemailspider
AwarioRssBot
Backlink-Ceck
BacklinkCrawler
Barkrowler
BBBike
BDCbot
BDFetch
BetaBot
Bigfoot
Bitacle
Blackboard
BlackWidow
BlowFish
Boardreader
BotALot
Brandprotect
Brandwatch
BuiltWith
BuzzSumo
Calculon
CCBot
CheTeam
ChinaClaw
Chlooe
Cliqzbot
coccocbot-web
com.plumanalytics
Copier
CopyRightCheck
Craftbot
crawler4j
Curious
Custo
DatabaseDriverMysqli
Devil
Digincore
DIIbot
Dirbuster
Disco
DittoSpyder
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
Drip
Ebingbong
Ecxi
EirGrabber
EMail Wolf
Evil
Extractor
EyeNetIE
Fimap
Foobot
Freeuploader
FrontPage
Fyrebot
GermCrawler
Getintent
GetWeb
Gigablast
G-i-g-a-b-o-t
Gotit
GoZilla
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GridBot
GT::WWW
HaosouSpider
Harvest
Havij
Hloader
HTMLparser
HTTrack
IDBot
IlseBot
Image Fetch
Image Sucker
IndeedBot
InfoTekies
Intelliseek
InterGET
ips-agent
IRLbot
JamesBOT
Jbrofuzz
JennyBot
JetCar
Kenjin Spider
Kozmosbot
Lanshanbot
Lftp
Libwhisker
Likse
LinkWalker
LinqiaMetadataDownloaderBot
Lmspider
Ltx71
lwp-request
lwp-trivial
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkWatch
Masscan
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
mediawords
MicroMessenger
Microsoft URL Control
Mister PiX
MJ12bot
MSFrontPage
Msrabot
Name Intelligence
Nameprotect
NearSite
NetAnts
Netcraft
netEstate NE Crawler
NetMechanic
Nettrack
Net Vampire
NextGenSearchBot
Nibbler
NICErsPRO
Niki-bot
Ninja
Nutch
Offline Explorer
OnCrawl
Openfind
Openvas
PageAnalyzer
Page Analyzer
PageGrabber
page scorer
PageScorer
Pandalytics
Papa Foto
Pavuk
PECL::HTTP
PeoplePal
PHPCrawl
Pimonster
Pi-Monster
Pixray
Probethenet
ProPowerBot
ProWebWalker
QueryN Metasearch
RankFlex
RankingBot2
Rankivabot
Reaper
RedesScrapy
RepoMonkey
RSSingBot
ScanAlert
Scrapy
Screaming
SearchmetricsBot
SEOkicks
SEOlyticsCrawler
SeoSiteCheckup
Shodan
SISTRIX
Sitebeam
SiteCheckerBotCrawler
sitechecker.pro
SiteSnagger
SlySearch
Snoopy
Sociscraper
Sogou web spider
Spanner
sp_auditbot
SputnikBot
Sqlmap
Sqworm
Stripper
SurveyBot
Suzuran
T0PHackTeam
Teleport
Telesoft
The Intraformant
Thumbor
TightTwatBot
Titan
trendiction.com
True_Robot
Turingos
Turnitin
TurnitinBot
TwengaBot
URLy Warning
URLy.Warning
Vacuum
VCI
WASALive-Bot
WebAuto
WebBandit
WebCollage
Web Collage
WebCopier
WebEnhancer
Web Enhancer
Web Fetch
WebGo IS
WebLeacher
WebmasterWorldForumBot
WebPix
WebSauger
Webshag
WebsiteQuester
Webster
WebStripper
WebSucker
Whacker
WinHTTrack
WiseGuys Robot
WISENutbot
Wonderbot
WWW-Collector-E
WWW::Mechanize
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
Zauba
Zitebot
ZmEu
ZumBot