360Spider
404checker
404enemy
ADmantX
ALittle Client
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Aipbot
AllSubmitter
Alligator
AlphaBot
Ankit
Anthill
Apexoo
Asterias
Attach
AwarioRssBot
BDFetch
BackStreet
BackWeb
Bandit
Barkrowler
BetaBot
Bigfoot
Bitacle
Boardreader
Brandwatch
Buddy
BuiltBotTough
Bullseye
BuzzSumo
CODE87
CheTeam
CheeseBot
Citoid
Cloud mapping
Cocolyzebot
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Curious
DIIbot
DataCha0s
Demon
Deusu
DigitalPebble
Dirbuster
Discoverybot
Dispatch
DnyzBot
DomCopBot
DomainSigmaCrawler
Download Wonder
EMail Wolf
Ebingbong
EroCrawler
Evil
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FDM
FHscan
Foobot
Freeuploader
FrontPage
G-i-g-a-b-o-t
Genieo
GetRight
Go-Ahead-Got-It
Gotit
GrabNet
Grabber
GrapeshotCrawler
GridBot
HMView
HTTrack
Haansoft
HaosouSpider
Heritrix
Hloader
HonoluluBot
IRLbot
Image Sucker
InfoNaviRobot
InterGET
JamesBOT
JetCar
Jorgee
JustView
Jyxobot
Kenjin Spider
Larbin
Leap
LeechFTP
Libwhisker
LinkWalker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
MQQBrowser
MSIECrawler
Mag-Net
Magnet
Majestic12
MarkMonitor
Mass Downloader
Metauri
Microsoft Data Access
Moblie Safari
Mojeek
Msrabot
Navroad
NetAnts
NetMechanic
Nettrack
Netvibes
NextGenSearchBot
Offline Explorer
OnCrawl
OrangeBot
OutclicksBot
PECL::HTTP
PageScorer
PictureFinder
Pimonster
Pixray
Pockey
Pu_iN
PxBroker
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
Re-re
Reaper
RepoMonkey
RocketCrawler
Rogerbot
SEOkicks
SISTRIX
SMTBot
ScanAlert
Scrapy
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
Seomoz
SiteLockSpider
SiteSnagger
SiteSucker
Siteimprove
Sitevigil
SlySearch
Snoopy
Sottopop
Spanner
SputnikBot
Sqlworm
SuperBot
SurveyBot
Suzuran
T0PHackTeam
T8Abot
Teleport
TeleportPro
Telesoft
Telesphorep
TheNomad
Titan
Toata
Trendiction
Trendictionbot
Turnitin
Twice
URLy Warning
URLy.Warning
Upflow
Vagabondo
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
WWW-Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Auto
Web Enhancer
Web Sauger
WebAuto
WebCollage
WebFetch
WebGo IS
WebPix
WebSauger
WebWhacker
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Whatweb
Widow
WiseGuys Robot
Woobot
Wotbox
Wprecon
Zade
ZoomBot
ZoominfoBot
backlink-check
coccocbot-web
crawl.sogou.com
dataforseo.com
demandbase-bot
evc-batch
instabid
internetVista monitor
isitwp.com
iubenda-radar
lwp-request
magpie-crawler
muhstik-scan
pcBrowser
plumanalytics
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
seobility
seostar
serpstatbot
sitechecker.pro
sogouspider
sp_auditbot
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webpros.com
x09Mozilla