360Spider
404checker
80legs
AIBOT
Abonti
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alexibot
Anarchie
Aspiegel
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackDoorBot
BackStreet
BacklinkCrawler
Bandit
Barkrowler
BetaBot
Bitacle
Blow
BlowFish
Buck
Buddy
BunnySlippers
CCBot
CODE87
Calculon
CazoodleBot
CheTeam
CheeseBot
ChinaClaw
Citoid
Cliqzbot
Cocolyzebot
Cogentbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
CyotekWebCopy
DTS Agent
DatabaseDriverMysqli
Devil
Disco
Dispatch
DomCopBot
DomainCrawler
Download Wonder
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
EirGrabber
EroCrawler
Evil
Exabot
ExtractorPro
Extreme Picture Finder
Ezooms
FHscan
FemtosearchBot
Fimap
Foobot
FrontPage
Fuzz
G-i-g-a-b-o-t
GT::WWW
Genieo
GermCrawler
Gigabot
Gotit
GrabNet
Grafula
GrapeshotCrawler
GridBot
Haansoft
HaosouSpider
Harvest
Havij
Hloader
IDBot
IRLbot
Image Fetch
Iria
JOC Web Spider
JetCar
Joomla
Lanshanbot
Larbin
Leap
LeechGet
Lftp
LibWeb
Libwhisker
Likse
LinqiaRSSBot
MFC_Tear_Sample
MIDown tool
MIIxpc
MSIECrawler
Mag-Net
Magnet
MarkMonitor
Mass Downloader
MauiBot
MicroMessenger
Minefield
Moblie Safari
Morfeus Fucking Scanner
Mr.4x3
NICErsPRO
Nameprotect
NearSite
Needle
Net Vampire
NetLyzer
Netcraft
Nettrack
Netvibes
Nibbler
Niki-bot
Ninja
Nmap
Not
Nutch
Offline Navigator
OpenLinkProfiler
Openfind
OutclicksBot
OutfoxBot
PageGrabber
PageThing.com
Panscient
PeoplePal
Piepmatz
PleaseCrawl
ProPowerBot
Probethenet
Psbot
Pump
PyCurl
QueryN Metasearch
Recorder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
Screaming
ScreenerBot
Searchestate
SearchmetricsBot
Seekport
Semrush
SemrushBot
SeoSiteCheckup
SiteSnagger
Sitebeam
Sitevigil
SmartDownload
Snoopy
SocialRankIOBot
Sosospider
Spammen
Spanner
Spinn3r
Sqlmap
Sqworm
Sucuri
Surfbot
Szukacz
Thumbor
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
Turingos
Twice
URLy Warning
URLy.Warning
UnisterBot
Upflow
VCI
Vacuum
VelenPublicWebCrawler
Voil
WBSearchBot
WEBDAV
WISENutbot
WWW::Mechanize
Wallpapers
WeSEE
Web Fetch
Web Sauger
Web Sucker
WebCollage
WebCopier
WebFuck
WebImageCollector
WebLeacher
WebPix
WebWhacker
Website Quester
WebsiteQuester
Webster
Whacker
Who.is Bot
Wonderbot
Wotbox
Xenu
YoudaoBot
Zauba
Zermelo
ZumBot
ZyBorg
arquivo.pt
autoemailspider
cah.io.community
crawler4j
dataforseo.com
demandbase-bot
isitwp.com
magpie-crawler
meanpathbot
pcBrowser
plumanalytics
polaris version
s1z.ru
scalaj-http
sexsearcher
siteripz
ubermetrics-technologies.com
voyagerx.com
webgains-bot
webmeup-crawler
xpymep1.exe
zgrab