360Spider
404enemy
80legs
ASPSeek
AfD-Verbotsverfahren
Alexibot
Alligator
Ankit
Atomseobot
Attach
AwarioSmartBot
BBBike
BLEXBot
BackStreet
BatchFTP
BetaBot
Bitacle
Blackboard
BlowFish
Brandprotect
BuiltBotTough
BunnySlippers
BuzzSumo
CazoodleBot
Cegbfeieh
CheeseBot
CherryPicker
Chlooe
Claritybot
Cogentbot
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
DBLBot
DIIbot
DatabaseDriverMysqli
Deusu
Dirbuster
Disco
Discobot
Discoverybot
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainCrawler
Domains Project
Drip
EMail Siphon
Ebingbong
Ecxi
EirGrabber
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FemtosearchBot
Fimap
Freeuploader
FrontPage
FyberSpider
Genieo
Gotit
Grafula
GridBot
HEADMasterSEO
HMView
HTTrack
Haansoft
HaosouSpider
Havij
IDBTE4M
IRLbot
Iblog
IlseBot
Image Fetch
IndeedBot
InfoTekies
Intelliseek
Iria
JamesBOT
Jbrofuzz
Jetty
Kenjin Spider
Keybot Translation-Search-Machine
LNSpiderguy
LWP::Simple
Lanshanbot
LeechGet
Lightspeedsystems
Likse
LinkWalker
Linkbot
LinqiaScrapeBot
Lmspider
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Mass Downloader
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
MolokaiBot
Mozlila
Msrabot
Nameprotect
Navroad
NearSite
Needle
Nessus
NetAnts
NetMechanic
NetSpider
NextGenSearchBot
Nutch
Octopus
Offline Explorer
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OutfoxBot
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageThing.com
Panscient
Petalbot
Pi-Monster
Picscout
Pimonster
Pockey
Probethenet
Psbot
Pump
PxBroker
RankingBot
RankingBot2
ReGet
Reaper
RebelMouse
Recorder
RepoMonkey
Ripper
Rogerbot
SBIder
SEOkicks
SEOprofiler
SEOstats
SISTRIX
SalesIntelligent
ScoutJet
Screaming
Seekport
SentiBot
SeobilityBot
Site Sucker
SlySearch
Sociscraper
Sogou web spider
Spanner
Spinn3r
SputnikBot
Sqlmap
Sqworm
Sucker
Sucuri
SurveyBot
Suzuran
Swiftbot
Szukacz
Telesphorep
The Intraformant
TheNomad
Titan
Toata
Trendiction
True_Robot
TurnitinBot
Twice
UnisterBot
Upflow
VeriCiteCrawler
VoidEYE
Voil
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
Wallpapers
Web Enhancer
Web Fetch
Web Sauger
WebAuto
WebFetch
WebPix
WebStripper
WebWhacker
WebmasterWorldForumBot
Webshag
Webster
Whacker
Whatweb
WinHTTrack
Woobot
Wotbox
Wprecon
YoudaoBot
Zauba
Zermelo
ZoominfoBot
adscanner
archive.org_bot
arquivo-web-crawler
autoemailspider
coccocbot
cognitiveseo
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
heritrix
ips-agent
lwp-request
lwp-trivial
magpie-crawler
netEstate NE Crawler
probe-image-size
seobility
sitechecker.pro
sp_auditbot
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
webprosbot
x09Mozilla
x22Mozilla
zgrab