360Spider
404enemy
ADmantX
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AiHitBot
AlphaBot
Ankit
Aspiegel
Asterias
Attach
BBBike
BDCbot
BDFetch
BackWeb
Backlink-Ceck
Bandit
Barkrowler
BatchFTP
BetaBot
Bigfoot
Blow
Boardreader
BuzzSumo
CCBot
CazoodleBot
Cegbfeieh
Claritybot
Cliqzbot
Cocolyzebot
Copier
Copyscape
Craftbot
Crawling at Home Project
CrunchBot
Curious
Custo
DatabaseDriverMysqli
Deusu
DigitalPebble
Disco
Discobot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainCrawler
DomainStatsBot
EMail Wolf
EasyDL
EroCrawler
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
FlashGet
FrontPage
Fuzz
GT::WWW
Genieo
GetRight
Gigabot
GridBot
HEADMasterSEO
HMView
Haansoft
IDBot
Id-search
IlseBot
IndeedBot
Indy Library
Intelliseek
InterGET
Iria
JamesBOT
Jbrofuzz
JennyBot
JetCar
Kenjin Spider
Keybot Translation-Search-Machine
LWP::Simple
Lanshanbot
LeechFTP
Lftp
LinkScan
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lmspider
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
Mag-Net
Mail.RU_Bot
Majestic-SEO
Mb2345Browser
MicroMessenger
Microsoft Data Access
Moblie Safari
Mojolicious
Msrabot
NICErsPRO
NPbot
Nameprotect
Navroad
NearSite
NetLyzer
NextGenSearchBot
Niki-bot
Nikto
Ninja
Nuclei
Octopus
OpenLinkProfiler
OpenVAS
OutclicksBot
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
Petalbot
Picsearch
Piepmatz
Pimonster
Probethenet
Psbot
Pu_iN
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot2
RealDownload
RebelMouse
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOprofiler
SMTBot
SalesIntelligent
Scanbot
ScoutJet
Scrapy
ScreenerBot
Searchestate
Semrush
Siphon
Site Sucker
SiteLockSpider
SiteSucker
Sitebeam
Siteimprove
SmartDownload
Snake
Snoopy
SpaceBison
Spammen
Spanner
Spbot
Sqlmap
Sqworm
Stripper
Sucker
SuperHTTP
Swiftbot
T0PHackTeam
Telesoft
Telesphorep
TheNomad
Toweyabot
Turingos
TwengaBot
Twice
Typhoeus
URLy.Warning
VCI
Vagabondo
VidibleScraper
Virusdie
VoidEYE
Voil
Voltron
WWW::Mechanize
WWWOFFLE
Wallpapers
WeSEE
Web Collage
Web Enhancer
Web Fetch
Web Pix
WebBandit
WebCopier
WebFetch
WebGo IS
WebSauger
WebStripper
WebSucker
WebWhacker
Webalta
WebsiteExtractor
WebsiteQuester
Webster
Whatweb
Widow
WinHTTrack
WiseGuys Robot
Wonderbot
Wotbox
Xaldon_WebSpider
YoudaoBot
Zeus
Zitebot
ZoominfoBot
ZumBot
arquivo-web-crawler
autoemailspider
backlink-check
crawl.sogou.com
crawler4j
eCatch
gopher
ips-agent
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
oBot
page scorer
polaris version
ripz
s1z.ru
scan.lol
seocompany.store
serpstatbot
siteripz
tAkeOut
trendiction.com
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webprosbot
x09Mozilla