404checker
404enemy
80legs
Abonti
Acunetix
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
AlphaBot
Apexoo
ASPSeek
Asterias
Badass
BatchFTP
BDCbot
BDFetch
Bigfoot
Bitacle
Blackboard
Black Hole
Blow
Boardreader
Brandprotect
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CazoodleBot
Cegbfeieh
CheTeam
ChinaClaw
Claritybot
Cliqzbot
Cogentbot
Collector
com.plumanalytics
Copyscape
Craftbot
crawler.feedback
crawl.sogou.com
Crescent
DatabaseDriverMysqli
DataCha0s
Deusu
Devil
Digincore
DigitalPebble
Discobot
DnyzBot
DomainAppender
Dotbot
Download Wonder
DSearch
DTS Agent
Ecxi
evc-batch
Express WebPictures
ExtLinksBot
Extractor
facebookscraper
FemtosearchBot
Firefox/7.0
Foobot
Freeuploader
FrontPage
GalaxyBot
Genieo
GermCrawler
GetWeb
Gigabot
G-i-g-a-b-o-t
GoZilla
Go!Zilla
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HaosouSpider
Havij
Heritrix
Hloader
HTTrack
HybridBot
Image Fetch
IndeedBot
InfoTekies
Intelliseek
Internet Ninja
InternetSeer
internetVista monitor
ips-agent
Iria
IRLbot
Iskanie
Jetty
JikeSpider
Jorgee
JustView
Keyword Density
Kozmosbot
Lanshanbot
Larbin
LeechFTP
Lftp
LinkextractorPro
LinkpadBot
LinksManager
LinkWalker
LinqiaScrapeBot
Litemage_walker
Lmspider
LNSpiderguy
Ltx71
lwp-request
Mag-Net
magpie-crawler
Mail.RU_Bot
MarkMonitor
MarkWatch
Masscan
Mass Downloader
MFC_Tear_Sample
MIDown tool
Mister PiX
Mojeek
Msrabot
MS Web Services Client Protocol
muhstik-scan
Name Intelligence
Nameprotect
Navroad
Needle
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
NetSpider
Nettrack
Netvibes
NextGenSearchBot
Nikto
NimbleCrawler
Nimbostratus
Ninja
oBot
Octopus
Offline Explorer
OpenLinkProfiler
Openvas
OpenVAS
OrangeSpider
PageGrabber
page scorer
Pavuk
PECL::HTTP
Picscout
Pi-Monster
Pixray
PleaseCrawl
plumanalytics
Pump
QueryN Metasearch
RankingBot2
RedesScrapy
RepoMonkey
s1z.ru
SalesIntelligent
SBIder
Scanbot
scan.lol
ScoutJet
Scrapy
Screaming
Searchestate
SEOkicks
seoscanners
serpstatbot
sexsearcher
Shodan
Siphon
SISTRIX
SiteExplorer
Siteimprove
SiteSucker
Site Sucker
SlySearch
Sogou web spider
Spammen
Sqlmap
SuperBot
Surfbot
SurveyBot
T8Abot
tAkeOut
Teleport
Telesoft
Tracemyfile
Trendiction
TwengaBot
UnisterBot
URLy.Warning
Vagabondo
VB Project
VCI
VeriCiteCrawler
Voil
WBSearchBot
WebAuto
Web Auto
WebBandit
WebCollage
WebCopier
WEBDAV
Web Enhancer
WebFetch
WebFuck
WebLeacher
WebPix
Web Pix
WebReaper
Web Sauger
Webshag
WebsiteExtractor
WebsiteQuester
Website Quester
WebStripper
WebZIP
WeSEE
Whatweb
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wprecon
WPScan
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xaldon_WebSpider
xpymep1.exe
YoudaoBot
Zauba
zauba.io
zgrab