404enemy
80legs
AIBOT
ASPSeek
AhrefsBot
Alligator
Anarchie
Anarchy
Apexoo
Aspiegel
Asterias
AwarioSmartBot
BackWeb
Badass
BatchFTP
Bitacle
Black Hole
Brandprotect
Buddy
BuiltBotTough
BunnySlippers
BuzzSumo
CCBot
CODE87
CSHttp
Calculon
Cegbfeieh
Claritybot
Cliqzbot
Collector
Copyscape
Cosmos
Crescent
CrunchBot
DTS Agent
DatabaseDriverMysqli
Digincore
Dirbuster
Disco
Discobot
Dispatch
DomainSigmaCrawler
Domains Project
Dotbot
EMail Siphon
Ebingbong
EirGrabber
EroCrawler
Exabot
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
Fimap
FrontPage
Fuzz
G-i-g-a-b-o-t
GT::WWW
Getintent
GrabNet
Haansoft
HaosouSpider
HybridBot
IDBot
Id-search
Image Sucker
Intelliseek
InterGET
Iskanie
IstellaBot
Jetty
Keyword Density
Kinza
LeechFTP
LeechGet
LexiBot
LibWeb
Libwhisker
Likse
LinkScan
LinksManager
LinqiaRSSBot
Lipperhey Spider
Lmspider
Ltx71
MJ12bot
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
Majestic12
Mass Downloader
Mata Hari
Mediatoolkitbot
Microsoft URL Control
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mr.4x3
Msrabot
NPbot
Nameprotect
Navroad
NetMechanic
NetSpider
Nikto
NimbleCrawler
Ninja
Nutch
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openfind
Openvas
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Panscient
Papa Foto
PeoplePal
Petalbot
Picscout
PictureFinder
Pimonster
PleaseCrawl
ProPowerBot
ProWebWalker
Psbot
Pump
Quick-Crawler
Rankivabot
RankurBot
RealDownload
Reaper
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SEOkicks
SEOprofiler
SISTRIX
Scrapy
Searchestate
Seekport
SemanticJuice
Semrush
SemrushBot
Shodan
Site Sucker
SiteSnagger
Sitebeam
Siteimprove
Sitevigil
Sociscraper
Sosospider
Spammen
Spbot
Spinn3r
Sqlmap
Sqlworm
Steeler
Sucker
Sucuri
SuperHTTP
Suzuran
Swiftbot
T0PHackTeam
T8Abot
Teleport
Toata
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turingos
TwengaBot
Twice
URLy Warning
URLy.Warning
UnisterBot
Upflow
V-BOT
Vacuum
VelenPublicWebCrawler
VidibleScraper
Voil
WISENutbot
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
WeSEE
Web Enhancer
Web Fuck
Web Sauger
Web Sucker
WebEnhancer
WebFetch
WebPix
Webalta
WebmasterWorldForumBot
Webshag
Whacker
WiseGuys Robot
Wonderbot
Woobot
Xaldon WebSpider
Zauba
Zeus
Zitebot
ZmEu
ZoomBot
ZoominfoBot
ZumBot
arquivo-web-crawler
backlink-check
check1.exe
clark-crawler
com.plumanalytics
crawl.sogou.com
demandbase-bot
facebookscraper
instabid
ips-agent
iubenda-radar
oBot
page scorer
polaris version
probe-image-size
scalaj-http
scan.lol
seoscanners
seostar
serpstatbot
sexsearcher
siteripz
sogouspider
sp_auditbot
tAkeOut
trendiction.com
ubermetrics-technologies.com
voyagerx.com
x22Mozilla
zgrab