404checker
80legs
ADmantX
AIBOT
Abonti
Aboundex
Aboundexbot
AhrefsBot
Alexibot
Alligator
AlphaBot
Anarchie
Apexoo
Aspiegel
Asterias
Atomseobot
BBBike
BackWeb
BacklinkCrawler
Battleztar Bazinga
Bigfoot
Bolt
Brandprotect
Buck
Buddy
Bullseye
BunnySlippers
CATExplorador
CODE87
Calculon
Cegbfeieh
CheTeam
CheeseBot
CherryPicker
Cloud mapping
Cocolyzebot
Collector
Copier
Copyscape
CrunchBot
Curious
Custo
DBLBot
DataCha0s
DatabaseDriverMysqli
Demon
Disco
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainSigmaCrawler
Download Wonder
Drip
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
EirGrabber
Exabot
Extreme Picture Finder
Ezooms
FemtosearchBot
Firefox/7.0
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
GermCrawler
Getintent
GoZilla
Grafula
GrapeshotCrawler
HEADMasterSEO
HTTrack
HaosouSpider
Harvest
Heritrix
Hloader
Humanlinks
IDBTE4M
IRLbot
IlseBot
IndeedBot
Indy Library
InfoNaviRobot
InternetSeer
Iskanie
Keybot Translation-Search-Machine
Kinza
Larbin
LeechGet
Lftp
LinkScan
LinkWalker
LinkpadBot
Lipperhey
Ltx71
MIDown tool
MJ12bot
MSFrontPage
Majestic-SEO
MarkWatch
Masscan
Mata Hari
Minefield
MolokaiBot
Morfeus Fucking Scanner
Mozlila
Msrabot
Musobot
NICErsPRO
NetLyzer
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Nikto
NimbleCrawler
Nimbostratus
Not
Nuclei
Nutch
Offline Explorer
Offline Navigator
OpenLinkProfiler
OrangeBot
OrangeSpider
PHPCrawl
POE-Component-Client-HTTP
PageScorer
PageThing.com
Panscient
Pavuk
Pi-Monster
Pimonster
PleaseCrawl
Pump
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
Rankivabot
RealDownload
RebelMouse
RedesScrapy
Ripper
RocketCrawler
SBIder
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
ScanAlert
Screaming
ScreenerBot
Seekport
SeobilityBot
Shodan
Site Sucker
SiteCheckerBotCrawler
Sitebeam
SocialRankIOBot
Sociscraper
Sosospider
Spammen
Spinn3r
SputnikBot
Sqlworm
Sqworm
Steeler
Sucuri
SuperBot
T0PHackTeam
TeleportPro
Telesoft
Telesphoreo
Thumbor
Titan
Turingos
Twice
UnisterBot
Upflow
VCI
Vagabondo
Virusdie
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WPScan
WWW-Mechanize
WallpapersHD
Web Auto
Web Enhancer
Web Fetch
WebBandit
WebCollage
WebFuck
WebImageCollector
WebLeacher
WebPix
WebReaper
WebStripper
WebSucker
WebWhacker
Website Quester
WebsiteQuester
Webster
Whack
Widow
WinHTTrack
Wprecon
Xaldon_WebSpider
Zade
Zauba
Zitebot
ZumBot
adscanner
arquivo.pt
check1.exe
clark-crawler
coccocbot
com.plumanalytics
crawler.feedback
dataforseo.com
demandbase-bot
domainsproject.org
evc-batch
instabid
internetVista monitor
ips-agent
iubenda-radar
lwp-request
lwp-trivial
mediawords
netEstate NE Crawler
plumanalytics
polaris version
scan.lol
seostar
siteripz
sogouspider
sp_auditbot
spyfu
trendiction.de
webmeup-crawler
zgrab