404checker
80legs
ADmantX
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
Aipbot
Alligator
Anarchie
Ankit
Asterias
Attach
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BackStreet
Badass
Bandit
Barkrowler
BlackWidow
Bolt
BotALot
Brandprotect
Bullseye
BunnySlippers
CATExplorador
CCBot
CSHttp
Calculon
CazoodleBot
Cegbfeieh
CherryPicker
Chlooe
Citoid
Cogentbot
Cosmos
CrazyWebCrawler
CyotekWebCopy
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
Disco
Discobot
Discoverybot
DittoSpyder
DomainAppender
ECCP/1.0
EirGrabber
EroCrawler
Exabot
ExtLinksBot
FDM
Firefox/7.0
Fyrebot
Genieo
Getintent
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
Harvest
Havij
Heritrix
Humanlinks
IDBTE4M
Id-search
IlseBot
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
Intelliseek
InterGET
InternetSeer
Iskanie
JOC Web Spider
JamesBOT
JetCar
JikeSpider
Joomla
Jorgee
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Larbin
Leap
LeechFTP
LeechGet
Lftp
Libwhisker
Lightspeedsystems
LinkextractorPro
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MSFrontPage
MTRobot
Mag-Net
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
Mediatoolkitbot
Minefield
Mojolicious
Mozlila
Mr.4x3
Nameprotect
NetAnts
NetLyzer
NetSpider
NetZIP
Netvibes
Niki-bot
NimbleCrawler
Nutch
OpenVAS
Openfind
OutfoxBot
PECL::HTTP
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Pandalytics
Panscient
Papa Foto
Pavuk
Pi-Monster
Picscout
Piepmatz
Pimonster
Pixray
Pockey
Psbot
Pump
QueryN Metasearch
RankingBot
RealDownload
Recorder
RedesScrapy
SBIder
SMTBot
SalesIntelligent
ScreenerBot
Seekport
SemrushBot
SentiBot
Seomoz
Shodan
Site Sucker
Siteimprove
SmartDownload
Snoopy
SocialRankIOBot
SpaceBison
Spanner
Sqlmap
Sqlworm
Sqworm
SuperHTTP
Surfbot
Suzuran
T8Abot
Telesphoreo
Thumbor
Titan
Tracemyfile
True_Robot
TurnitinBot
TwengaBot
Typhoeus
URLy Warning
UnisterBot
V-BOT
VCI
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Voltron
WISENutbot
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
Web Auto
Web Enhancer
Web Fetch
Web Fuck
Web Sauger
Web Sucker
WebAuto
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFetch
WebLeacher
WebStripper
WebZIP
Website Quester
WebsiteExtractor
WebsiteQuester
Webster
Whack
Whacker
Who.is Bot
WinHTTrack
WiseGuys Robot
Wprecon
YoudaoBot
Zermelo
Zeus
ZyBorg
archive.org_bot
backlink-check
cah.io.community
check1.exe
clark-crawler
cognitiveseo
crawl.sogou.com
evc-batch
iubenda-radar
lwp-request
mediawords
plumanalytics
polaris version
ripz
satoristudio.net
scalaj-http
scan.lol
sexsearcher
sitechecker.pro
sp_auditbot
sysscan
trendiction.com
ubermetrics-technologies.com
webgains-bot
webpros.com
x09Mozilla
zauba.io
zgrab