404checker
80legs
AIBOT
ALittle Client
Abonti
Aboundexbot
AhrefsBot
Aipbot
Anarchy99
Ankit
Atomseobot
AwarioRssBot
BLEXBot
BackDoorBot
BackStreet
Barkrowler
BatchFTP
Battleztar Bazinga
Bitacle
BlackWidow
BotALot
Buddy
BuzzSumo
CCBot
CazoodleBot
CensysInspect
CherryPicker
Citoid
Claritybot
Collector
Copier
Cosmos
Crescent
CrunchBot
Custo
DIIbot
Devil
DigitalPebble
Dirbuster
DomainAppender
DomainCrawler
Domains Project
EMail Wolf
Ecxi
Extractor
FDM
FemtosearchBot
Fimap
FlashGet
Freeuploader
FrontPage
Fyrebot
GalaxyBot
GrabNet
Grabber
GrapeshotCrawler
HTTP::Lite
HTTrack
Hloader
HonoluluBot
IDBot
Iblog
Image Fetch
Image Sucker
InfoNaviRobot
InterGET
JennyBot
JikeSpider
Jyxobot
Keybot Translation-Search-Machine
Kozmosbot
LWP::Simple
Lanshanbot
Larbin
LeechFTP
LibWeb
Linkbot
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Lmspider
MIIxpc
MSIECrawler
Magnet
Majestic-SEO
Majestic12
MarkMonitor
MarkWatch
Meanpathbot
MegaIndex.ru
Metauri
Moblie Safari
Mojeek
Mojolicious
MolokaiBot
Musobot
Name Intelligence
Needle
Net Vampire
NetAnts
NetLyzer
NetZIP
Nettrack
NextGenSearchBot
Nibbler
Nimbostratus
Not
Nutch
Offline Navigator
OnCrawl
Openfind
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Petalbot
Picscout
Picsearch
PictureFinder
Pimonster
Pu_iN
Pump
PxBroker
QueryN Metasearch
RankingBot2
Rankivabot
RankurBot
ReGet
RealDownload
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
SBIder
SEOkicks-Robot
SEOprofiler
SEOstats
SMTBot
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
ScreenerBot
ScrepyBot
Seekport
SemanticJuice
Semrush
SemrushBot
SeobilityBot
Seomoz
Shodan
Siphon
SiteLockSpider
SmartDownload
Snapbot
Sociscraper
Sogou web spider
Sosospider
Spammen
SpankBot
Spanner
Spinn3r
Sqlworm
Sqworm
Steeler
SuperHTTP
Swiftbot
TeleportPro
Telesoft
Telesphorep
Toweyabot
Tracemyfile
TurnitinBot
Twice
URLy.Warning
UnisterBot
Upflow
VB Project
VCI
Vagabondo
VoidEYE
Voil
Voltron
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
Web Collage
Web Enhancer
Web Fetch
Web Pix
Web Sauger
WebCollage
WebEnhancer
WebFetch
WebFuck
WebLeacher
WebPix
WebZIP
Webalta
Whack
Whacker
Whatweb
Widow
Wonderbot
Wotbox
Xaldon_WebSpider
Xenu
Zauba
Zermelo
Zeus
ZoominfoBot
ZyBorg
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
cah.io.community
check1.exe
coccocbot
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
domainsproject.org
evc-batch
gopher
instabid
ips-agent
isitwp.com
lwp-request
mediawords
polaris version
seostar
serpstatbot
sexsearcher
siteripz
sogouspider
sysscan
trendiction.de
voyagerx.com
webgains-bot
x09Mozilla