404checker
80legs
Abonti
AhrefsBot
AIBOT
AiHitBot
Aipbot
Alexibot
AllSubmitter
archive.org_bot
Attach
autoemailspider
BacklinkCrawler
BackStreet
BackWeb
Bandit
BetaBot
Blackboard
Black Hole
BlackWidow
BLEXBot
BlowFish
BotALot
BuiltBotTough
BuzzSumo
CATExplorador
CazoodleBot
CCBot
CheeseBot
Chlooe
Claritybot
Cliqzbot
cognitiveseo
Collector
com.plumanalytics
Copier
CopyRightCheck
Copyscape
Craftbot
crawl.sogou.com
CrunchBot
CSHttp
DatabaseDriverMysqli
DataCha0s
Deusu
Digincore
DigitalPebble
DIIbot
Disco
Discoverybot
Dispatch
DomainSigmaCrawler
DomainStatsBot
Dotbot
DSearch
DTS Agent
EirGrabber
evc-batch
Extractor
ExtractorPro
Ezooms
FDM
FemtosearchBot
FlashGet
Foobot
GalaxyBot
GetRight
GetWeb
Gigablast
Gigabot
G-i-g-a-b-o-t
GrabNet
Grafula
GrapeshotCrawler
HaosouSpider
Harvest
Hloader
HTTrack
Id-search
IlseBot
Image Fetch
Image Sucker
IndeedBot
Indy Library
InfoTekies
InternetSeer
IRLbot
Jbrofuzz
JikeSpider
JOC Web Spider
JustView
LexiBot
Lftp
Lightspeedsystems
Likse
LinksManager
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Ltx71
lwp-request
LWP::Simple
Mag-Net
Mail.RU_Bot
Majestic12
Majestic SEO
Majestic-SEO
MarkWatch
Mata Hari
Mediatoolkitbot
MegaIndex.ru
MFC_Tear_Sample
Microsoft Data Access
Mister PiX
MJ12bot
Mojeek
Msrabot
MS Web Services Client Protocol
Needle
Netcraft
netEstate NE Crawler
NetLyzer
NetSpider
Netvibes
NICErsPRO
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Nutch
oBot
Openfind
OpenVAS
OrangeBot
OrangeSpider
OutclicksBot
Page Analyzer
PageGrabber
Panscient
Pavuk
pcBrowser
PeoplePal
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
plumanalytics
Pockey
POE-Component-Client-HTTP
Probethenet
PxBroker
QueryN Metasearch
Quick-Crawler
RankActive
RankFlex
RankingBot2
Reaper
RepoMonkey
Ripper
SalesIntelligent
ScanAlert
Scanbot
scan.lol
Semrush
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
seoscanners
SEOstats
serpstatbot
Shodan
Siphon
SISTRIX
Siteimprove
SiteLockSpider
SiteSnagger
Site Sucker
Sitevigil
SlySearch
Snake
Sociscraper
Sogou web spider
Sosospider
Sottopop
Spammen
Spanner
SputnikBot
spyfu
Sqworm
Steeler
Sucker
Sucuri
SurveyBot
Suzuran
Szukacz
T0PHackTeam
tAkeOut
Telesphoreo
Telesphorep
The Intraformant
Titan
Toata
Toweyabot
Trendictionbot
trendiction.de
TurnitinBot
TwengaBot
Twice
Typhoeus
Upflow
Vacuum
Vagabondo
VCI
VidibleScraper
Virusdie
Voil
Wallpapers/3.0
Webalta
WebBandit
WebCollage
Web Collage
Web Enhancer
WebFuck
WebImageCollector
WebLeacher
WebPix
WebReaper
WebSauger
Web Sauger
WebsiteQuester
Website Quester
Whack
Wonderbot
Woobot
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
x09Mozilla
x22Mozilla
Xaldon_WebSpider
xpymep1.exe
zauba.io
Zitebot
ZmEu