404enemy
ADmantX
Abonti
Aboundex
Aboundexbot
AhrefsBot
AiHitBot
Aipbot
Alexibot
Alligator
Anthill
AwarioSmartBot
BBBike
BLEXBot
Backlink-Ceck
Badass
Bandit
Black Hole
BlackWidow
Blow
Brandprotect
Buck
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CODE87
CazoodleBot
Cegbfeieh
CensysInspect
ChinaClaw
Cloud mapping
Cogentbot
CyotekWebCopy
DIIbot
DatabaseDriverMysqli
Demon
Digincore
DigitalPebble
Disco
Discoverybot
DittoSpyder
DnBCrawler-Analytics
DomainAppender
Domains Project
Drip
ECCP/1.0
Ecxi
EroCrawler
ExtLinksBot
Extractor
Extreme Picture Finder
FemtosearchBot
Foobot
FyberSpider
G-i-g-a-b-o-t
GT::WWW
Genieo
GetRight
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
Grafula
GrapeFX
HEADMasterSEO
HTTrack
Haansoft
Havij
HybridBot
IDBTE4M
IRLbot
Id-search
Image Fetch
IndeedBot
Jorgee
Keybot Translation-Search-Machine
Kinza
Kozmosbot
LWP::Simple
Larbin
LeechFTP
LeechGet
LexiBot
Lftp
LibWeb
Libwhisker
Lightspeedsystems
LinkpadBot
LinqiaMetadataDownloaderBot
MJ12bot
MSIECrawler
Magnet
Mail.RU_Bot
Majestic12
MarkMonitor
Mass Downloader
MauiBot
Meanpathbot
Mediatoolkitbot
Metauri
Minefield
Mister PiX
Mojeek
Mozlila
Msrabot
NICErsPRO
Navroad
Nessus
NetMechanic
NetZIP
Nettrack
Ninja
Not
Nuclei
Octopus
Offline Explorer
OpenVAS
OrangeBot
OrangeSpider
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageGrabber
Pandalytics
Papa Foto
Petalbot
Pi-Monster
Picscout
Picsearch
PictureFinder
PleaseCrawl
Pu_iN
PxBroker
PyCurl
Quick-Crawler
RSSingBot
RankFlex
Rankivabot
RankurBot
RebelMouse
RedesScrapy
RepoMonkey
RocketCrawler
SEOlyticsCrawler
SMTBot
SalesIntelligent
ScanAlert
Scrapy
ScrepyBot
SearchmetricsBot
Semrush
SemrushBot
SentiBot
SeobilityBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
Siteimprove
Snake
Sosospider
SpankBot
Spanner
Spinn3r
SputnikBot
Sqworm
Steeler
Stripper
Sucker
Sucuri
Surfbot
Swiftbot
Telesphorep
The Intraformant
TheNomad
Titan
Trendiction
Trendictionbot
Turnitin
TurnitinBot
Twice
Typhoeus
UnisterBot
V-BOT
VCI
VidibleScraper
VoidEYE
Voltron
WISENutbot
Wallpapers/3.0
Web Pix
Web Sauger
WebCollage
WebEnhancer
WebFuck
WebGo IS
WebPix
WebSauger
WebZIP
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Whack
Whacker
WinHTTrack
Woobot
Wotbox
Xaldon_WebSpider
Xenu
Zeus
ZoomBot
ZyBorg
adscanner
archive.org_bot
arquivo-web-crawler
backlink-check
cah.io.community
clark-crawler
cognitiveseo
demandbase-bot
evc-batch
gopher
internetVista monitor
ips-agent
linkdexbot
lwp-trivial
magpie-crawler
meanpathbot
mediawords
plumanalytics
polaris version
probe-image-size
ripz
satoristudio.net
serpstatbot
siteripz
sp_auditbot
spyfu
tAkeOut
trendiction.com
voyagerx.com
webgains-bot
webmeup-crawler
webprosbot
x09Mozilla
xpymep1.exe
zauba.io
zgrab