360Spider
404checker
404enemy
AhrefsBot
Aipbot
AllSubmitter
Anarchy99
Apexoo
archive.org_bot
arquivo.pt
Aspiegel
ASPSeek
AwarioRssBot
BackDoorBot
BacklinkCrawler
BackStreet
Bandit
BatchFTP
Battleztar Bazinga
BBBike
BetaBot
Bitacle
Bolt
BotALot
Buck
Buddy
BuiltBotTough
Bullseye
BunnySlippers
BuzzSumo
Calculon
CATExplorador
CazoodleBot
Cegbfeieh
CheTeam
ChinaClaw
Claritybot
coccocbot-web
Cocolyzebot
cognitiveseo
Collector
Copier
CopyRightCheck
Craftbot
crawler.feedback
Curious
Demon
Deusu
Devil
Digincore
DigitalPebble
Dirbuster
Discobot
Dispatch
DittoSpyder
DomainAppender
DomainSigmaCrawler
Domains Project
Dragonfly
DSearch
DTS Agent
Ecxi
EroCrawler
Exabot
ExtLinksBot
Extreme Picture Finder
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Fuzz
FyberSpider
Fyrebot
Genieo
Gigablast
gopher
Go!Zilla
Grafula
GrapeFX
Haansoft
HaosouSpider
Havij
HEADMasterSEO
HTMLparser
HTTrack
Humanlinks
IDBTE4M
Id-search
Indy Library
instabid
InterGET
ips-agent
isitwp.com
Iskanie
IstellaBot
JennyBot
Jetty
JustView
Kenjin Spider
Keyword Density
Kinza
Kozmosbot
LexiBot
Libwhisker
Linkdexbot
LinkextractorPro
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
lwp-request
LWP::Simple
Magnet
Mag-Net
Mail.RU_Bot
Majestic12
MarkMonitor
Masscan
MauiBot
mediawords
Microsoft Data Access
Mojolicious
MSFrontPage
Msrabot
Musobot
Nameprotect
Needle
NetAnts
NetLyzer
Net Vampire
Netvibes
NICErsPRO
Ninja
Nmap
Nutch
Octopus
Offline Explorer
OnCrawl
Openfind
Openvas
OpenVAS
OrangeSpider
PageThing.com
pcBrowser
PeoplePal
PHPCrawl
Picsearch
Pimonster
Pi-Monster
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
polaris version
probe-image-size
Probethenet
Psbot
Pu_iN
PxBroker
Quick-Crawler
RankingBot
RankurBot
RealDownload
Reaper
RepoMonkey
Re-re
Ripper
RocketCrawler
RSSingBot
scalaj-http
ScanAlert
ScoutJet
Scrapy
ScreenerBot
Searchestate
SeoSiteCheckup
SEOstats
sexsearcher
Siphon
Sitebeam
SiteLockSpider
SiteSucker
Site Sucker
SlySearch
Snapbot
Snoopy
SocialRankIOBot
sogouspider
Sosospider
SpankBot
Spbot
Spinn3r
Sqlmap
Sqlworm
Sucker
Sucuri
Surfbot
sysscan
Szukacz
T8Abot
TeleportPro
Telesphoreo
Telesphorep
Thumbor
TightTwatBot
Titan
Toweyabot
Trendictionbot
trendiction.de
TurnitinBot
Twice
Typhoeus
UnisterBot
URLy Warning
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
Wallpapers/3.0
Web Auto
WebBandit
WebCollage
WEBDAV
WebEnhancer
WebFetch
Web Fetch
WebFuck
WebGo IS
WebLeacher
Web Pix
WebReaper
Web Sauger
Website Quester
WebStripper
WebSucker
WeSEE
Whack
Widow
WWW-Collector-E
WWW::Mechanize
x09Mozilla
Xaldon WebSpider
Xenu
xpymep1.exe
Zauba
zgrab
Zitebot
ZmEu
ZoominfoBot
ZumBot