360Spider
404checker
Abonti
AhrefsBot
AiHitBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchie
archive.org_bot
ASPSeek
Asterias
Attach
autoemailspider
BackDoorBot
Backlink-Ceck
BackStreet
Bandit
Barkrowler
BatchFTP
Bigfoot
Bitacle
Blackboard
Blow
BotALot
Brandwatch
Buddy
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
Calculon
CCBot
CheTeam
Claritybot
coccocbot-web
cognitiveseo
com.plumanalytics
Copyscape
crawler.feedback
crawl.sogou.com
Crescent
Curious
DatabaseDriverMysqli
Demon
Deusu
Digincore
DigitalPebble
DIIbot
Dirbuster
Discobot
DittoSpyder
DnyzBot
Dotbot
Download Wonder
Dragonfly
Drip
Ecxi
EirGrabber
EMail Siphon
EMail Wolf
EroCrawler
Evil
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FlashGet
Flunky
Foobot
Freeuploader
FrontPage
Fyrebot
Genieo
Getintent
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla
Grafula
GrapeFX
GrapeshotCrawler
Haansoft
Hloader
Id-search
Image Fetch
Image Sucker
InfoNaviRobot
instabid
Internet Ninja
JennyBot
JetCar
Jetty
JOC Web Spider
Jorgee
Kenjin Spider
Keyword Density
Kozmosbot
Lanshanbot
LexiBot
Lftp
Likse
LinkextractorPro
Litemage_walker
Lmspider
Ltx71
Magnet
Mag-Net
magpie-crawler
Majestic12
MarkMonitor
MarkWatch
Masscan
Mata Hari
meanpathbot
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
MIIxpc
Mister PiX
Mojeek
Mr.4x3
MSIECrawler
muhstik-scan
Name Intelligence
Nameprotect
NearSite
Nessus
netEstate NE Crawler
NetLyzer
NetSpider
NICErsPRO
NimbleCrawler
Ninja
Nmap
Nutch
Offline Explorer
Offline Navigator
OpenLinkProfiler
Openvas
OrangeBot
OutclicksBot
OutfoxBot
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Panscient
Papa Foto
PeoplePal
PictureFinder
Pimonster
Pixray
Pockey
Probethenet
Pump
PxBroker
PyCurl
RankActiveLinkBot
RankingBot2
Rankivabot
RealDownload
Reaper
RebelMouse
ReGet
Rogerbot
SalesIntelligent
SBIder
ScoutJet
Scrapy
Searchestate
SearchmetricsBot
SemrushBot
seoscanners
SEOstats
sexsearcher
SiteExplorer
SiteLockSpider
SiteSnagger
Sitevigil
SlySearch
SMTBot
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Sottopop
SpaceBison
SpankBot
Spbot
Sqlmap
Sqlworm
Sqworm
Sucuri
Suzuran
Swiftbot
Teleport
TeleportPro
Telesphoreo
Thumbor
Toata
Trendiction
True_Robot
Turnitin
TurnitinBot
Twice
Typhoeus
UnisterBot
Upflow
URLy Warning
URLy.Warning
VB Project
Virusdie
VoidEYE
Wallpapers/3.0
WBSearchBot
WebCollage
WebCopier
WEBDAV
WebEnhancer
Web Enhancer
Web Fetch
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Pix
WebsiteExtractor
WebsiteQuester
Website Quester
WebStripper
WebSucker
WebWhacker
WebZIP
WeSEE
Whacker
Woobot
Wprecon
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Zauba
Zermelo
zgrab
Zitebot
ZumBot
ZyBorg