360Spider
404checker
404enemy
80legs
AIBOT
ALittle Client
ASPSeek
Abonti
Aboundex
AiHitBot
Alexibot
AlphaBot
Anarchie
Anarchy
Anarchy99
Ankit
Apexoo
Aspiegel
Atomseobot
AwarioRssBot
AwarioSmartBot
BDCbot
BLEXBot
BackDoorBot
BackWeb
Badass
Battleztar Bazinga
Bigfoot
Black Hole
BlackWidow
BlowFish
Bolt
BotALot
Buck
Bullseye
CATExplorador
CSHttp
CazoodleBot
CheTeam
CherryPicker
Citoid
Claritybot
Cloud mapping
Cogentbot
Collector
Craftbot
Crawling at Home Project
Crescent
Custo
CyotekWebCopy
DBLBot
DTS Agent
DatabaseDriverMysqli
Deusu
Discoverybot
Dispatch
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
EMail Siphon
Ebingbong
Ecxi
Evil
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
Firefox/7.0
FlashGet
Foobot
Freeuploader
GT::WWW
GalaxyBot
GermCrawler
GetWeb
Getintent
Gigabot
GoZilla
Gotit
Grabber
HMView
HTTP::Lite
HaosouSpider
Harvest
Humanlinks
HybridBot
IDBot
Iblog
Indy Library
InfoTekies
JennyBot
JetCar
Joomla
Kinza
LNSpiderguy
Leap
Libwhisker
Lightspeedsystems
LinkWalker
Linkbot
LinkextractorPro
LinksManager
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Ltx71
MIIxpc
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
Majestic12
Mata Hari
MauiBot
Meanpathbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
Musobot
NPbot
Name Intelligence
Nameprotect
NearSite
NetMechanic
NetZIP
NextGenSearchBot
Niki-bot
NimbleCrawler
Nmap
Offline Explorer
OrangeBot
OrangeSpider
PECL::HTTP
POE-Component-Client-HTTP
PageScorer
Panscient
Papa Foto
Petalbot
Pi-Monster
Picsearch
Pimonster
Pixray
ProPowerBot
Probethenet
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankingBot
RankingBot2
Re-re
RebelMouse
Recorder
SEOkicks
SMTBot
ScanAlert
Scrapy
ScreenerBot
ScrepyBot
Searchestate
Seekport
SemanticJuice
SeobilityBot
SiteCheckerBotCrawler
Sitebeam
Sociscraper
Sogou web spider
Sosospider
SpaceBison
Spanner
Spinn3r
SputnikBot
Sqlworm
Sqworm
Stripper
Surfbot
Suzuran
Swiftbot
Szukacz
TeleportPro
TightTwatBot
Toata
Turingos
Typhoeus
URLy Warning
URLy.Warning
Upflow
VCI
VelenPublicWebCrawler
Virusdie
Voltron
WBSearchBot
WEBDAV
WISENutbot
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
WebBandit
WebFetch
WebLeacher
WebStripper
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
Widow
WinHTTrack
Woobot
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zitebot
ZmEu
ZumBot
archive.org_bot
arquivo.pt
backlink-check
cah.io.community
check1.exe
coccocbot
com.plumanalytics
crawler4j
demandbase-bot
gopher
heritrix
instabid
internetVista monitor
ips-agent
isitwp.com
iubenda-radar
lwp-trivial
muhstik-scan
scan.lol
serpstatbot
sexsearcher
sitechecker.pro
sogouspider
tAkeOut
trendiction.com
trendiction.de
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
zgrab