404enemy
Aboundexbot
AhrefsBot
AiHitBot
Aipbot
Alligator
AllSubmitter
AlphaBot
Apexoo
ASPSeek
Attach
Backlink-Ceck
BacklinkCrawler
BackStreet
BatchFTP
BBBike
BDCbot
BDFetch
Bitacle
Black Hole
BlackWidow
Blow
Boardreader
Brandprotect
Brandwatch
Buddy
BuiltBotTough
Bullseye
BunnySlippers
CCBot
Cegbfeieh
CheeseBot
CheTeam
Cliqzbot
Cogentbot
Collector
Cosmos
Craftbot
crawler4j
crawl.sogou.com
CrazyWebCrawler
CSHttp
Custo
Deusu
Disco
Dispatch
DittoSpyder
DomainCrawler
DomainSigmaCrawler
Download Wonder
DSearch
Ebingbong
ECCP/1.0
Ecxi
EMail Wolf
EroCrawler
evc-batch
Exabot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FDM
FemtosearchBot
FHscan
FlashGet
Flunky
Foobot
FrontPage
FyberSpider
Fyrebot
GalaxyBot
GermCrawler
Getintent
GetWeb
Gigabot
G-i-g-a-b-o-t
Go-Ahead-Got-It
Gotit
GoZilla
Go!Zilla
Grabber
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
Haansoft
HaosouSpider
Heritrix
Hloader
HMView
HTMLparser
IDBot
Id-search
Indy Library
instabid
Intelliseek
InterGET
Internet Ninja
InternetSeer
Iria
Iskanie
IstellaBot
JamesBOT
JetCar
Jetty
JikeSpider
Joomla
Kenjin Spider
Kozmosbot
Larbin
LibWeb
Likse
LinkextractorPro
LinkpadBot
LinkScan
LinksManager
LinqiaMetadataDownloaderBot
LNSpiderguy
Magnet
Mag-Net
Majestic SEO
MarkMonitor
MarkWatch
Meanpathbot
Mediatoolkitbot
Metauri
Microsoft Data Access
MIDown tool
MJ12bot
Mr.4x3
Navroad
Needle
netEstate NE Crawler
NetSpider
NextGenSearchBot
NICErsPRO
NimbleCrawler
Nimbostratus
Nmap
oBot
OnCrawl
OrangeBot
OrangeSpider
OutfoxBot
PageAnalyzer
Pavuk
pcBrowser
PECL::HTTP
Picscout
PictureFinder
Pi-Monster
Pixray
PleaseCrawl
plumanalytics
POE-Component-Client-HTTP
ProWebWalker
PxBroker
RankFlex
RankingBot
RankingBot2
RankurBot
RealDownload
RebelMouse
ReGet
RocketCrawler
s1z.ru
Scanbot
Searchestate
SemrushBot
SEOkicks
SEOkicks-Robot
Seomoz
SEOprofiler
SeoSiteCheckup
sexsearcher
Shodan
SiteExplorer
Siteimprove
SiteSnagger
SMTBot
Snapbot
Sociscraper
Sogou web spider
Sosospider
Spammen
Spinn3r
SputnikBot
Sqlmap
Sqlworm
Sqworm
Steeler
Stripper
Sucker
SuperBot
Surfbot
SurveyBot
Swiftbot
Szukacz
T0PHackTeam
T8Abot
tAkeOut
Telesphoreo
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Titan
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turingos
Twice
Upflow
VCI
Voltron
Wallpapers/3.0
WASALive-Bot
WebCollage
WEBDAV
Web Fetch
Web Fuck
WebGo IS
WebImageCollector
WebLeacher
webmeup-crawler
WebPix
Web Pix
WebReaper
WebSauger
WebsiteQuester
Webster
Web Sucker
WeSEE
Whatweb
Widow
Wonderbot
Wotbox
WWW::Mechanize
x09Mozilla
x22Mozilla
Xaldon WebSpider
Xenu
xpymep1.exe
Zauba
Zeus
Zitebot
ZumBot
ZyBorg