404checker
80legs
AIBOT
Abonti
Aboundex
Aipbot
AllSubmitter
AlphaBot
Anarchy99
Apexoo
Asterias
AwarioSmartBot
BBBike
BDFetch
BLEXBot
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Barkrowler
BetaBot
Bigfoot
Bitacle
BlackWidow
Boardreader
BotALot
Brandwatch
Bullseye
BunnySlippers
CCBot
CheeseBot
ChinaClaw
Chlooe
Citoid
Cloud mapping
Cogentbot
Copier
Copyscape
Crawling at Home Project
CrazyWebCrawler
DSearch
DTS Agent
DatabaseDriverMysqli
Devil
Disco
Discobot
Discoverybot
DnBCrawler-Analytics
DomCopBot
DomainSigmaCrawler
DomainStatsBot
Drip
ECCP/1.0
EasyDL
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FemtosearchBot
Fimap
Firefox/7.0
Flunky
Freeuploader
FyberSpider
G-i-g-a-b-o-t
GermCrawler
GetWeb
Go!Zilla
Go-Ahead-Got-It
GrapeFX
HEADMasterSEO
HTMLparser
Harvest
HonoluluBot
IDBTE4M
IDBot
IndeedBot
Indy Library
InfoTekies
InterGET
InternetSeer
Iria
IstellaBot
JetCar
Jetty
JustView
Jyxobot
Keyword Density
Lftp
LibWeb
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
Mata Hari
Mediatoolkitbot
Microsoft Data Access
Mojeek
Morfeus Fucking Scanner
NICErsPRO
Name Intelligence
Nameprotect
NetAnts
NetLyzer
NetSpider
NetZIP
Netcraft
Netvibes
Nuclei
Octopus
OpenVAS
OutclicksBot
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageThing.com
Panscient
Picscout
Picsearch
Pixray
ProPowerBot
ProWebWalker
Probethenet
Pu_iN
Pump
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
Rankivabot
ReGet
RealDownload
RebelMouse
RepoMonkey
RocketCrawler
SBIder
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
Scanbot
Screaming
Searchestate
Seekport
SemanticJuice
SentiBot
Seomoz
Siphon
Site Sucker
SiteLockSpider
SiteSnagger
SiteSucker
Sitevigil
Snapbot
SocialRankIOBot
SpankBot
Spanner
Spbot
Spinn3r
Steeler
Stripper
SuperHTTP
Swiftbot
Szukacz
T0PHackTeam
Teleport
Telesoft
Telesphoreo
Telesphorep
TheNomad
Thumbor
Toata
Tracemyfile
Turingos
Twice
Typhoeus
Vacuum
VeriCiteCrawler
Virusdie
VoidEYE
WASALive-Bot
WEBDAV
WWW::Mechanize
Web Collage
Web Enhancer
Web Pix
WebAuto
WebPix
WebReaper
WebSucker
WebsiteExtractor
WebsiteQuester
Webster
Widow
WiseGuys Robot
Wprecon
Xaldon WebSpider
Xenu
YoudaoBot
Zermelo
Zeus
ZoomBot
ZyBorg
adscanner
archive.org_bot
backlink-check
cah.io.community
check1.exe
clark-crawler
crawler.feedback
demandbase-bot
eCatch
evc-batch
facebookscraper
gopher
heritrix
iubenda-radar
lwp-request
meanpathbot
mediawords
netEstate NE Crawler
pcBrowser
plumanalytics
probe-image-size
s1z.ru
scan.lol
seobility
serpstatbot
sexsearcher
tAkeOut
webgains-bot
webmeup-crawler
webpros.com