404checker
404enemy
80legs
ADmantX
AIBOT
ASPSeek
Abonti
Aboundexbot
Acunetix
AhrefsBot
AiHitBot
AllSubmitter
Alligator
Ankit
Atomseobot
Attach
BBBike
BDCbot
BDFetch
BackStreet
BacklinkCrawler
BetaBot
Bigfoot
Black Hole
BlackWidow
Blow
Boardreader
BotALot
Brandprotect
Buddy
BuiltBotTough
Bullseye
CSHttp
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Citoid
Claritybot
Collector
Copyscape
Craftbot
CrazyWebCrawler
Custo
DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli
Deusu
Digincore
DigitalPebble
Disco
Discoverybot
DomCopBot
Drip
ECCP/1.0
EMail Siphon
EMail Wolf
Extreme Picture Finder
Firefox/7.0
Flunky
Freeuploader
GermCrawler
Getintent
Gigabot
Go!Zilla
Grabber
GrapeFX
GrapeshotCrawler
HaosouSpider
Heritrix
IRLbot
Iblog
IlseBot
IndeedBot
InfoTekies
InterGET
IstellaBot
JOC Web Spider
JetCar
Joomla
Jorgee
Jyxobot
Kozmosbot
Lanshanbot
LeechGet
Lftp
LibWeb
Libwhisker
Lightspeedsystems
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lmspider
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MTRobot
Mail.RU_Bot
Majestic-SEO
Majestic12
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Mister PiX
Moblie Safari
MolokaiBot
Musobot
Name Intelligence
NearSite
Needle
Net Vampire
NetSpider
Netcraft
Nettrack
Nibbler
Nikto
Nimbostratus
Nuclei
Nutch
Octopus
Offline Navigator
OnCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
Pandalytics
Picsearch
Piepmatz
Pixray
PxBroker
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
RankurBot
ReGet
Reaper
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
Scrapy
Screaming
SemrushBot
SentiBot
Seomoz
Site Sucker
SiteExplorer
Siteimprove
Sociscraper
Sosospider
Sottopop
Spanner
Spbot
Spinn3r
Sqworm
Steeler
Sucker
Sucuri
Surfbot
SurveyBot
T0PHackTeam
T8Abot
TeleportPro
TheNomad
Toata
Toweyabot
True_Robot
TurnitinBot
TwengaBot
UnisterBot
V-BOT
VCI
Vagabondo
VoidEYE
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WWW::Mechanize
Wallpapers
Wallpapers/3.0
Web Auto
Web Fuck
WebAuto
WebCollage
WebEnhancer
WebSauger
WebSucker
WebZIP
Webalta
WebsiteExtractor
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Xenu
Zermelo
archive.org_bot
arquivo-web-crawler
arquivo.pt
autoemailspider
backlink-check
clark-crawler
com.plumanalytics
crawler4j
dataforseo.com
demandbase-bot
domainsproject.org
evc-batch
facebookscraper
instabid
internetVista monitor
meanpathbot
mediawords
page scorer
pcBrowser
polaris version
probe-image-size
scan.lol
seostar
serpstatbot
sexsearcher
sitechecker.pro
sysscan
tAkeOut
trendiction.com
webgains-bot
webpros.com
webprosbot
xpymep1.exe