404checker
404enemy
80legs
Abonti
AhrefsBot
Aipbot
Alexibot
Anarchie
Apexoo
archive.org_bot
ASPSeek
Attach
autoemailspider
backlink-check
BacklinkCrawler
Badass
Bandit
Barkrowler
BatchFTP
BBBike
BDCbot
BDFetch
BetaBot
Black Hole
BlowFish
Boardreader
BuiltWith
Bullseye
Calculon
Cegbfeieh
CheeseBot
CheTeam
Chlooe
CopyRightCheck
Craftbot
crawler4j
crawler.feedback
crawl.sogou.com
CSHttp
Curious
DatabaseDriverMysqli
Deusu
Digincore
DnyzBot
DomainCrawler
DomainStatsBot
Download Wonder
DSearch
DTS Agent
Ebingbong
eCatch
ECCP/1.0
EMail Wolf
Evil
Exabot
ExtractorPro
Extreme Picture Finder
facebookscraper
FHscan
Flunky
Foobot
FrontPage
Fyrebot
GermCrawler
GetRight
Gigablast
Gigabot
Go-Ahead-Got-It
Go!Zilla
Grabber
GrabNet
Grafula
Havij
HEADMasterSEO
Hloader
HMView
HTTrack
InfoNaviRobot
InfoTekies
Internet Ninja
internetVista monitor
ips-agent
IstellaBot
JamesBOT
Jbrofuzz
Joomla
Jorgee
Jyxobot
Keyword Density
LeechFTP
LeechGet
LexiBot
LibWeb
Libwhisker
Lightspeedsystems
Linkdexbot
LinkpadBot
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
lwp-request
lwp-trivial
Mag-Net
magpie-crawler
Majestic12
Majestic-SEO
MarkMonitor
Masscan
Meanpathbot
Mediatoolkitbot
mediawords
MegaIndex.ru
MFC_Tear_Sample
Microsoft Data Access
MIIxpc
Morfeus Fucking Scanner
MSIECrawler
muhstik-scan
Musobot
Name Intelligence
Navroad
NetAnts
NetMechanic
Netvibes
NetZIP
Nibbler
NICErsPRO
Niki-bot
NimbleCrawler
Nimbostratus
Nutch
oBot
Offline Explorer
OnCrawl
OpenVAS
OutclicksBot
OutfoxBot
page scorer
Pandalytics
Pavuk
pcBrowser
PeoplePal
Picscout
PictureFinder
Pimonster
Pi-Monster
PleaseCrawl
plumanalytics
ProWebWalker
Pump
PyCurl
Quick-Crawler
RankActiveLinkBot
RankurBot
RealDownload
RebelMouse
ReGet
RepoMonkey
Rogerbot
SBIder
Scanbot
scan.lol
Semrush
SemrushBot
Seomoz
seoscanners
Shodan
SiteExplorer
SiteSnagger
Snake
Snapbot
Snoopy
SpaceBison
sp_auditbot
Spbot
SputnikBot
spyfu
Sqlmap
Sqworm
Sucuri
SuperBot
Surfbot
Szukacz
T0PHackTeam
T8Abot
tAkeOut
Teleport
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Toweyabot
Trendiction
TwengaBot
Twice
Upflow
Vagabondo
VB Project
VeriCiteCrawler
Virusdie
VoidEYE
Voil
Voltron
Wallpapers/3.0
WASALive-Bot
Webalta
Web Auto
WebBandit
WebCollage
Web Collage
WEBDAV
WebEnhancer
WebFetch
Web Fetch
WebFuck
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebPix
WebsiteQuester
Website Quester
WebStripper
WebSucker
Web Sucker
WebWhacker
WeSEE
Whack
Whacker
Whatweb
WinHTTrack
WiseGuys Robot
WISENutbot
Wonderbot
Wotbox
WWW-Collector-E
x09Mozilla
Xaldon_WebSpider
Xenu
xpymep1.exe
YoudaoBot
zauba.io
Zermelo
ZmEu
ZumBot
ZyBorg