404enemy
80legs
Abonti
Acunetix
AhrefsBot
AIBOT
AiHitBot
Aipbot
AlphaBot
Apexoo
arquivo-web-crawler
Asterias
Backlink-Ceck
BackStreet
Bandit
Bitacle
BlackWidow
BLEXBot
Blow
Boardreader
Bolt
BotALot
Brandwatch
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CATExplorador
CazoodleBot
CCBot
Cegbfeieh
CheeseBot
Chlooe
cognitiveseo
Collector
CopyRightCheck
Copyscape
Craftbot
crawler.feedback
Crescent
Curious
demandbase-bot
Demon
DigitalPebble
Dirbuster
DittoSpyder
DnyzBot
DomainAppender
Dragonfly
Ebingbong
Ecxi
EirGrabber
EMail Wolf
EroCrawler
Evil
ExtractorPro
Extreme Picture Finder
EyeNetIE
Firefox/7.0
FlashGet
Freeuploader
GalaxyBot
Genieo
GetWeb
Gigabot
GoZilla
GrabNet
GrapeFX
GrapeshotCrawler
GT::WWW
Haansoft
Havij
HEADMasterSEO
Heritrix
HMView
HTTP::Lite
HTTrack
Iblog
Id-search
IlseBot
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
InterGET
internetVista monitor
Iria
IRLbot
Iskanie
Jbrofuzz
JennyBot
JetCar
Jetty
JOC Web Spider
Joomla
Jorgee
Kenjin Spider
Kozmosbot
Lanshanbot
LeechGet
Libwhisker
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
LWP::Simple
lwp-trivial
Magnet
Mag-Net
Majestic12
Majestic SEO
Majestic-SEO
Mass Downloader
meanpathbot
Meanpathbot
Microsoft Data Access
Microsoft URL Control
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
MSFrontPage
Msrabot
Musobot
Name Intelligence
Navroad
NetSpider
Nettrack
Net Vampire
Netvibes
NextGenSearchBot
Nimbostratus
NPbot
oBot
Offline Navigator
OnCrawl
Openfind
OpenLinkProfiler
OrangeBot
OrangeSpider
Page Analyzer
Pandalytics
Panscient
PECL::HTTP
PeoplePal
Pixray
PleaseCrawl
PyCurl
RankFlex
RankingBot
RankingBot2
RankurBot
Reaper
RebelMouse
ReGet
Ripper
RocketCrawler
Scanbot
scan.lol
Screaming
ScreenerBot
SearchmetricsBot
Semrush
SemrushBot
SEOkicks-Robot
Seomoz
SEOprofiler
SeoSiteCheckup
serpstatbot
sexsearcher
Shodan
SISTRIX
Sitebeam
SiteExplorer
Siteimprove
SiteLockSpider
SiteSnagger
Sitevigil
Snake
Snoopy
Sosospider
SpaceBison
Spanner
Spbot
Sqlmap
Sqlworm
Sqworm
Steeler
SuperBot
SuperHTTP
SurveyBot
Swiftbot
sysscan
Szukacz
tAkeOut
Telesphorep
TheNomad
Thumbor
TightTwatBot
Toata
Toweyabot
Trendictionbot
trendiction.com
True_Robot
Turingos
TurnitinBot
TwengaBot
Typhoeus
UnisterBot
Vacuum
Vagabondo
VCI
VeriCiteCrawler
Voil
Voltron
Wallpapers/3.0
WASALive-Bot
WBSearchBot
Webalta
Web Auto
WebCollage
Web Collage
WebCopier
WebFetch
Web Fetch
WebFuck
Web Fuck
WebGo IS
WebmasterWorldForumBot
webmeup-crawler
WebPix
Web Pix
WebReaper
Webshag
Webster
WebSucker
Web Sucker
Whacker
Whatweb
Who.is Bot
WinHTTrack
Wonderbot
WWW-Collector-E
Xaldon WebSpider
Xenu
YoudaoBot
Zade
Zeus
zgrab
Zitebot
ZmEu