360Spider
404checker
404enemy
Aboundexbot
ADmantX
AhrefsBot
AiHitBot
Aipbot
Alligator
Apexoo
archive.org_bot
ASPSeek
BacklinkCrawler
BatchFTP
BBBike
BetaBot
Bigfoot
Bitacle
BlackWidow
BLEXBot
BlowFish
BotALot
BuiltBotTough
CazoodleBot
Cegbfeieh
Claritybot
Cloud mapping
coccocbot-web
Cogentbot
cognitiveseo
Collector
Copier
Craftbot
crawl.sogou.com
Crescent
Custo
DatabaseDriverMysqli
DataCha0s
DBLBot
demandbase-bot
Demon
DigitalPebble
DIIbot
Dirbuster
Discobot
Discoverybot
Dispatch
DnyzBot
DomainAppender
DomainCrawler
DomainSigmaCrawler
Dotbot
Download Wonder
Dragonfly
Drip
eCatch
ECCP/1.0
Ecxi
EirGrabber
Exabot
Extractor
ExtractorPro
Extreme Picture Finder
FHscan
Firefox/7.0
FlashGet
FyberSpider
Genieo
GermCrawler
GetRight
GetWeb
Gigabot
G-i-g-a-b-o-t
GoZilla
GrabNet
GrapeshotCrawler
Haansoft
Harvest
Havij
HEADMasterSEO
Heritrix
HTMLparser
HTTP::Lite
HTTrack
Humanlinks
HybridBot
IDBot
Id-search
Image Fetch
Image Sucker
IndeedBot
instabid
Intelliseek
Internet Ninja
Iria
JamesBOT
Jbrofuzz
JetCar
Jetty
JikeSpider
JOC Web Spider
Joomla
Jorgee
JustView
Kozmosbot
Lanshanbot
Larbin
Lftp
LinkpadBot
LinksManager
LinkWalker
Litemage_walker
Lmspider
lwp-request
LWP::Simple
Magnet
Mail.RU_Bot
Majestic-SEO
Masscan
MauiBot
meanpathbot
Meanpathbot
MeanPath Bot
mediawords
Metauri
MFC_Tear_Sample
MIDown tool
Mister PiX
Morfeus Fucking Scanner
Mr.4x3
MSIECrawler
Nameprotect
Navroad
NearSite
Needle
NetAnts
Netcraft
netEstate NE Crawler
NetLyzer
NetMechanic
NetSpider
NextGenSearchBot
Nibbler
NICErsPRO
Niki-bot
NimbleCrawler
Nmap
NPbot
oBot
Openvas
OutclicksBot
OutfoxBot
PageGrabber
PageScorer
Panscient
Papa Foto
PeoplePal
PHPCrawl
Picsearch
PictureFinder
Pixray
PleaseCrawl
Pockey
ProPowerBot
Psbot
Pump
PxBroker
PyCurl
QueryN Metasearch
RankActive
RankingBot
Rankivabot
s1z.ru
ScanAlert
Screaming
ScreenerBot
SEOkicks-Robot
SEOlyticsCrawler
Seomoz
SEOprofiler
serpstatbot
Shodan
Siphon
Sitebeam
SiteExplorer
SlySearch
Snapbot
Sociscraper
Spammen
Spanner
Spbot
Spinn3r
SputnikBot
Sqlmap
Stripper
SuperHTTP
SurveyBot
Suzuran
Szukacz
Teleport
TeleportPro
Telesoft
Telesphorep
The Intraformant
Toata
Toweyabot
Trendictionbot
Turingos
Turnitin
UnisterBot
URLy.Warning
Vacuum
Vagabondo
VCI
VidibleScraper
VoidEYE
Voil
Voltron
Wallpapers/3.0
WallpapersHD
Web Collage
WEBDAV
Web Fetch
WebLeacher
WebmasterWorldForumBot
webmeup-crawler
WebReaper
WebsiteExtractor
WebStripper
Web Sucker
WebZIP
Whacker
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wotbox
Wprecon
WPScan
WWW-Mechanize
x22Mozilla
Xaldon WebSpider
Xenu
xpymep1.exe
Zauba
zauba.io
Zermelo
Zeus
zgrab
ZumBot