404checker
404enemy
Abonti
Aboundex
Acunetix
ADmantX
AfD-Verbotsverfahren
AiHitBot
Aipbot
AllSubmitter
AlphaBot
Anarchie
Apexoo
arquivo.pt
arquivo-web-crawler
Asterias
Attach
autoemailspider
AwarioSmartBot
Backlink-Ceck
backlink-check
BackWeb
Bandit
Barkrowler
BBBike
BetaBot
Black Hole
BlackWidow
Blow
Brandprotect
BuiltBotTough
Calculon
CATExplorador
CazoodleBot
Cegbfeieh
CheeseBot
ChinaClaw
Cliqzbot
Cloud mapping
Collector
Copier
CopyRightCheck
crawler4j
crawler.feedback
Crescent
DataCha0s
DBLBot
demandbase-bot
Demon
Deusu
Devil
Digincore
DigitalPebble
Dirbuster
Disco
Dispatch
DomainSigmaCrawler
DomainStatsBot
Dotbot
Download Wonder
DSearch
Ebingbong
eCatch
ECCP/1.0
EMail Wolf
Evil
Express WebPictures
ExtLinksBot
Ezooms
FDM
FemtosearchBot
FHscan
Fimap
Foobot
Freeuploader
FrontPage
FyberSpider
Genieo
GetWeb
Gigabot
Grabber
GrabNet
GrapeFX
GridBot
Haansoft
Havij
Heritrix
Hloader
HMView
HTMLparser
InfoNaviRobot
instabid
InterGET
Internet Ninja
internetVista monitor
ips-agent
Iria
IRLbot
Joomla
Jorgee
JustView
Jyxobot
LeechFTP
LeechGet
LibWeb
Lightspeedsystems
Likse
Linkdexbot
LinkpadBot
LinksManager
Lipperhey Spider
LWP::Simple
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkWatch
Masscan
Mass Downloader
Meanpathbot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MFC_Tear_Sample
Microsoft Data Access
MIIxpc
Mojolicious
Mr.4x3
Msrabot
muhstik-scan
Name Intelligence
Nameprotect
Navroad
NetAnts
netEstate NE Crawler
NetSpider
NICErsPRO
NimbleCrawler
Ninja
NPbot
Nutch
oBot
OnCrawl
Openfind
OpenVAS
PageAnalyzer
PageGrabber
page scorer
Pandalytics
Pavuk
pcBrowser
PECL::HTTP
Pimonster
Pixray
plumanalytics
POE-Component-Client-HTTP
ProPowerBot
Psbot
PxBroker
RankActive
RankActiveLinkBot
RankFlex
RebelMouse
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
RSSingBot
s1z.ru
Scanbot
ScoutJet
Scrapy
ScreenerBot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
serpstatbot
SISTRIX
SiteExplorer
Siteimprove
SiteLockSpider
Snake
Snapbot
Snoopy
sogouspider
Sogou web spider
Sosospider
Sottopop
Spammen
SpankBot
Spanner
sp_auditbot
Spinn3r
SputnikBot
Sqworm
Steeler
Sucuri
SuperHTTP
Surfbot
SurveyBot
tAkeOut
Telesoft
Telesphorep
trendiction.com
True_Robot
Turnitin
TwengaBot
UnisterBot
URLy Warning
URLy.Warning
Vacuum
Vagabondo
VCI
VeriCiteCrawler
Virusdie
Voil
Voltron
Wallpapers/3.0
WBSearchBot
Webalta
Web Collage
WEBDAV
WebEnhancer
WebFuck
WebGo IS
WebPix
WebReaper
WebSauger
Webshag
Website Quester
Webster
WebStripper
Web Sucker
Whatweb
Who.is Bot
Widow
Wonderbot
Wprecon
WPScan
WWW-Collector-E
Xaldon WebSpider
Xaldon_WebSpider
Xenu
Zade
Zauba
Zermelo
Zitebot
ZmEu
ZumBot