404checker
404enemy
Abonti
ADmantX
AfD-Verbotsverfahren
AhrefsBot
AIBOT
Alexibot
AllSubmitter
AlphaBot
Anarchie
Apexoo
arquivo-web-crawler
autoemailspider
AwarioRssBot
AwarioSmartBot
BackDoorBot
Backlink-Ceck
BackStreet
BackWeb
Bandit
BBBike
BDCbot
BDFetch
BetaBot
Bitacle
Blackboard
BlowFish
Boardreader
BotALot
BuiltBotTough
BunnySlippers
BuzzSumo
Calculon
ChinaClaw
Claritybot
Cliqzbot
coccocbot-web
Cogentbot
cognitiveseo
Collector
Copier
CopyRightCheck
CrazyWebCrawler
CSHttp
DatabaseDriverMysqli
DataCha0s
DBLBot
Demon
Devil
Dirbuster
Discoverybot
DittoSpyder
DomainSigmaCrawler
DomainStatsBot
Dotbot
DSearch
EasyDL
Ecxi
EMail Siphon
EMail Wolf
evc-batch
Express WebPictures
ExtLinksBot
Extractor
Extreme Picture Finder
FHscan
Fimap
FlashGet
Flunky
GalaxyBot
GetRight
Gigablast
Go-Ahead-Got-It
GoZilla
Grafula
GrapeFX
Harvest
Havij
Heritrix
HMView
HTMLparser
HTTP::Lite
HybridBot
Image Sucker
IndeedBot
Indy Library
InfoTekies
Intelliseek
Internet Ninja
Iskanie
Jbrofuzz
Jetty
JikeSpider
JOC Web Spider
Jorgee
Jyxobot
Kenjin Spider
Kozmosbot
Lanshanbot
Larbin
LeechFTP
LexiBot
LibWeb
Likse
Linkdexbot
LinkScan
LinkWalker
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Lmspider
LNSpiderguy
Ltx71
lwp-request
lwp-trivial
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
meanpathbot
Meanpathbot
MeanPath Bot
mediawords
MegaIndex.ru
Metauri
MFC_Tear_Sample
Microsoft Data Access
Mister PiX
MJ12bot
Mojeek
Mojolicious
Morfeus Fucking Scanner
MSIECrawler
muhstik-scan
Name Intelligence
Nameprotect
NearSite
Needle
netEstate NE Crawler
NetSpider
Net Vampire
Netvibes
NextGenSearchBot
Nibbler
Nikto
NimbleCrawler
Nimbostratus
Ninja
Nmap
NPbot
oBot
Octopus
Openfind
OpenLinkProfiler
OpenVAS
OrangeBot
PageGrabber
page scorer
Panscient
Papa Foto
PECL::HTTP
PeoplePal
Picsearch
Pimonster
plumanalytics
ProPowerBot
ProWebWalker
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
RankurBot
RealDownload
Reaper
RepoMonkey
SalesIntelligent
SBIder
Scanbot
scan.lol
Scrapy
Screaming
Searchestate
Semrush
SEOkicks
serpstatbot
Siphon
SiteSucker
SMTBot
Snake
Snoopy
SocialRankIOBot
sogouspider
Sosospider
Sottopop
SputnikBot
Steeler
Sucker
Sucuri
SuperHTTP
Suzuran
T0PHackTeam
T8Abot
tAkeOut
TeleportPro
The Intraformant
Thumbor
Titan
Toata
trendiction.de
TwengaBot
Typhoeus
Vagabondo
Virusdie
Voil
Wallpapers/3.0
WallpapersHD
WASALive-Bot
WBSearchBot
Web Auto
Web Collage
WEBDAV
Web Enhancer
WebFuck
Web Fuck
WebGo IS
WebImageCollector
WebSauger
Web Sauger
Webshag
WebsiteExtractor
WebsiteQuester
Website Quester
Webster
Web Sucker
Who.is Bot
WinHTTrack
Wonderbot
Wprecon
WPScan
WWW::Mechanize
x22Mozilla
Xaldon_WebSpider
Zade
ZmEu