404checker
404enemy
Abonti
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
Alexibot
Alligator
AllSubmitter
Anarchie
arquivo.pt
ASPSeek
Attach
autoemailspider
AwarioSmartBot
BackStreet
Bandit
BatchFTP
BBBike
BDCbot
BDFetch
Bitacle
Blow
BuiltBotTough
Cegbfeieh
CherryPicker
Chlooe
Cliqzbot
Cloud mapping
com.plumanalytics
crawler.feedback
CrazyWebCrawler
Custo
DatabaseDriverMysqli
DBLBot
Deusu
Devil
DigitalPebble
DIIbot
Disco
Discoverybot
DomainCrawler
DomainStatsBot
Dotbot
DTS Agent
eCatch
evc-batch
Evil
Express WebPictures
ExtractorPro
Ezooms
facebookscraper
FDM
FemtosearchBot
Firefox/7.0
Flunky
Foobot
FyberSpider
Genieo
GermCrawler
GetWeb
Gotit
Grabber
GrabNet
GrapeFX
GrapeshotCrawler
GridBot
HaosouSpider
heritrix
HMView
HTTP::Lite
Iblog
IDBot
Id-search
IlseBot
Image Fetch
Intelliseek
Internet Ninja
InternetSeer
internetVista monitor
Iria
IRLbot
Iskanie
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JikeSpider
Jorgee
Keyword Density
LeechFTP
LexiBot
LinkextractorPro
LinkScan
LinkWalker
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
LNSpiderguy
Ltx71
lwp-request
LWP::Simple
Magnet
Mag-Net
Majestic-SEO
MarkWatch
Masscan
MauiBot
meanpathbot
Meanpathbot
Mediatoolkitbot
mediawords
Metauri
Microsoft URL Control
MIDown tool
MIIxpc
Mister PiX
Mojeek
Mojolicious
Morfeus Fucking Scanner
MSIECrawler
Msrabot
Name Intelligence
Nameprotect
Navroad
NetAnts
netEstate NE Crawler
Netvibes
NetZIP
Niki-bot
Nikto
Ninja
oBot
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
OrangeBot
OutfoxBot
PageAnalyzer
page scorer
Pandalytics
pcBrowser
PECL::HTTP
PHPCrawl
Picscout
Pimonster
PleaseCrawl
plumanalytics
Probethenet
ProWebWalker
PxBroker
PyCurl
Quick-Crawler
RankActive
RankFlex
RankingBot
Reaper
Recorder
RedesScrapy
RepoMonkey
Ripper
Rogerbot
SalesIntelligent
scan.lol
ScoutJet
Screaming
Searchestate
Semrush
SemrushBot
SEOstats
sexsearcher
Shodan
SiteExplorer
Siteimprove
SiteSucker
SlySearch
Snake
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
SpankBot
Spanner
Spbot
Spinn3r
SputnikBot
spyfu
Sqlmap
Sqlworm
Sqworm
Sucuri
Surfbot
SurveyBot
Suzuran
Swiftbot
sysscan
T8Abot
tAkeOut
TeleportPro
Telesoft
Telesphorep
Titan
Toweyabot
trendiction.de
Turingos
Turnitin
UnisterBot
URLy Warning
Vacuum
VB Project
Virusdie
VoidEYE
Wallpapers/3.0
WBSearchBot
Web Auto
WebBandit
WebCollage
Web Collage
WEBDAV
WebFuck
WebLeacher
WebmasterWorldForumBot
WebPix
WebReaper
WebsiteExtractor
WebsiteQuester
Webster
Web Sucker
Whacker
Widow
WiseGuys Robot
WWW::Mechanize
x22Mozilla
Xaldon_WebSpider
xpymep1.exe
YoudaoBot
Zauba
zauba.io
Zermelo
Zitebot
ZumBot
ZyBorg